-- Logs begin at Mon 2022-04-11 19:05:18 UTC, end at Mon 2022-04-11 20:35:42 UTC. -- Apr 11 19:38:29.203161 dv-cinder-830787-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 11 19:38:29.212126 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 19:38:29 2022] *** Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: nodename: dv-cinder-830787-3-iscsi Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: machine: x86_64 Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: clock source: unix Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: pcre jit disabled Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: detected number of CPU cores: 4 Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: current working directory: / Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: detected binary path: /usr/bin/uwsgi-core Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: your processes number limit is 47680 Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: your memory page size is 4096 bytes Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: detected max file descriptor number: 2048 Apr 11 19:38:29.214183 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: lock engine: pthread robust mutexes Apr 11 19:38:29.215136 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: thunder lock: enabled Apr 11 19:38:29.215136 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 19:38:29.215136 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 19:38:29.258541 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: Python main interpreter initialized at 0x5625e256e9c0 Apr 11 19:38:29.258541 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: python threads support enabled Apr 11 19:38:29.258541 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: your server socket listen backlog is limited to 100 connections Apr 11 19:38:29.258541 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: your mercy for graceful operations on workers is 90 seconds Apr 11 19:38:29.258871 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 19:38:29.258950 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: *** Operational MODE: preforking *** Apr 11 19:38:29.259189 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: *** uWSGI is running in multiple interpreter mode *** Apr 11 19:38:29.259189 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: spawned uWSGI master process (pid: 109254) Apr 11 19:38:29.259375 dv-cinder-830787-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 11 19:38:29.259871 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: spawned uWSGI worker 1 (pid: 109255, cores: 1) Apr 11 19:38:29.260202 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: spawned uWSGI worker 2 (pid: 109256, cores: 1) Apr 11 19:38:29.260362 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 19:38:30.424918 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 19:38:30.430278 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 19:38:31.266378 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 19:38:31.266378 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: from cryptography.utils import int_from_bytes Apr 11 19:38:31.266690 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 19:38:31.266690 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: from cryptography.utils import int_from_bytes Apr 11 19:38:31.272874 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 19:38:31.272874 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: from cryptography.utils import int_from_bytes Apr 11 19:38:31.273223 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 19:38:31.273223 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: from cryptography.utils import int_from_bytes Apr 11 19:38:33.754420 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 19:38:33.755024 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 19:38:33.755210 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 19:38:33.755563 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 19:38:33.755817 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 19:38:33.756205 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.756335 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 19:38:33.756703 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.756805 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 19:38:33.756888 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.757199 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 19:38:33.757342 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.757538 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.757668 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 19:38:33.757765 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 19:38:33.757857 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.758123 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.758265 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.758430 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.758562 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.758748 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.758857 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.759005 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.759092 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.759308 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.759400 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.759636 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830787-3-iscsi {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.759727 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.759958 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.760046 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.760265 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.760361 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.760578 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.760676 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.760835 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.760955 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.761180 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.761280 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.761502 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830787-3-iscsi {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.761597 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.761811 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.761901 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.762113 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.762312 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.762414 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.763506 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.763604 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.763673 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.763747 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.763813 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.763876 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.763943 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.764008 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.764008 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.764138 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.764319 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.764399 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.764610 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.764704 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.764939 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.765086 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.765268 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.765360 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.765581 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.765736 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.765912 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.766002 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830787-3-iscsi {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.766256 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.766348 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.766564 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.766650 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.766883 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.766986 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.767191 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.767295 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.767581 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830787-3-iscsi {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.767667 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.767893 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.767976 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.768202 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.768302 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.768513 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.768597 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.768821 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.768921 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.769177 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.769264 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.769498 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.769590 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.769817 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.769909 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.770134 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.770223 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.770436 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.770544 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.770753 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.770845 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.771062 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.771152 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.771371 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.771464 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.771674 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.771757 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.771972 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.772061 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.772218 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.772310 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.772526 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.772611 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.772847 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.772950 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.773183 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.773274 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.773484 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.773575 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.773733 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.773863 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.773981 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.774076 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.774299 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.774390 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.774627 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.774764 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.774937 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.775029 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.775188 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.775283 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.775438 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.775538 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.775761 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.775851 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.776079 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.776173 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.776388 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.776479 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.776693 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.776785 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.777021 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.777121 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.777331 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.777432 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.777633 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.777726 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.777938 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.778046 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.778239 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.778325 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.778541 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.778632 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.778855 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.778945 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.779167 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.779253 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.779472 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.779554 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.779776 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.779870 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.780094 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.780218 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.780407 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.780554 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.780723 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.780814 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.781052 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.781139 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.781359 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.781441 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.781711 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.781848 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.782049 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.782134 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.782368 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.782457 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.782686 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.782778 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.782992 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.783123 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.783245 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.783330 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.783547 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.783632 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.783853 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.783937 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.784173 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.784293 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.784483 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.784578 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.784735 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.784837 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.785059 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.785151 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.785363 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.785454 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.785682 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.785771 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.785987 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.786082 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.786300 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.786394 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.786597 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.786686 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.786896 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.786985 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.787199 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.787296 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.787503 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.787598 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.787802 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.787899 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.788104 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.788203 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.788405 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.788503 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.788732 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.788834 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.789068 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.789161 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.789377 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.789467 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.789687 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.789787 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.789993 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.790091 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.790312 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.790409 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.790621 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.790722 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.790928 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.791024 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.791246 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.791344 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.791549 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.791647 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.791854 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.791943 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.792172 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.792267 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.792480 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.792646 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.792789 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.792886 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.793119 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.793220 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.793422 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.793519 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.793729 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.793825 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.794029 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.794133 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.794331 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.794433 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.794644 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.794731 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.794940 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.795035 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.795242 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.795329 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.795547 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.795635 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.795852 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.795941 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.796151 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.796238 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.796451 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.796539 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.796748 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.796850 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.797078 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.797168 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.797425 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.797521 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.797727 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.797816 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.798028 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.798118 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.798325 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.798413 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.798637 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.798738 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.798951 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.799042 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.799257 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.799353 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.799559 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.799661 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.799860 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.799956 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.800178 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:38:33.800266 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.800510 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.800612 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.800835 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.801005 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.801209 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.801299 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.801522 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.801622 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.801850 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.801939 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.802162 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.802257 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.802479 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.802569 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.802787 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.802875 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.803100 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.803189 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.803421 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.803510 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.803730 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.803824 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.804039 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.804128 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.804349 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.804448 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.804665 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.804759 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.805004 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.805095 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.805325 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.805423 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.805644 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.805732 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.805961 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.806050 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.806271 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.806359 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.806578 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.806667 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.806893 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.806983 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.807217 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.807306 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.807536 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.807626 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.807846 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.807943 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.808168 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.808311 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.808479 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.808622 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.808793 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.808986 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.809131 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.809272 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.809440 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.809583 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.809753 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.809904 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.810063 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.810205 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.810372 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.810513 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.810684 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.810843 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.810996 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.811141 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.811299 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.811440 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.811613 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.811762 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.811921 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.812061 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.812233 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.812374 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.812541 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.812683 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.812838 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.813064 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.813224 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.813378 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.813525 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.813660 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.813836 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.813981 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.814150 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.814292 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.814459 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.814640 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.814789 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.814943 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.815086 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.815309 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.815448 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.815583 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.815756 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.815896 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.816032 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.816174 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.816310 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.816446 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.816580 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.816724 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.816932 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.817089 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.817227 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.817364 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.817508 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.817644 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.817779 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.817963 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.818101 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.818242 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.818377 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.818521 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.818665 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.818819 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.818955 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.819091 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.819252 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.819705 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.819855 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.819992 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.820129 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.820264 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.820399 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.820535 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.820679 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.820824 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.821018 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.821159 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.821294 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.821429 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.821585 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.821729 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.821865 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.822000 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.822136 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.822286 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.822422 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.822558 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.822706 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.822842 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.822978 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.823122 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.823260 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.823401 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.823538 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.823680 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.823826 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.823971 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.824107 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.824244 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.824384 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.824530 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.824666 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.824814 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.824972 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.825115 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.825251 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.825388 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.825535 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.825682 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.825818 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.826027 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.826229 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.826392 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.826563 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.826712 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.826858 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.826996 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.827131 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.827267 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.827414 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.827551 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.827686 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.827821 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.827965 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.828102 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.828257 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.828395 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.828532 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.828667 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.828801 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.828994 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.829140 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.829276 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.829419 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.829557 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.829692 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.829844 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.829988 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.830143 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.830280 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.830422 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.830559 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.830741 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.830891 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.831036 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.831173 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.831317 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.831454 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.831681 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.831892 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.832048 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.832210 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.832354 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.832511 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.832666 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.832818 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.833014 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.833162 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.833305 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.833458 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.833602 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.833747 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.833897 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.834040 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.834203 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.834357 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.834508 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.834652 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.834796 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.834938 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.835080 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.835231 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.835383 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.835527 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.835669 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.835813 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.835956 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.836119 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.836263 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.836406 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.836547 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.836690 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.836842 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.837054 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.837199 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.837342 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.837484 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.837626 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.837779 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.837935 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.838078 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.838221 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.838363 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.838505 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.838656 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.838800 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.838951 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.839093 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.839234 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.839377 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.839528 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.839680 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.839833 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.839977 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.840118 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.840275 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.840418 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.840563 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.840704 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.840853 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.841023 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.841183 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.841327 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.841469 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.841611 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.841763 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.841904 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.842055 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.842207 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.842351 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.842499 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.842689 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.842845 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.843065 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.843211 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.843353 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.843498 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.843641 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.843793 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.843944 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.844095 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.844333 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.844480 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.844630 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.844781 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.844981 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.845142 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.845294 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.845438 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.845580 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.845731 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.845889 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.846032 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.846174 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.846323 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.846466 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.846619 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.846771 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.846915 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.847057 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.847205 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.847350 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.847502 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.847734 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.847891 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.848035 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.848177 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.848335 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.848479 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.848621 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.848763 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.848927 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.849077 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.849234 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.849378 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.849520 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.849673 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.849824 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.849974 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.850131 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.850282 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.850426 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.850576 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.850727 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.850871 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.851061 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.851215 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.851358 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.851504 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.851657 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.851809 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.851953 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.852100 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.852242 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.852384 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.852526 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.852687 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.852831 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.853014 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.853158 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.853300 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.853453 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.853628 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.853779 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.853922 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.854071 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.854215 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.854356 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.854507 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.854652 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.854804 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.854947 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.855089 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.855241 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.855392 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.855559 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.855713 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.855858 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.856000 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.856151 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.856295 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.856438 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.856589 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.856733 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.856875 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.857058 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.857204 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.857358 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.857506 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.857649 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.857792 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.857945 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.858096 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.858247 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.858392 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.858542 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.858692 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.858836 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.858979 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.859120 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.859274 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.859415 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.859566 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.859715 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.860068 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.860236 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.860388 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.860546 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.860703 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.860855 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.861042 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.861187 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.861380 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.861541 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.861701 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.861846 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.862035 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.862194 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.862347 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.862498 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.862656 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.862814 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.862972 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.863130 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.863281 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.863436 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.863579 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.863721 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.863879 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.864038 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.864189 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.864339 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.864488 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.864635 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.864786 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.864983 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.865145 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.865291 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.865452 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.865605 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.865749 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.865892 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.866041 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.866184 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.866333 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.866551 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.866696 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.866839 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.866980 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.867123 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.867265 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.867435 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.867609 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.867755 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.867897 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.868039 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.868180 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.868337 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.868487 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.868628 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.868780 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.868961 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.869128 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.869275 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.869430 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.869600 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.869600 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.869885 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.869885 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.870167 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.870311 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.870456 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.870605 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.870756 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.870908 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.871050 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.871204 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.871353 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.871525 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.871670 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.871823 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.871966 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.872108 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.872250 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.872392 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.872544 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.872687 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.872829 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.873030 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.873187 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.873330 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.873502 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.873502 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.873785 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.873927 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.874076 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.874219 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.874370 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.874520 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.874672 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.874815 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.874957 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.875113 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.875265 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.875456 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.875916 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.876068 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.876211 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.876361 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.876513 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.876664 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.876808 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.876971 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.877120 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.877275 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.877438 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.877581 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.877751 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.877896 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.878038 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.878219 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.878366 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.878508 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.878657 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.878801 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.878944 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.879104 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.879259 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.879401 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.879545 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.879698 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.879852 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.880003 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.880152 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.880294 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.880437 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.880578 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.880729 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.880874 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.881064 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.881218 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.881370 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.881524 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.881677 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.881821 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.881973 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.882116 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.882262 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.882405 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.882562 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.882712 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.882864 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.883008 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.883160 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.883313 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.883457 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.883599 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.883743 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.883897 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.884042 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.884197 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.884348 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.884498 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.884649 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.884798 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.884963 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.885135 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.885287 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.885430 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.885572 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.885714 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.885882 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.886042 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.886188 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.886331 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.886481 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.886623 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.886784 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.886935 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.887093 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.887237 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.887393 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.887536 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.887690 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.887840 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.887984 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.888133 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.888278 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.888427 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.888580 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.888724 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.888876 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.889048 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.889203 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.889356 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.889509 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.889652 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.889794 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.889936 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.890078 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.890232 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.890378 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.890519 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.890661 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.890813 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.890965 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.891170 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.891323 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.891470 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.891613 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.891755 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.891911 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.892062 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.892213 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.892357 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.892507 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.892657 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.892810 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.893009 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.893159 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.893301 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.893453 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.893597 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.893739 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.893890 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.894034 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.894176 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.894326 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.894469 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.894686 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.894849 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.895007 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.895150 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.895293 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.895435 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.895587 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.895737 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.895888 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.896031 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.896174 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.896316 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.896471 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.896616 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.896772 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.896966 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.897118 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.897262 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.897421 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.897574 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.897721 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.897871 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.898020 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.898176 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.898320 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.898462 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.898614 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.898758 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.898900 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.899051 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.899195 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.899337 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.899493 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.899637 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.899789 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.899942 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.900085 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.900227 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.900376 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.900530 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.900681 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.900834 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.901016 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.901162 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.901320 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.901466 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.901466 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.901748 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.901902 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.902053 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.902196 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.902344 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.902508 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.902652 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.902796 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.902940 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.903082 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.903224 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.903375 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.903518 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.903661 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.903816 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.903960 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.904110 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.904272 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.904424 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.904568 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.904711 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.904866 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.905074 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.905220 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.905363 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.905518 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.905662 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.905805 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.905961 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.906107 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.906260 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.906444 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.906548 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.906629 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.906722 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.906801 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.906884 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.907112 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.907256 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.907426 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.907570 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.907748 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.907878 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.908039 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.908169 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.908362 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.908492 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.908760 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.908945 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.909050 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.909135 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.909386 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.909515 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.909795 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.909923 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.910108 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.910236 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.910420 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.910550 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.910721 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.910824 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.911042 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.911141 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.911342 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.911428 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.911654 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.911755 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.911966 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.912053 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.912278 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.912373 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.912596 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.912685 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.912918 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.913007 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.913235 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.913340 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.913537 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.913625 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.913839 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.913926 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.914156 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.914259 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.914477 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.914574 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.914794 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.914889 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.915110 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.915206 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.915506 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.915593 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.915820 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.915902 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.916133 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.916217 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.916457 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.916553 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.916761 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.916853 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.917097 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.917183 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.917402 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.917488 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.917710 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.917794 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.918013 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.918098 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.918317 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.918401 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.918627 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.918712 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.918931 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.919015 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.919240 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.919332 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.919549 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.919632 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.919854 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.919945 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.920158 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.920243 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.920462 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.920555 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.920771 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.920857 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.921099 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.921192 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.921422 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.921519 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.921736 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.921822 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.922055 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.922144 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.922483 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.922600 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.922735 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.922819 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.923046 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.923129 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.923356 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.923473 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.923661 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.923769 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.923965 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.924057 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.924268 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.924356 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.924606 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.924697 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.925000 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.925090 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.925252 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.925339 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.925581 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.925674 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.925894 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.925985 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.926215 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.926300 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.926550 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.926649 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.926868 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.926969 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.927179 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.927268 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.927497 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.927587 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.927801 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.927959 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.928106 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.928267 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.928412 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.928553 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.928694 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.928846 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.929015 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.929186 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.929335 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.929478 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.929633 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.929787 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.929931 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.930074 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.930235 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.930393 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.930547 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.930690 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.930832 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.930981 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.931125 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.931268 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.931419 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.931564 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.931707 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.931856 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.932000 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.932181 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.932335 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.932487 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.932630 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.932773 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.932942 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.933095 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.933253 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.933399 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.933542 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.933700 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.933843 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.934004 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.934157 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.934308 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.934453 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.934602 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.934754 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.934907 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.935050 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.935192 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.935335 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.935478 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.935621 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.935776 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.935936 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.936081 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.936224 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.936366 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.936510 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.936661 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.936805 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.936965 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.937113 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.937268 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.937411 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.937566 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.937711 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.937865 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.938039 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.938189 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.938342 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.938486 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.938654 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.938988 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.939172 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.939321 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.939498 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.939650 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.939803 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.939966 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.940110 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.940253 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.940406 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.940550 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.940693 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.940835 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.941013 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.941171 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.941324 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.941478 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.941630 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.941776 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.941930 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.942082 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.942227 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.942377 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.942520 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.942669 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.942815 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.942972 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.943117 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.943317 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.943468 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.943644 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.943814 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.943969 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.944120 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.944262 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.944413 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.944583 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.944745 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.944962 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.945132 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.945286 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.945428 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.945590 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.945735 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.945888 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.946031 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.946174 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.946316 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.946475 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.946627 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.946770 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.946912 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.947079 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.947228 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.947384 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.947538 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.947681 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.947824 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.947966 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.948119 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.948274 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.948427 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.948578 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.948796 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.948992 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.949157 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.949311 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.949467 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.949610 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.949756 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.949906 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.950059 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.950213 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.950355 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.950506 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.950653 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.950805 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.950950 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.951225 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.951387 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.951533 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.951676 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.951854 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.952005 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.952173 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.952331 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.952482 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.952639 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.952802 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.952975 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.953125 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.953269 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.953436 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.953636 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.953794 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.953939 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.954081 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.954231 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.954377 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.954540 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.954693 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.954838 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.954980 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.955123 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.955264 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.955427 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.955580 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.955746 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.955897 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.956042 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.956184 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.956517 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.956679 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.956832 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.957038 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.957186 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.957338 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.957496 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.957639 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.957782 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.957924 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.958068 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.958219 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.958363 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.958507 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.958661 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.958826 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.958978 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.959129 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.959274 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.959434 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.959580 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.959723 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.959866 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.960016 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.960160 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.960302 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.960445 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.960589 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.960740 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.960884 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.961050 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.961193 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.961348 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.961491 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.961653 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.961798 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.961949 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.962092 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.962237 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.962391 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.962545 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.962689 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.962833 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.962974 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.963117 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.963275 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.963493 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.963640 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.963784 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.963926 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.964068 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.964219 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.964363 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.964522 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.964676 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.964820 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.965015 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.965182 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.965328 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.965471 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.965622 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.965765 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.965909 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.966060 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.966204 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.966356 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.966501 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.966728 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.966879 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.967032 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.967187 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.967330 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.967484 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.967627 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.967771 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.967928 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.968072 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.968216 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.968359 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.968500 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.968652 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.968797 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.968976 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.969159 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.969310 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.969453 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.969605 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.969750 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.969894 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.970038 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.970181 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.970348 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.970572 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.970718 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.970861 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.971177 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.971349 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.971503 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.971658 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.971801 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.971949 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.972126 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.972288 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.972441 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.972593 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.972737 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.972880 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.973084 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.973245 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.973398 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.973543 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.973686 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.973829 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.973971 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.974114 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.974266 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.974411 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.974554 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.974716 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.974860 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.975017 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.975171 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.975316 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.975465 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.975609 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.975752 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.975903 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.976047 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.976199 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.976343 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.976487 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.976635 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.976795 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.976982 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.977143 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.977288 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.977432 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.977583 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.977728 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.977871 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.978014 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.978157 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.978299 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.978451 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.978603 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.978747 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.978910 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.979054 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.979196 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.979347 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.979501 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.979644 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.979786 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.979928 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.980071 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.980226 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.980370 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.980515 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.980675 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.980819 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.981036 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.981187 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.981354 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.981499 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.981650 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.981793 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.981945 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.982089 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.982264 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.982416 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.982572 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.982727 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.982901 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.983052 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.983198 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.983372 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.983518 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.983675 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.983821 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.983965 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.984141 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.984299 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.984466 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.984644 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.984843 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.985026 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.985172 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.985315 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.985497 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.985659 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.985806 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.985948 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.986112 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.986261 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.986414 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.986574 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.986718 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.986863 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.987006 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.987161 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.987314 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.987463 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.987613 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.987756 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.987908 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.988052 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.988206 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.988350 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.988510 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.988654 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.988804 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.989007 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.989159 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.989311 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.989455 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.989610 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.989760 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.989911 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.990064 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.990207 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.990350 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.990502 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.990645 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.990800 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.990943 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.991087 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.991230 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.991372 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.991514 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.991665 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.991816 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.991959 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.992102 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.992254 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.992405 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.992551 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.992693 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.992847 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.993079 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.993239 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.993392 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.993537 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.993686 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.993829 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.993972 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.994122 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.994284 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.994441 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.994590 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.994742 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.994887 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.995029 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.995181 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.995325 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.995468 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.995610 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.995752 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.995907 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.996051 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.996203 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.996347 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.996490 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.996632 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.996790 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.996964 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.997116 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.997261 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.997403 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.997545 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.997699 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.997843 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.997991 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.998152 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.998296 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.998440 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.998655 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.998800 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.998944 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.999091 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.999234 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.999387 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.999531 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.999675 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.999819 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:33.999979 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.000130 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.000282 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.000449 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.000921 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.001073 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.001216 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.001358 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.001514 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.001659 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.001801 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.001944 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.002096 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.002248 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.002391 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.002535 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.002678 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.002821 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.002964 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.003116 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.003266 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.003410 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.003561 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.003705 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.003848 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.004010 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.004154 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.004303 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.004487 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.004654 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.004811 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.005008 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.005157 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.005301 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.005443 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.005586 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.005738 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.005896 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.006039 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.006181 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.006324 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.006467 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.006618 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.006773 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.006916 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.007058 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.007208 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.007351 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.007503 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.007653 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 19:38:34.007809 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.008001 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:38:34.008245 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 19:38:34.030891 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:38:34.033024 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_db.sqlalchemy.engines [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:38:34.092716 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.context [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52b6058f-23f3-4720-b8c1-0d0a04c26f0f(cell1) {{(pid=109256) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 19:38:34.095325 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.context [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52b6058f-23f3-4720-b8c1-0d0a04c26f0f(cell1) {{(pid=109255) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 19:38:34.098639 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG oslo_concurrency.lockutils [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:38:34.100250 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG oslo_concurrency.lockutils [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:38:34.101073 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG oslo_concurrency.lockutils [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:38:34.101221 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:38:34.102696 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:38:34.103017 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG oslo_concurrency.lockutils [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:38:34.103525 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:38:34.105501 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:38:34.113683 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:38:34.116503 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:38:34.119578 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_db.sqlalchemy.engines [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:38:34.122707 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_db.sqlalchemy.engines [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:38:34.275183 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:38:34.279840 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_db.sqlalchemy.engines [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:38:34.723899 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: WARNING keystonemiddleware.auth_token [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:38:34.729589 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: WARNING keystonemiddleware.auth_token [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:38:34.730570 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: WARNING keystonemiddleware.auth_token [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:38:34.736208 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: WARNING keystonemiddleware.auth_token [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:38:34.947312 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: WARNING keystonemiddleware.auth_token [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:38:34.952606 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: WARNING keystonemiddleware.auth_token [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:38:34.954679 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: WARNING keystonemiddleware.auth_token [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:38:34.957794 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5625e256e9c0 pid: 109256 (default app) Apr 11 19:38:34.959815 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:38:34.959947 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: WARNING keystonemiddleware.auth_token [None req-44f53d9e-5779-42e1-8615-6cb10539eb16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:38:34.961043 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 Apr 11 19:38:34.961463 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Mon Apr 11 19:38:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:38:34.965140 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5625e256e9c0 pid: 109255 (default app) Apr 11 19:39:54.321168 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:54.322179 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Apr 11 19:39:54.322581 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:39:54.759480 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-10731083-2eff-4a4f-adb3-bee24fec829a admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:54.793784 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-10731083-2eff-4a4f-adb3-bee24fec829a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463191 Apr 11 19:39:54.800455 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Apr 11 19:39:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:57.152506 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:57.153690 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-7cf59c2d-8e67-4a73-a5f4-bc8f1b9f1908 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Apr 11 19:39:57.154378 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:39:57.223876 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-929b678e-c0bc-4e10-a82a-da2eaecc434a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "cirros256", "ram": 256, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:39:57.241857 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 19:39:57.241857 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: warnings.warn(msg) Apr 11 19:39:57.269724 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-929b678e-c0bc-4e10-a82a-da2eaecc434a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108903 Apr 11 19:39:57.273016 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:39:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:39:57.482230 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-74d4d33c-9cbc-414f-9420-d592b10c9be2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:39:57.484679 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 19:39:57.484679 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: warnings.warn(msg) Apr 11 19:39:57.534677 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-74d4d33c-9cbc-414f-9420-d592b10c9be2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.256121 Apr 11 19:39:57.540599 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Apr 11 19:39:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:39:59.884205 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-929b678e-c0bc-4e10-a82a-da2eaecc434a admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:39:59.885270 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-929b678e-c0bc-4e10-a82a-da2eaecc434a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Apr 11 19:39:59.885679 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:39:59.994443 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-c7809b05-04da-4cfc-9fe3-f173606fbafe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "disk": 5, "vcpus": 1, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:00.016280 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 19:40:00.016280 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: warnings.warn(msg) Apr 11 19:40:00.037122 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-c7809b05-04da-4cfc-9fe3-f173606fbafe admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145379 Apr 11 19:40:00.037984 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:39:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:00.052191 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-4eaa9ee6-82ef-40eb-ac6c-96a9aec7aabf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:00.054659 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 19:40:00.054659 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: warnings.warn(msg) Apr 11 19:40:00.093118 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-4eaa9ee6-82ef-40eb-ac6c-96a9aec7aabf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047021 Apr 11 19:40:00.093994 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Apr 11 19:40:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:02.420027 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-c7809b05-04da-4cfc-9fe3-f173606fbafe admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:02.421575 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-c7809b05-04da-4cfc-9fe3-f173606fbafe admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Apr 11 19:40:02.422118 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:02.486917 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-f18a358f-8669-4c2c-aa11-11c9a078f361 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "swap": 0, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:02.505145 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-f18a358f-8669-4c2c-aa11-11c9a078f361 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076963 Apr 11 19:40:02.505778 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:40:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:02.517576 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-9f9ce3e9-41b6-4358-bfb1-95a6ee7743c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:02.540000 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-9f9ce3e9-41b6-4358-bfb1-95a6ee7743c1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026109 Apr 11 19:40:02.545039 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Apr 11 19:40:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:04.871049 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-f18a358f-8669-4c2c-aa11-11c9a078f361 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:04.872111 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-f18a358f-8669-4c2c-aa11-11c9a078f361 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Apr 11 19:40:04.872504 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:04.933401 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-1ede2f46-a5ea-4697-8c8f-adf0efbdcd7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:04.952754 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-1ede2f46-a5ea-4697-8c8f-adf0efbdcd7a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073816 Apr 11 19:40:04.953351 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:40:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:04.965123 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-fe7f2ae4-9aec-4183-8b48-eea03613b791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:04.990082 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-fe7f2ae4-9aec-4183-8b48-eea03613b791 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028718 Apr 11 19:40:04.991166 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Apr 11 19:40:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:40:07.332784 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-1ede2f46-a5ea-4697-8c8f-adf0efbdcd7a admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:07.333877 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-1ede2f46-a5ea-4697-8c8f-adf0efbdcd7a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Apr 11 19:40:07.334240 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:07.396218 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-572e737c-675b-43d9-8f10-85ca2e23ae89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "id": "d4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:07.414735 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-572e737c-675b-43d9-8f10-85ca2e23ae89 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074625 Apr 11 19:40:07.422522 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:40:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:40:07.428194 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-b6dea514-47d6-4461-ad9c-b7fd8adf610f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:07.451625 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-b6dea514-47d6-4461-ad9c-b7fd8adf610f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027350 Apr 11 19:40:07.452367 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Apr 11 19:40:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:09.773038 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-572e737c-675b-43d9-8f10-85ca2e23ae89 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:09.774097 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-572e737c-675b-43d9-8f10-85ca2e23ae89 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Apr 11 19:40:09.774682 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:09.837175 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-a3ac8072-218f-4228-9ae9-9a7eacf9387b admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:09.861002 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-a3ac8072-218f-4228-9ae9-9a7eacf9387b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078468 Apr 11 19:40:09.861545 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Apr 11 19:40:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:40:12.182938 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-572e737c-675b-43d9-8f10-85ca2e23ae89 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:12.184190 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-572e737c-675b-43d9-8f10-85ca2e23ae89 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Apr 11 19:40:12.184716 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:12.244733 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-29f7232b-7c57-414e-b68c-181f01188126 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "vcpus": 1}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:12.264685 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-29f7232b-7c57-414e-b68c-181f01188126 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072779 Apr 11 19:40:12.265276 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:40:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:12.277863 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-bf6cf6e6-7169-4250-aeb8-3e2f69bb8c1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:12.308217 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-bf6cf6e6-7169-4250-aeb8-3e2f69bb8c1f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034361 Apr 11 19:40:12.308981 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Apr 11 19:40:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:40:15.160531 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-29f7232b-7c57-414e-b68c-181f01188126 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:15.161671 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-29f7232b-7c57-414e-b68c-181f01188126 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Apr 11 19:40:15.162124 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:15.223707 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-b6369068-a712-44ac-a025-9fcb81d9a1f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:15.241165 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-b6369068-a712-44ac-a025-9fcb81d9a1f5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072404 Apr 11 19:40:15.241721 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:40:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:15.253982 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-8c161c33-f50e-4b4b-99d1-4bbf0daa0528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:15.277855 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-8c161c33-f50e-4b4b-99d1-4bbf0daa0528 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027475 Apr 11 19:40:15.278474 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Apr 11 19:40:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:40:18.016480 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-b6369068-a712-44ac-a025-9fcb81d9a1f5 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:18.017540 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-b6369068-a712-44ac-a025-9fcb81d9a1f5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Apr 11 19:40:18.017946 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:18.079270 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-ea7921d4-d8f4-469e-8298-233e735ed1c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:18.097511 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-ea7921d4-d8f4-469e-8298-233e735ed1c1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073294 Apr 11 19:40:18.098066 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:40:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:40:18.110040 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-3f214ced-081e-453a-aa59-ee19160d1381 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:18.132068 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-3f214ced-081e-453a-aa59-ee19160d1381 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025854 Apr 11 19:40:18.132646 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Apr 11 19:40:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:20.440034 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-ea7921d4-d8f4-469e-8298-233e735ed1c1 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:20.441082 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-ea7921d4-d8f4-469e-8298-233e735ed1c1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Apr 11 19:40:20.441453 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:20.496791 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-4b9b00ee-6650-4fe1-aee7-e51c2a6f8500 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 8192, "name": "m1.large", "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:20.514924 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-4b9b00ee-6650-4fe1-aee7-e51c2a6f8500 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.067525 Apr 11 19:40:20.520946 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:40:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:20.527466 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-5701b3a8-b1b0-4741-82ee-a26b2dc2c04b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:20.549558 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-5701b3a8-b1b0-4741-82ee-a26b2dc2c04b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025818 Apr 11 19:40:20.550129 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Apr 11 19:40:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:22.891479 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-4b9b00ee-6650-4fe1-aee7-e51c2a6f8500 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:22.892604 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-4b9b00ee-6650-4fe1-aee7-e51c2a6f8500 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Apr 11 19:40:22.893019 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:22.951096 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-cca7b163-c73b-4ecd-8799-a3aba3943e25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:22.970221 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-cca7b163-c73b-4ecd-8799-a3aba3943e25 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070911 Apr 11 19:40:22.971107 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Apr 11 19:40:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:40:22.983062 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-fbfae9fd-9e6e-4a9a-8f6e-35c74977527e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:23.009671 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-fbfae9fd-9e6e-4a9a-8f6e-35c74977527e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030302 Apr 11 19:40:23.024936 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Apr 11 19:40:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:40:46.319211 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-cca7b163-c73b-4ecd-8799-a3aba3943e25 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:46.320218 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-cca7b163-c73b-4ecd-8799-a3aba3943e25 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Apr 11 19:40:46.320614 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:46.380288 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-006db0f6-6cd5-4a89-9fe9-2a6c71325776 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:46.396894 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-006db0f6-6cd5-4a89-9fe9-2a6c71325776 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070450 Apr 11 19:40:46.397450 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Apr 11 19:40:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:40:47.772584 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-cca7b163-c73b-4ecd-8799-a3aba3943e25 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:47.774230 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-cca7b163-c73b-4ecd-8799-a3aba3943e25 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Apr 11 19:40:47.774628 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:47.997928 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-49429c1d-8e5a-48db-998b-00806c450517 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:48.003918 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.wsgi [None req-49429c1d-8e5a-48db-998b-00806c450517 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 11 19:40:48.004483 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-49429c1d-8e5a-48db-998b-00806c450517 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:40:48.005310 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-49429c1d-8e5a-48db-998b-00806c450517 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064127 Apr 11 19:40:48.005814 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Apr 11 19:40:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 19:40:48.015320 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-549aa8a4-f2ae-4d5d-b4d9-6e7b00b636e5 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:48.036223 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-549aa8a4-f2ae-4d5d-b4d9-6e7b00b636e5 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024590 Apr 11 19:40:48.036776 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Apr 11 19:40:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:40:48.046544 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-fbb5ffa3-de5a-48ea-bd3d-17f18e473a4c admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:48.067452 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-fbb5ffa3-de5a-48ea-bd3d-17f18e473a4c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024412 Apr 11 19:40:48.068001 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Apr 11 19:40:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:40:48.077738 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-1cd103c4-fc05-4ecc-ac06-f6ad857dabfa admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:48.083419 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.wsgi [None req-1cd103c4-fc05-4ecc-ac06-f6ad857dabfa admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 11 19:40:48.083987 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-1cd103c4-fc05-4ecc-ac06-f6ad857dabfa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:40:48.084779 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-1cd103c4-fc05-4ecc-ac06-f6ad857dabfa admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010720 Apr 11 19:40:48.085309 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Apr 11 19:40:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 19:40:49.346436 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-fbb5ffa3-de5a-48ea-bd3d-17f18e473a4c admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:49.347447 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-fbb5ffa3-de5a-48ea-bd3d-17f18e473a4c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Apr 11 19:40:49.347846 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:49.556305 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-7cc1346a-de47-46f1-9089-3a1ace568c65 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:49.562120 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.wsgi [None req-7cc1346a-de47-46f1-9089-3a1ace568c65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 11 19:40:49.562587 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-7cc1346a-de47-46f1-9089-3a1ace568c65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:40:49.563394 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-7cc1346a-de47-46f1-9089-3a1ace568c65 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072996 Apr 11 19:40:49.563914 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Apr 11 19:40:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 19:40:49.573618 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-0fdbac0b-1b5d-4000-bb8e-51d78b3ef825 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:49.587198 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-0fdbac0b-1b5d-4000-bb8e-51d78b3ef825 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017277 Apr 11 19:40:49.587753 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Apr 11 19:40:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:40:49.597379 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-81c4e38b-7f46-4771-962e-ec867a2f445f admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:49.611440 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-81c4e38b-7f46-4771-962e-ec867a2f445f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017605 Apr 11 19:40:49.611967 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Apr 11 19:40:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:40:49.621293 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-0baaea51-dc3c-4e5e-93c2-9ab49b16cdeb admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:49.627100 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.wsgi [None req-0baaea51-dc3c-4e5e-93c2-9ab49b16cdeb admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 11 19:40:49.627659 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-0baaea51-dc3c-4e5e-93c2-9ab49b16cdeb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:40:49.628439 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-0baaea51-dc3c-4e5e-93c2-9ab49b16cdeb admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010762 Apr 11 19:40:49.628962 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Apr 11 19:40:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 19:40:50.867102 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-81c4e38b-7f46-4771-962e-ec867a2f445f admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:50.868106 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-81c4e38b-7f46-4771-962e-ec867a2f445f admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Apr 11 19:40:50.868504 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:51.065845 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-d917bd05-524f-4968-9c77-02802c5534f1 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:51.073902 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.wsgi [None req-d917bd05-524f-4968-9c77-02802c5534f1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 11 19:40:51.074650 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-d917bd05-524f-4968-9c77-02802c5534f1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:40:51.075796 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-d917bd05-524f-4968-9c77-02802c5534f1 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072659 Apr 11 19:40:51.076488 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Apr 11 19:40:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 19:40:51.088801 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-00f6387b-fb97-4346-8b39-172fa5543b0b admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:51.102817 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-00f6387b-fb97-4346-8b39-172fa5543b0b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018062 Apr 11 19:40:51.103306 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Apr 11 19:40:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:40:51.114319 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:51.128389 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018344 Apr 11 19:40:51.128944 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Apr 11 19:40:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:40:51.138863 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-510d1feb-145c-4cb2-9a5b-a3c54bbfe035 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:51.144827 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.wsgi [None req-510d1feb-145c-4cb2-9a5b-a3c54bbfe035 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 11 19:40:51.145423 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-510d1feb-145c-4cb2-9a5b-a3c54bbfe035 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:40:51.146216 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-510d1feb-145c-4cb2-9a5b-a3c54bbfe035 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011176 Apr 11 19:40:51.146725 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Apr 11 19:40:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 19:40:52.408353 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:52.409404 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Apr 11 19:40:52.409780 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:40:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:52.602662 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-127ce578-be86-46e2-a732-508575595700 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:52.622519 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-127ce578-be86-46e2-a732-508575595700 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.077113 Apr 11 19:40:52.623069 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Apr 11 19:40:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:53.874295 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:53.875325 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001840 Apr 11 19:40:53.875719 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:54.068184 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-6c57b09c-103b-4a93-be5d-d96c4cf1315f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:54.087475 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-6c57b09c-103b-4a93-be5d-d96c4cf1315f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077520 Apr 11 19:40:54.087918 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Apr 11 19:40:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:55.340896 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:55.341967 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Apr 11 19:40:55.342367 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:40:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:55.536932 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-302aa994-b45e-4e61-9412-24c93569e360 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:55.558489 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-302aa994-b45e-4e61-9412-24c93569e360 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.082875 Apr 11 19:40:55.559045 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Apr 11 19:40:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:56.830552 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:56.831594 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Apr 11 19:40:56.832029 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:57.040509 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-72c0df8f-4697-49e1-aa88-88866e1185d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:40:57.061615 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-72c0df8f-4697-49e1-aa88-88866e1185d9 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.091277 Apr 11 19:40:57.062160 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Apr 11 19:40:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:40:58.334047 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:58.335433 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Apr 11 19:40:58.335937 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:40:58.536336 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-a887e2e0-5f94-4646-ab6e-791fcf792112 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:40:58.562299 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-a887e2e0-5f94-4646-ab6e-791fcf792112 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.091582 Apr 11 19:40:58.562824 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Mon Apr 11 19:40:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:42:02.174294 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:02.175975 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-bff0e7b0-a481-4e4c-9ec4-b35037529622 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Apr 11 19:42:02.176373 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 930 bytes} [Mon Apr 11 19:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:42:02.246637 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-3518cf4a-f19f-4d0b-840d-e54ee30b4912 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:02.267520 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-3518cf4a-f19f-4d0b-840d-e54ee30b4912 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.084691 Apr 11 19:42:02.268067 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Apr 11 19:42:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:42:02.293797 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-8c7d801f-f7f4-4833-90ef-07a7fb92d207 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:02.305982 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-8c7d801f-f7f4-4833-90ef-07a7fb92d207 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018999 Apr 11 19:42:02.306768 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1282 bytes} [Mon Apr 11 19:42:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:42:02.318745 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-25972053-f890-44f5-aa36-2416ae1058c8 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:02.328509 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-25972053-f890-44f5-aa36-2416ae1058c8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013045 Apr 11 19:42:02.329097 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1285 bytes} [Mon Apr 11 19:42:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:42:02.344194 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-50ef8508-8ad0-466f-b0a3-1528a97467bc admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:02.354934 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-50ef8508-8ad0-466f-b0a3-1528a97467bc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014372 Apr 11 19:42:02.355394 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1285 bytes} [Mon Apr 11 19:42:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:42:02.366850 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:42:02.375633 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012334 Apr 11 19:42:02.376387 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1282 bytes} [Mon Apr 11 19:42:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:43:46.508137 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-c1caa6db-236e-43db-bfc4-022b044d481e tempest-verify_tempest_config-1757461064 tempest-verify_tempest_config-1757461064-project] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:43:46.510309 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-c1caa6db-236e-43db-bfc4-022b044d481e tempest-verify_tempest_config-1757461064 tempest-verify_tempest_config-1757461064-project] 10.222.0.62 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.138874 Apr 11 19:43:46.510848 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 34/69] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Apr 11 19:43:46 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:45:30.389817 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:30.390812 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Apr 11 19:45:30.391199 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 36/70] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:45:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:30.659550 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-932ff24f-6c10-46d2-a4ae-3ee9ff67c55c admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:30.660687 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 19:45:30.660687 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: warnings.warn(msg) Apr 11 19:45:30.662046 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-932ff24f-6c10-46d2-a4ae-3ee9ff67c55c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:45:30.662485 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-932ff24f-6c10-46d2-a4ae-3ee9ff67c55c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:45:30.663357 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-932ff24f-6c10-46d2-a4ae-3ee9ff67c55c admin admin] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:45:30.663800 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-932ff24f-6c10-46d2-a4ae-3ee9ff67c55c admin admin] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:45:30.699054 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-932ff24f-6c10-46d2-a4ae-3ee9ff67c55c admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.168533 Apr 11 19:45:30.699637 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 35/71] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Apr 11 19:45:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:45:32.002115 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:32.003835 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002469 Apr 11 19:45:32.004540 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 37/72] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:45:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:32.203331 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-62cec886-875c-4397-9b51-653ee202f7fb admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:32.204488 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 19:45:32.204488 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: warnings.warn(msg) Apr 11 19:45:32.205740 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-62cec886-875c-4397-9b51-653ee202f7fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:45:32.206183 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-62cec886-875c-4397-9b51-653ee202f7fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:45:32.206960 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-62cec886-875c-4397-9b51-653ee202f7fb admin admin] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:45:32.207455 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-62cec886-875c-4397-9b51-653ee202f7fb admin admin] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:45:32.226576 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-62cec886-875c-4397-9b51-653ee202f7fb admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081287 Apr 11 19:45:32.227147 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 36/73] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Apr 11 19:45:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:45:43.933157 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:43.934173 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Apr 11 19:45:43.934600 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 38/74] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:45:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:44.161477 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-ebad536d-c186-4497-9b50-fa595e2b76e0 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:44.162636 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 19:45:44.162636 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: warnings.warn(msg) Apr 11 19:45:44.163858 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-ebad536d-c186-4497-9b50-fa595e2b76e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:45:44.164292 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-ebad536d-c186-4497-9b50-fa595e2b76e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:45:44.165122 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-ebad536d-c186-4497-9b50-fa595e2b76e0 admin admin] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:45:44.165554 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-ebad536d-c186-4497-9b50-fa595e2b76e0 admin admin] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:45:44.190236 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-ebad536d-c186-4497-9b50-fa595e2b76e0 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088861 Apr 11 19:45:44.190750 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 37/75] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Apr 11 19:45:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:45:45.520290 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: DEBUG nova.api.openstack.wsgi [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] Calling method '>' {{(pid=109256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:45.521374 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: INFO nova.api.openstack.requestlog [None req-9d3ceb1a-0266-400b-89b5-1a5ba4e22318 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Apr 11 19:45:45.521785 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: [pid: 109256|app: 0|req: 39/76] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Apr 11 19:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:45:45.717439 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG nova.api.openstack.wsgi [None req-100fa416-9493-46f1-a4df-d154baf8df90 admin admin] Calling method '>' {{(pid=109255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:45:45.718680 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 19:45:45.718680 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: warnings.warn(msg) Apr 11 19:45:45.720113 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-100fa416-9493-46f1-a4df-d154baf8df90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:45:45.720591 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-100fa416-9493-46f1-a4df-d154baf8df90 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:45:45.721485 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-100fa416-9493-46f1-a4df-d154baf8df90 admin admin] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:45:45.721848 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: DEBUG oslo_concurrency.lockutils [None req-100fa416-9493-46f1-a4df-d154baf8df90 admin admin] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:45:45.744620 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: INFO nova.api.openstack.requestlog [None req-100fa416-9493-46f1-a4df-d154baf8df90 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085711 Apr 11 19:45:45.745250 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: [pid: 109255|app: 0|req: 38/77] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Apr 11 19:45:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:46:47.133479 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: Mon Apr 11 19:46:47 2022 - graceful shutdown triggered... Apr 11 19:46:47.133605 dv-cinder-830787-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 11 19:46:47.134603 dv-cinder-830787-3-iscsi devstack@n-api.service[109256]: Gracefully killing worker 2 (pid: 109256)... Apr 11 19:46:47.135483 dv-cinder-830787-3-iscsi devstack@n-api.service[109255]: Gracefully killing worker 1 (pid: 109255)... Apr 11 19:46:48.134020 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: worker 1 buried after 1 seconds Apr 11 19:46:48.134020 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: worker 2 buried after 1 seconds Apr 11 19:46:48.134020 dv-cinder-830787-3-iscsi devstack@n-api.service[109254]: goodbye to uWSGI. Apr 11 19:46:48.136420 dv-cinder-830787-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 11 19:46:48.137393 dv-cinder-830787-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 11 19:46:48.141645 dv-cinder-830787-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 11 19:46:48.163369 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 19:46:48.187189 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 19:46:48 2022] *** Apr 11 19:46:48.188605 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 19:46:48.188758 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 19:46:48.188891 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: nodename: dv-cinder-830787-3-iscsi Apr 11 19:46:48.189701 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: machine: x86_64 Apr 11 19:46:48.189828 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: clock source: unix Apr 11 19:46:48.189938 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: pcre jit disabled Apr 11 19:46:48.190048 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: detected number of CPU cores: 4 Apr 11 19:46:48.190164 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: current working directory: / Apr 11 19:46:48.190282 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: detected binary path: /usr/bin/uwsgi-core Apr 11 19:46:48.190399 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: your processes number limit is 47680 Apr 11 19:46:48.190522 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: your memory page size is 4096 bytes Apr 11 19:46:48.190633 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: detected max file descriptor number: 2048 Apr 11 19:46:48.190750 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: lock engine: pthread robust mutexes Apr 11 19:46:48.191037 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: thunder lock: enabled Apr 11 19:46:48.191373 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 19:46:48.191587 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 19:46:48.237116 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: Python main interpreter initialized at 0x559b73b0c9c0 Apr 11 19:46:48.237116 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: python threads support enabled Apr 11 19:46:48.237116 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: your server socket listen backlog is limited to 100 connections Apr 11 19:46:48.237116 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: your mercy for graceful operations on workers is 90 seconds Apr 11 19:46:48.237569 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 19:46:48.237569 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: *** Operational MODE: preforking *** Apr 11 19:46:48.237817 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: *** uWSGI is running in multiple interpreter mode *** Apr 11 19:46:48.237817 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: spawned uWSGI master process (pid: 123619) Apr 11 19:46:48.238041 dv-cinder-830787-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 11 19:46:48.238692 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: spawned uWSGI worker 1 (pid: 123637, cores: 1) Apr 11 19:46:48.238957 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: spawned uWSGI worker 2 (pid: 123638, cores: 1) Apr 11 19:46:48.239083 dv-cinder-830787-3-iscsi devstack@n-api.service[123619]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 19:46:49.427816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 19:46:49.428455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 19:46:50.343087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 19:46:50.343087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: from cryptography.utils import int_from_bytes Apr 11 19:46:50.343430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 19:46:50.343430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: from cryptography.utils import int_from_bytes Apr 11 19:46:50.343430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 19:46:50.343430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: from cryptography.utils import int_from_bytes Apr 11 19:46:50.343742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 19:46:50.343742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: from cryptography.utils import int_from_bytes Apr 11 19:46:52.702766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 19:46:52.703395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 19:46:52.703639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 19:46:52.703963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 19:46:52.704219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 19:46:52.704638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.705002 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.705321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.705639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.705964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.706252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.706576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.706923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.707281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.707583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.707854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.708176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830787-3-iscsi {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.708505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.708870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.709296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.709622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.709930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.710253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.710574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.711066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.712551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.712551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.712551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.712551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.712888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.713332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.713463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.713725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.714038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.714353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.714764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830787-3-iscsi {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.715094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.715492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.715916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.716384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.716703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.717039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.717362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.717716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.717998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.718329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.718648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.718971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.719292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.719596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.719904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.720218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.720539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.720846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.721183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.721437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.721744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.722065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.722389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.722715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.722969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.723223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.723543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.723870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.724175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.724483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.724787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.725121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.725428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.725734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.726038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.726343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.726665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.726985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.727384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.727667 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.727987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.728389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.728641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.728979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.729088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 19:46:52.729520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 19:46:52.729611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.729611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.729842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 19:46:52.729956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.730208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 19:46:52.730301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.730469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 19:46:52.730568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.730834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.730929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.731144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.731277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.731453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.731561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.731771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.731870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.732113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.732226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.732415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.732520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.732666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.732828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.732993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.733188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.733300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.733525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.733702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.733807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.733920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.734096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.734215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.734432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830787-3-iscsi {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.734531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.734760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.734871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.735076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.735172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.735392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.735516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.735699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.735802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.736005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.736120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.736309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.736410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.736612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.736711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.736940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.737147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.737267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.737463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.737630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.737766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.737996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.738094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.738385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.738475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.738697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.738828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.739018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.739343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.739459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.739654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.739779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.739982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.740093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.740295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.740416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.740702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830787-3-iscsi {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.740804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.741044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.741130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.741361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.741466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.741707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.741813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.742027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.742182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.743541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.743631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.743719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.743818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.743909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.744961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.745891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.745891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.746941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.747097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.747191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.747191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.747343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.747553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.747655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.747806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.748131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.748550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.748781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.748877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.749062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.749163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.749318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.749422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.749645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.749745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.749970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.750062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.750281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.750440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.750594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.750722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.750905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.751056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.751212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.751412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.751522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.751706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.751818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.752021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.752128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.752334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.752502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.752661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.752759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.753000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.753107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.753315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.753406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.753627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.753725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.753948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.754039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.754265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.754365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.754597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.754688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.754907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.754996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.755221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.755310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.755540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.755639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.755853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.755949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.756169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.756268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.756490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.756587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.756799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.756895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.757138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.757236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.757451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.757548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.757781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.757930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.758112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.758271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.758420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.758635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.758774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.758918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.759055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.759196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.759345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.759487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.759647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.759782 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.759940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.760079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.760252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.760397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.760563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.760707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.760870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.761051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.761203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.761304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.761516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.761645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.761863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.761982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.762175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.762320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.762483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.762573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.762803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.762977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.763113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.763212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.763423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.763513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.763732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.763895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.764044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.764133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.764353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.764450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.764661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.764759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.764991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.765100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.765295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.765384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.765598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.765696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.765901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.766004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.766208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.766307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.766511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.766607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.766828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.766927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.767140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.767247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.767444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.767533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.767832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.767949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.768119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.768206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.768360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.768451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.768668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.768766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.768993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.769101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.769297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.769386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.769604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.769693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.769911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.770008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.770212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.770309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.770517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.770612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.770825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.770924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.771134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.771225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.771443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.771564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.771799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.771898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.772126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.772232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.772430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.772529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.772739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.772827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.773084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.773188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.773396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.773501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.773704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.773801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.774015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.774106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.774368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 19:46:52.774473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.774679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.774768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.775014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.775113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.775345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.775449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.775651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.775749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.775977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.776075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.776301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.776400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.776618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.776716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.776947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.777053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.777256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.777348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.777563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.777653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.777943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.778053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.778185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.778291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.778477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.778583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.778783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.778882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.779086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.779184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.779391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.779489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.779695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.779795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.780014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.780103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.780351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.780447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.780667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.780766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.781009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.781113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.781313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.781410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.781617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.781709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.781961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.782050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.782268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.782357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.782609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.782700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.782940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.783037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.783257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.783348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.783577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.783677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.783891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.783988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.784206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.784294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.784519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.784608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.784826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.784951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.785161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.785262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.785469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.785559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.785788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.785885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.786097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.786200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.786412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.786509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.786719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.786815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.787032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.787130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.787341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.787430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.787669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.787765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.787986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.788096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.788290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.788405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.788601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.788701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.788936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.789048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.789255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.789347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.789569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.789659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.789931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.790036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.790244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.790335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.790556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.790646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.790865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.790955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.791180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.791278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.791492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.791580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.791810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.791900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.792116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.792209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.792432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.792522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.792741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.792838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.793099 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.793190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.793407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.793514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.793729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.793862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.794032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.794154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.794343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.794445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.794660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.794747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.794975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.795065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.795284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.795383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.795591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.795680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.795910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.796008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.796214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.796317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.796523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.796619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.796834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.796954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.797166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.797269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.797470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.797566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.797779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.797876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.798091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.798229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.798425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.798525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.798692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.798798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.798995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.799094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.799307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.799439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.799613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.799710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.799916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.800008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.800228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.800374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.800531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.800636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.800827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.800963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.801162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.801262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.801483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.801630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.801803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.801901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.802106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.802203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.802409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.802508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.802716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.802845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.803022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.803111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.803324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.803423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.803623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.803721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.803926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.804015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.804238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.804334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.804548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.804645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.804850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.804961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.805188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.805280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.805545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.805647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.805858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.805957 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.806170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.806269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.806480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.806570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.806785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.806883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.807104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.807194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.807413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.807502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.807719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.807825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.808027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.808126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.808333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.808446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.808641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.808788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.808974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.809126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.809297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.809405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.809602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.809716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.809923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.810031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.810215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.810322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.810514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.810624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.810820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.810913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.811133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.811227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.811529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.811716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.811863 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.812050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.812167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.812369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.812485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.812694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.812787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.813039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.813155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.813357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.813464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.813699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.813800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.814028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.814201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.814371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.814521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.814678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.814771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.814992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.815084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.815299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.815399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.815604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.815711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.815915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.816005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.816217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.816314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.816521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.816611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.816823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.816983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.817163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.817254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.817467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.817568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.817772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.817873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.818074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.818176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.818377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.818481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.818692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.818833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.818993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.819101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.819300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.819415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.819602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.819703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.819922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.820022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.820228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.820347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.820528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.820628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.820829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.820961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.821221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.821341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.821562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.821656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.821867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.821969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.822204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.822305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.822517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.822619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.822834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.822935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.823149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.823257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.823449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.823540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.823753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.823851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.824067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.824160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.824371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.824461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.824672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.824770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.824998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.825105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.825307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.825398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.825611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.825722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.825918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.826011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.826225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.826325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.826535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.826641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.826843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.826943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.827145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.827244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.827454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.827554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.827756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.827871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.828064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.828224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.828373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.828519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.828654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.828819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.828977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.829111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.829263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.829358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.829571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.829667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.829872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.829969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.830182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.830300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.830482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.830593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.830797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.830898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.831100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.831201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.831403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.831502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.831705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.831804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.832014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.832114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.832320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.832464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.832677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.832834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.833018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.833187 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.833326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.833473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.833620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.833766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.833904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.834061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.834205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.834347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.834484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.834633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.834768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.834913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.835056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.835199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.835344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.835494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.835657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.835790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.835938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.836193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.836350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.836486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.836633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.836887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.837071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.837191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.837307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.837531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.837682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.837783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.837908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.838131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.838333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.838430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.838575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.838724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.838920 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.839083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.839248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.839342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.839541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.839647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.839855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.839960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.840155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.840309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.840440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.840583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.840766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.840926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.841106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.841207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.841465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.841566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.841770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.841869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.842076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.842173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.842390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.842489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.842697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.842788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.843005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.843101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.843318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.843412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.843624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.843714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.843939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.844030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.844246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.844378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.844561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.844651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.844865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.844990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.845193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.845294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.845496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.845593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.845804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.845904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.846107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.846198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.846425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.846523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.846748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.846849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.847072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.847163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.847376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.847465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.847686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.847855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.847993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.848086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.848305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.848503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.848653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.848830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.849034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.849209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.849358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.849523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.849617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.849834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.849933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.850141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.850232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.850452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.850567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.850760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.850858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.851066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.851166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.851376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.851477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.851686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.851788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.851991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.852092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.852356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.852460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.852672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.852790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.853008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.853117 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.853322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.853502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.853641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.853775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.853920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.854078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.854231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.854368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.854516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.854651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.854818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.854962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.855110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.855255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.855429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.855566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.855738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.855907 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.856063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.856209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.856346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.856489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.856625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.856760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.856960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.857066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.857270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.857435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.857598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.857747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.857917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.858057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.858225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.858367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.858537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.858697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.858849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.859024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.859155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.859247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.859461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.859563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.859774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.859865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.860103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.860194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.860426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.860614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.860738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.861077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.864268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.864418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.864527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.864627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.864715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.864808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.864928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865661 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.865955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.866948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.867843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.868040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.868206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.868355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.868511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.868658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.868806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.868921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.869915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.870929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.871082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.871334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.871474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.871655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.871807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.871910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.872067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.872256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.872406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.872575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.872712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.872873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.873073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.873167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.873602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.873823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.874005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.874108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.874194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.874410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.874607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.874698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.874791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.875051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.875205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.875340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.875461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.875679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.875821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.875952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.876053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.876294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.876435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.876550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.876638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.876886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.877076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.877184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.877282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.877487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.877605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.877828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.877937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.878130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.878226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.878444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.878543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.878750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.878856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.879068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.879252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.879349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.879475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.879694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.879793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.880021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.880127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.880336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.880435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.880651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.880796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.880995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.881096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.881301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.881413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.881601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.881707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.881910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.882007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.882210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.882317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.882512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.882725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.882831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.883045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.883142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.883357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.883455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.883699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.883810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.884012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.884119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.884320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.884436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.884614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.884720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.884944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.885055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.885266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.885381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.885570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.885668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.885854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.885961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.886152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.886293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.886475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.886580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.886778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.886880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.887109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.887211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.887426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.887520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.887746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.887854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.888070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.888217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.888380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.888534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.888701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.888848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.889041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.889199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.889340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.889527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.889655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.889854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.889967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.890164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.890279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.890481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.890587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.890798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.890935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.891128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.891222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.891456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.891558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.891773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.891865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.892084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.892175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.892392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.892645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.892753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.892995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.893106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.893312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.893420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.893625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.893719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.893941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.894083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.894252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.894419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.894564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.894734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.894875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.895062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.895184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.895392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.895487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.895702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.895793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.896014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.896192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.896329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.896421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.896638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.896748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.896969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.897082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.897300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.897393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.897613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.897705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.897928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.898029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.898243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.898337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.898556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.898650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.898864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.898967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.899217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.899351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.899550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.899722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.899859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.899954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.900184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.900330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.900520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.900668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.900809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.901015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.901144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.901238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.901456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.901572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.901766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.901860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.902073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.902167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.902385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.902490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.902695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.902790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.903019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.903112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.903351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.903455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.903675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.903783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.903987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.904095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.904299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.904395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.904613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.904742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.904972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.905165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.905315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.905482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.905648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.905814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.905967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.906141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.906293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.906465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.906623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.906783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.906933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.907100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.907241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.907425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.907557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.907733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.907865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.908037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.908172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.908347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.908483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.908658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.908797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.908984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.909115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.909310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.909478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.909622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.909762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.909914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.910058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.910198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.910335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.910510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.910618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.910931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.911024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.911238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.911370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.911547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.911687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.911852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.912011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.912197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.912335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.912504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.912652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.912842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.912970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.913188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.913291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.913514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.913621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.913846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.913977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.914163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.914255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.914480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.914580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.914805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.914899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.915110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.915203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.915420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.915523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.915727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.915821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.916030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.916122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.916338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.916432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.916642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.916758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.916981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.917093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.917287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.917394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.917589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.917698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.917893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.918005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.918200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.918464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.918572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.918792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.918884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.919095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.919190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.919394 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.919534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.919704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.919802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.920005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.920109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.920311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.920406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.920613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.920714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.921010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.921167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.921307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.921470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.921624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.921777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.921963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.922145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.922282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.922639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.922743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.922895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.923242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.923389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.923716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.924044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.924148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.924246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.924334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.924444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.924651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.924747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.924983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.925143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.925337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.925490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.925658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.925779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.926098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.926199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.926420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.926536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.927983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.928086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.928263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.928348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.928577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.928749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.928894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.928990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.929230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.929332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.929558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.929651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.929886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.929969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.930197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.930281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.930557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.930646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.930867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.930961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.931175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.931273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.931483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.931783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.931866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.932093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.932192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.932719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.932837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.932975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.933067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.933152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.933251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.933370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.933465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.933685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.933779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.934006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.934109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.934320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.934416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.934628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.934719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.934939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.935040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.935248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.935352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.935557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.935656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.935867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.935960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.936185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.936280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.936493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.936595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.936794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.936931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.937140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.937242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.937556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.937678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.937874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.938105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.938220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.938355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.938485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.938688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.938804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.939019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.939121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.939341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.939443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.939655 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.939758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.939984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.940085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.940295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.940389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.940605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.940707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.940958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.941056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.941263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.941358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.941572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.941681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.941882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.941985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.942210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.942358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.942491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.942591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.942794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.942887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.943115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.943217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.943398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.943495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.943700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.943794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.944012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.944105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.944315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.944426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.944621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.944777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.944938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.945035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.945247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.945342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.945551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.945644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.945849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.945950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.946176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.946273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.946476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.946579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.946777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.946881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.947080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.947175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.947381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.947475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.947687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.947791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.947988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.948083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.948293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.948398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.948590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.948695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.948891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.949046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.949216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.949359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.949547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.949652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.949898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.950144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.950246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.950467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.950597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.950790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.950925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.951100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.951203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.951421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.951530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.951732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.951835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.952051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.952361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.952467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.952631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.952737 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.952980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.953079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.953318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.953410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.953631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.953735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.953948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.954040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.954257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.954363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.954564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.954660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.954872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.954965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.955181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.955284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.955496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.955600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.955811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.955912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.956341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.956464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.956564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.956684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.956779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.957028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.957147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.957355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.957458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.957670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.957771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.957984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.958088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.958315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.958463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.958615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.958749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.958927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.959114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.959244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.959470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.959565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.959799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.959906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.960123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.960219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.960447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.960546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.960769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.960873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.961112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.961220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.961430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.961525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.961803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.961919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.962119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.962222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.962528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.962637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.962772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.962878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.963090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.963195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.963400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.963494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.963711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.963843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.964024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.964163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.964257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 19:46:52.964491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.964817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.965157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.965484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.965812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.966129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.966457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.966773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.967107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.967452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.967787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.968119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.968431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.968743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.969074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.969391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.969715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.970028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.970336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.970645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.970961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.971270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.971580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.971888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.972195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.972667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.972996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.973163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.973461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.973770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.974076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.974390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.974702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.975009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.975420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.975737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.976042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.976348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.976684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.977047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.977401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.977732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.978057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.978384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.978705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.979049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.979364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.979689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.980009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.980348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.980667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.981015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.981337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.981655 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.982148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.982600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.982740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.983163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.983599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.983711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.984018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.984356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.984678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.985015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.985355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.985675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.985991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.986316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.986632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.986949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.987270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.987591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.987701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_db.sqlalchemy.engines [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:46:52.987924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.988257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.988589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.988940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.989300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.989617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.989966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.990301 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.990620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.990937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.991250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 19:46:52.991498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 19:46:53.015266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_db.sqlalchemy.engines [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:46:53.051638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.context [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52b6058f-23f3-4720-b8c1-0d0a04c26f0f(cell1) {{(pid=123637) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 19:46:53.056123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:46:53.057771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:46:53.058573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:46:53.060507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:46:53.071679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_db.sqlalchemy.engines [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:46:53.072686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_db.sqlalchemy.engines [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:46:53.086039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.context [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52b6058f-23f3-4720-b8c1-0d0a04c26f0f(cell1) {{(pid=123638) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 19:46:53.091805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:46:53.093480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:46:53.094309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:46:53.096295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:46:53.110953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_db.sqlalchemy.engines [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:46:53.112277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_db.sqlalchemy.engines [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:46:53.233738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_db.sqlalchemy.engines [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:46:53.300934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_db.sqlalchemy.engines [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 19:46:53.689652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: WARNING keystonemiddleware.auth_token [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:46:53.696256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: WARNING keystonemiddleware.auth_token [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:46:53.766244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: WARNING keystonemiddleware.auth_token [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:46:53.772974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: WARNING keystonemiddleware.auth_token [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:46:53.916073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: WARNING keystonemiddleware.auth_token [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:46:53.921462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: WARNING keystonemiddleware.auth_token [None req-16d6493e-0f8f-4126-9736-2177073eea7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:46:53.926911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559b73b0c9c0 pid: 123637 (default app) Apr 11 19:46:54.011746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: WARNING keystonemiddleware.auth_token [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 19:46:54.018258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: WARNING keystonemiddleware.auth_token [None req-c01e51bd-6a80-4201-b3f2-285509c1a051 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 19:46:54.026693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b73b0c9c0 pid: 123638 (default app) Apr 11 19:47:41.086287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2108177677", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "networks": [{"uuid": "13470833-cbf2-460b-9d41-bd335bd9414e"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:41.640317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] validate_networks() for [('13470833-cbf2-460b-9d41-bd335bd9414e', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:47:44.128322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:47:44.129768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:47:44.131557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:47:44.132757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:47:44.133924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:47:44.172539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:44.173215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:44.177365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:44.178005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:44.263515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Getting quotas for project f9ee47275a8f47118b9684a347efca87. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:47:44.288974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Getting quotas for user c20929015e45493ebcf4faf78aeeab78 and project f9ee47275a8f47118b9684a347efca87. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:47:44.337336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:47:44.340743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:47:44.606207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-18b7eacc-87e3-42c0-bc23-c1d195541b48 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.739416 Apr 11 19:47:44.607209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:47:45.265950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5a119d1-b4bc-450c-a562-c5f0e4f2a666 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:45.269180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5a119d1-b4bc-450c-a562-c5f0e4f2a666 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:47:46.260828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5a119d1-b4bc-450c-a562-c5f0e4f2a666 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:47:46.282399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5a119d1-b4bc-450c-a562-c5f0e4f2a666 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1215 microversion: 2.1 time: 1.667595 Apr 11 19:47:46.285628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1/2] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:47:44 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1215 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:47.305385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a0e34e21-d5e6-4fa8-b78c-9a96a3812ba5 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:47.306842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a0e34e21-d5e6-4fa8-b78c-9a96a3812ba5 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:47:47.319415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0e34e21-d5e6-4fa8-b78c-9a96a3812ba5 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:47.320458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0e34e21-d5e6-4fa8-b78c-9a96a3812ba5 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:47.322996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0e34e21-d5e6-4fa8-b78c-9a96a3812ba5 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:47.326560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0e34e21-d5e6-4fa8-b78c-9a96a3812ba5 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:47.385376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-72e719dd-de46-41ed-9f64-3afc6698f53d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: .version_select at 0x7f408c2f9700>, body: {"keypair": {"name": "tempest-keypair-624933815"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:47.464664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-72e719dd-de46-41ed-9f64-3afc6698f53d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:47:47.477229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-72e719dd-de46-41ed-9f64-3afc6698f53d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:47:47.920959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a0e34e21-d5e6-4fa8-b78c-9a96a3812ba5 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:47:47.966305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a0e34e21-d5e6-4fa8-b78c-9a96a3812ba5 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1267 microversion: 2.1 time: 0.666759 Apr 11 19:47:47.971215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:47:47 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1267 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:48.271948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-72e719dd-de46-41ed-9f64-3afc6698f53d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:47:48.284752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-72e719dd-de46-41ed-9f64-3afc6698f53d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:47:48.314495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-72e719dd-de46-41ed-9f64-3afc6698f53d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.614915 Apr 11 19:47:48.315882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 2/4] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 19:47:46 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:48.995616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-63808643-ca19-4f24-a4f8-95599fc23c62 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:48.999759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-63808643-ca19-4f24-a4f8-95599fc23c62 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:47:49.039740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63808643-ca19-4f24-a4f8-95599fc23c62 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:49.041865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63808643-ca19-4f24-a4f8-95599fc23c62 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:49.043794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63808643-ca19-4f24-a4f8-95599fc23c62 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:49.044867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63808643-ca19-4f24-a4f8-95599fc23c62 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:49.427101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-63808643-ca19-4f24-a4f8-95599fc23c62 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:47:49.438248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-63808643-ca19-4f24-a4f8-95599fc23c62 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1273 microversion: 2.1 time: 0.453007 Apr 11 19:47:49.441951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 3/5] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:47:48 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1273 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:50.462632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6bcbcc54-46c2-4d64-aba2-409c034c8f8c tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:50.463995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6bcbcc54-46c2-4d64-aba2-409c034c8f8c tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:47:50.542478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6bcbcc54-46c2-4d64-aba2-409c034c8f8c tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:50.543286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6bcbcc54-46c2-4d64-aba2-409c034c8f8c tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:50.547626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6bcbcc54-46c2-4d64-aba2-409c034c8f8c tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:50.558281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6bcbcc54-46c2-4d64-aba2-409c034c8f8c tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:51.099944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6bcbcc54-46c2-4d64-aba2-409c034c8f8c tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:47:51.161685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6bcbcc54-46c2-4d64-aba2-409c034c8f8c tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1273 microversion: 2.1 time: 0.703951 Apr 11 19:47:51.162310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 3/6] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:47:50 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1273 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:52.183221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e87fa20e-e5d1-41bb-ba3d-e84d63116a06 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:52.183683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e87fa20e-e5d1-41bb-ba3d-e84d63116a06 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:47:52.194678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e87fa20e-e5d1-41bb-ba3d-e84d63116a06 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:52.201341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e87fa20e-e5d1-41bb-ba3d-e84d63116a06 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:52.202622 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e87fa20e-e5d1-41bb-ba3d-e84d63116a06 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:52.206163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e87fa20e-e5d1-41bb-ba3d-e84d63116a06 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:55.114230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e87fa20e-e5d1-41bb-ba3d-e84d63116a06 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:47:55.135660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e87fa20e-e5d1-41bb-ba3d-e84d63116a06 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 2.959405 Apr 11 19:47:55.156218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:47:52 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 2980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:56.160174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7847a4fb-b2d8-4a62-9fa1-30e666960fda tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:56.160996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7847a4fb-b2d8-4a62-9fa1-30e666960fda tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:47:56.182945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7847a4fb-b2d8-4a62-9fa1-30e666960fda tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:56.195441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7847a4fb-b2d8-4a62-9fa1-30e666960fda tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:56.201384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7847a4fb-b2d8-4a62-9fa1-30e666960fda tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:56.204990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7847a4fb-b2d8-4a62-9fa1-30e666960fda tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:56.741048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7847a4fb-b2d8-4a62-9fa1-30e666960fda tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:47:56.752248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7847a4fb-b2d8-4a62-9fa1-30e666960fda tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.594451 Apr 11 19:47:56.753875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 5/8] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:47:56 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:47:56.870238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb3cc48e-6aae-4f1c-98d1-98adeab13f54 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Action: 'create', calling method: .version_select at 0x7f408c1e4700>, body: {"keypair": {"name": "tempest-keypair-840447429"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:56.914790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-eb3cc48e-6aae-4f1c-98d1-98adeab13f54 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:47:56.970452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-eb3cc48e-6aae-4f1c-98d1-98adeab13f54 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for user 6342f0d42fd04a6abd7d1da1e692de34 and project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:47:57.534492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-267302917", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31fd0e52-1286-4398-91da-eeb66b072c42"}], "security_groups": [{"name": "tempest-securitygroup--448598288"}], "key_name": "tempest-keypair-624933815", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:47:57.625475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-eb3cc48e-6aae-4f1c-98d1-98adeab13f54 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:47:57.640932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-eb3cc48e-6aae-4f1c-98d1-98adeab13f54 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for user 6342f0d42fd04a6abd7d1da1e692de34 and project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:47:57.727410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb3cc48e-6aae-4f1c-98d1-98adeab13f54 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.598434 Apr 11 19:47:57.732285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 4/9] 10.222.0.62 () {62 vars in 1198 bytes} [Mon Apr 11 19:47:56 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1606 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 11 19:47:57.770383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-77b6e180-8bb1-4ba3-9142-dbcba6ef8113 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:47:57.771285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-77b6e180-8bb1-4ba3-9142-dbcba6ef8113 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:47:57.781379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77b6e180-8bb1-4ba3-9142-dbcba6ef8113 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:57.782102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77b6e180-8bb1-4ba3-9142-dbcba6ef8113 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:57.782927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77b6e180-8bb1-4ba3-9142-dbcba6ef8113 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:47:57.786396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77b6e180-8bb1-4ba3-9142-dbcba6ef8113 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:47:58.559639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] validate_networks() for [('31fd0e52-1286-4398-91da-eeb66b072c42', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:47:59.606050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-77b6e180-8bb1-4ba3-9142-dbcba6ef8113 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:47:59.613750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-77b6e180-8bb1-4ba3-9142-dbcba6ef8113 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 1.847240 Apr 11 19:47:59.621594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 5/10] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:47:57 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:00.300854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2059377148", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:00.485379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] validate_networks() for [('99b55c31-7554-467c-91cc-9b60db5d7cec', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:48:02.931905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:48:02.932420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:48:02.932833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:48:02.933828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:48:02.934328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:48:02.993376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:02.999998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.001928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:03.003954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.098378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:48:03.098898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:48:03.099255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:48:03.099659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:48:03.100064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:48:03.114138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:48:03.123145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:03.123591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.125925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:03.128008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.147567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:48:03.165034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for project 97f4cd9fe29043878982a24319784c47. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:48:03.170104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for user cc87368fa6c24e50b4214a57d6783530 and project 97f4cd9fe29043878982a24319784c47. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:48:03.186847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:48:03.192985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:48:03.201150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:48:03.208496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:48:03.309116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5048c229-43a3-4ce4-8866-0aa44c23fe9f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.686019 Apr 11 19:48:03.310975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 6/11] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:47:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:48:03.450150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-71522ee6-ade9-4d5b-8a7d-d6f19d8cb162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.921056 Apr 11 19:48:03.452011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 6/12] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:47:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 5923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 19:48:03.458183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-876a5508-bfa8-4307-82f6-19480f11a287 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:03.458750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-876a5508-bfa8-4307-82f6-19480f11a287 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:03.477197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-876a5508-bfa8-4307-82f6-19480f11a287 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:03.477772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-876a5508-bfa8-4307-82f6-19480f11a287 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.478633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-876a5508-bfa8-4307-82f6-19480f11a287 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:03.479013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-876a5508-bfa8-4307-82f6-19480f11a287 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.625163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-95aa9842-46f4-4b20-a7b2-96778177f6d3 req-fa3eae96-2e3a-4737-b481-76d6f02a6bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d175e143-0fb4-46bc-acbf-99ed3710c59f", "tag": "e355d285-c51d-412d-84be-6b4cfc168e42"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:03.692958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-95aa9842-46f4-4b20-a7b2-96778177f6d3 req-fa3eae96-2e3a-4737-b481-76d6f02a6bed service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:03.698252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-95aa9842-46f4-4b20-a7b2-96778177f6d3 req-fa3eae96-2e3a-4737-b481-76d6f02a6bed service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.825669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-95aa9842-46f4-4b20-a7b2-96778177f6d3 req-fa3eae96-2e3a-4737-b481-76d6f02a6bed service nova] Creating event network-changed:e355d285-c51d-412d-84be-6b4cfc168e42 for instance d175e143-0fb4-46bc-acbf-99ed3710c59f on hv-cinder-83078 Apr 11 19:48:03.827920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-95aa9842-46f4-4b20-a7b2-96778177f6d3 req-fa3eae96-2e3a-4737-b481-76d6f02a6bed service nova] Acquired lock "compute-rpcapi-router" {{(pid=123637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 11 19:48:03.832420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438cd040-e7d8-43a3-96c1-4abf2ded54bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:03.833261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438cd040-e7d8-43a3-96c1-4abf2ded54bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.836017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438cd040-e7d8-43a3-96c1-4abf2ded54bb None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:03.838407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438cd040-e7d8-43a3-96c1-4abf2ded54bb None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:03.899258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.compute.rpcapi [None req-438cd040-e7d8-43a3-96c1-4abf2ded54bb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 11 19:48:03.909634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438cd040-e7d8-43a3-96c1-4abf2ded54bb None None] Releasing lock "compute-rpcapi-router" {{(pid=123637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 19:48:04.003004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-438cd040-e7d8-43a3-96c1-4abf2ded54bb None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.690307 Apr 11 19:48:04.004711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 7/13] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:04.015266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bc08c20c-2b23-4497-8a3e-cbc959420ccb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:04.032103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bc08c20c-2b23-4497-8a3e-cbc959420ccb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:04.090696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-876a5508-bfa8-4307-82f6-19480f11a287 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:04.098865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-876a5508-bfa8-4307-82f6-19480f11a287 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.645795 Apr 11 19:48:04.125396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 7/14] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:03 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:04.143398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ee28b4b-97aa-4b68-8056-96b0071cf2e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:04.144298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ee28b4b-97aa-4b68-8056-96b0071cf2e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:04.252068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bc08c20c-2b23-4497-8a3e-cbc959420ccb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:04.296676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bc08c20c-2b23-4497-8a3e-cbc959420ccb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1222 microversion: 2.1 time: 0.284512 Apr 11 19:48:04.298681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 8/15] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:04 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1222 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:04.408663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ee28b4b-97aa-4b68-8056-96b0071cf2e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:04.417664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ee28b4b-97aa-4b68-8056-96b0071cf2e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1240 microversion: 2.1 time: 0.289206 Apr 11 19:48:04.422388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1240 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:04.732355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-610458831", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:04.910886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] validate_networks() for [('99b55c31-7554-467c-91cc-9b60db5d7cec', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:48:05.131278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ad4911bb-89c0-42b6-81c7-2450c4cefdf4 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:05.131871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ad4911bb-89c0-42b6-81c7-2450c4cefdf4 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:05.165557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad4911bb-89c0-42b6-81c7-2450c4cefdf4 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:05.178054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad4911bb-89c0-42b6-81c7-2450c4cefdf4 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:05.181756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad4911bb-89c0-42b6-81c7-2450c4cefdf4 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:05.182781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad4911bb-89c0-42b6-81c7-2450c4cefdf4 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:06.168313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ad4911bb-89c0-42b6-81c7-2450c4cefdf4 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:06.192611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ad4911bb-89c0-42b6-81c7-2450c4cefdf4 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 1.065283 Apr 11 19:48:06.204936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 9/17] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:05 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:06.210147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-160207923", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4987ff82-d882-41eb-93e0-80dec0d86a06"}], "security_groups": [{"name": "tempest-securitygroup--2137672540"}], "key_name": "tempest-keypair-840447429", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:06.392099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] validate_networks() for [('4987ff82-d882-41eb-93e0-80dec0d86a06', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:48:06.520763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:48:06.521569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:48:06.522110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:48:06.522530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:48:06.523132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:48:06.537887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:06.538138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:06.538994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:06.542710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:06.588767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for project 97f4cd9fe29043878982a24319784c47. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:48:06.600116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for user cc87368fa6c24e50b4214a57d6783530 and project 97f4cd9fe29043878982a24319784c47. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:48:06.643983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:48:06.646868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:48:06.771673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3bec4d78-c622-4698-8343-494c134ee0ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.044823 Apr 11 19:48:06.780676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 9/18] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:48:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:48:06.799694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-accaa595-2fb4-4138-a117-2fb130f596b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:06.800317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-accaa595-2fb4-4138-a117-2fb130f596b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:07.329766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-accaa595-2fb4-4138-a117-2fb130f596b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:07.330218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-accaa595-2fb4-4138-a117-2fb130f596b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:07.331015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-accaa595-2fb4-4138-a117-2fb130f596b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:07.336677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-accaa595-2fb4-4138-a117-2fb130f596b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:07.820081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-accaa595-2fb4-4138-a117-2fb130f596b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:07.831321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-accaa595-2fb4-4138-a117-2fb130f596b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1300 microversion: 2.1 time: 1.038585 Apr 11 19:48:07.832546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 10/19] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1300 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:07.843666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e9041b8-0bb1-4e31-815a-c65952a8fe5f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:07.844623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e9041b8-0bb1-4e31-815a-c65952a8fe5f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:07.860050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e9041b8-0bb1-4e31-815a-c65952a8fe5f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:07.860551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e9041b8-0bb1-4e31-815a-c65952a8fe5f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:07.861775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e9041b8-0bb1-4e31-815a-c65952a8fe5f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:07.862485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e9041b8-0bb1-4e31-815a-c65952a8fe5f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:07.982102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e9041b8-0bb1-4e31-815a-c65952a8fe5f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:07.990816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e9041b8-0bb1-4e31-815a-c65952a8fe5f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1225 microversion: 2.1 time: 0.156683 Apr 11 19:48:07.994847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 11/20] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:07 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:08.009903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7c27921-b801-4ca0-944f-cfe34e6325d3 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:08.010946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7c27921-b801-4ca0-944f-cfe34e6325d3 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:08.031658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7c27921-b801-4ca0-944f-cfe34e6325d3 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:08.038454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7c27921-b801-4ca0-944f-cfe34e6325d3 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:08.045716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7c27921-b801-4ca0-944f-cfe34e6325d3 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:08.048632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7c27921-b801-4ca0-944f-cfe34e6325d3 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:08.290552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:48:08.291279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:48:08.291901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:48:08.292491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:48:08.293038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:48:08.324432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:08.328436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:08.330114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:08.330526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:08.362632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7c27921-b801-4ca0-944f-cfe34e6325d3 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:08.374411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7c27921-b801-4ca0-944f-cfe34e6325d3 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.373615 Apr 11 19:48:08.375702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 12/21] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:07 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:08.377938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:48:08.388270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for user 6342f0d42fd04a6abd7d1da1e692de34 and project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:48:08.436621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:48:08.439285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:48:08.527685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23df39ee-5784-4187-a9f6-1c872835d433 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.329543 Apr 11 19:48:08.533248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 10/22] 10.222.0.62 () {62 vars in 1187 bytes} [Mon Apr 11 19:48:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 11 19:48:08.538870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e21b8075-1eca-416e-ba0b-79cd757a93f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:08.539507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e21b8075-1eca-416e-ba0b-79cd757a93f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:08.659516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e21b8075-1eca-416e-ba0b-79cd757a93f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:08.671403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e21b8075-1eca-416e-ba0b-79cd757a93f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:08.677422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e21b8075-1eca-416e-ba0b-79cd757a93f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:08.679260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e21b8075-1eca-416e-ba0b-79cd757a93f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1280 microversion: 2.20 time: 0.144333 Apr 11 19:48:08.680957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 13/23] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:08.850817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c2c6f5b-3e67-48c5-a4f0-ff9b343e6e1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:08.851473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c2c6f5b-3e67-48c5-a4f0-ff9b343e6e1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:08.860025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c2c6f5b-3e67-48c5-a4f0-ff9b343e6e1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:08.860399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c2c6f5b-3e67-48c5-a4f0-ff9b343e6e1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:08.861234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c2c6f5b-3e67-48c5-a4f0-ff9b343e6e1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:08.868544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c2c6f5b-3e67-48c5-a4f0-ff9b343e6e1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:08.973109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c2c6f5b-3e67-48c5-a4f0-ff9b343e6e1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:08.981494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c2c6f5b-3e67-48c5-a4f0-ff9b343e6e1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1310 microversion: 2.1 time: 0.134429 Apr 11 19:48:08.992283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 11/24] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1310 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:09.013523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ea06c886-0ff2-46c5-a339-0de11455e661 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:09.014807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ea06c886-0ff2-46c5-a339-0de11455e661 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:09.022836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea06c886-0ff2-46c5-a339-0de11455e661 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:09.023754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea06c886-0ff2-46c5-a339-0de11455e661 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:09.024758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea06c886-0ff2-46c5-a339-0de11455e661 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:09.025368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea06c886-0ff2-46c5-a339-0de11455e661 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:09.129697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea06c886-0ff2-46c5-a339-0de11455e661 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:09.145722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ea06c886-0ff2-46c5-a339-0de11455e661 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1225 microversion: 2.1 time: 0.135756 Apr 11 19:48:09.146591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 14/25] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:09 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:09.395429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-529c747e-7ed5-432a-8d30-84208aecabca tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:09.397791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-529c747e-7ed5-432a-8d30-84208aecabca tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:09.405025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-529c747e-7ed5-432a-8d30-84208aecabca tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:09.405833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-529c747e-7ed5-432a-8d30-84208aecabca tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:09.406823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-529c747e-7ed5-432a-8d30-84208aecabca tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:09.407467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-529c747e-7ed5-432a-8d30-84208aecabca tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:09.568575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-529c747e-7ed5-432a-8d30-84208aecabca tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:09.578363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-529c747e-7ed5-432a-8d30-84208aecabca tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.187753 Apr 11 19:48:09.591994 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 12/26] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:09 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:09.698821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:09.699759 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:09.707571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:09.712177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:09.713873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:09.714531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:09.790866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:09.800035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:09.801937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:09.803244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e0eec652-44fb-484a-8ae8-a460de19cae8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1284 microversion: 2.20 time: 0.109019 Apr 11 19:48:09.804319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 15/27] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:09.998523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-18655c28-1b86-4357-9d0c-a871e6051b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:09.999369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-18655c28-1b86-4357-9d0c-a871e6051b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:10.005667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18655c28-1b86-4357-9d0c-a871e6051b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:10.006379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18655c28-1b86-4357-9d0c-a871e6051b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:10.007302 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18655c28-1b86-4357-9d0c-a871e6051b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:10.014909 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18655c28-1b86-4357-9d0c-a871e6051b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:10.106109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-18655c28-1b86-4357-9d0c-a871e6051b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:10.120378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-18655c28-1b86-4357-9d0c-a871e6051b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1310 microversion: 2.1 time: 0.125712 Apr 11 19:48:10.122845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 13/28] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1310 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:10.163201 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8b05355a-3be6-4a83-a980-245fa509e62f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:10.164117 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8b05355a-3be6-4a83-a980-245fa509e62f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:10.179461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b05355a-3be6-4a83-a980-245fa509e62f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:10.181333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b05355a-3be6-4a83-a980-245fa509e62f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:10.182383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b05355a-3be6-4a83-a980-245fa509e62f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:10.184456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b05355a-3be6-4a83-a980-245fa509e62f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:10.317835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8b05355a-3be6-4a83-a980-245fa509e62f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:10.334140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8b05355a-3be6-4a83-a980-245fa509e62f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1225 microversion: 2.1 time: 0.174862 Apr 11 19:48:10.344750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 16/29] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:10 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1225 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:10.595432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a35eee08-5037-47d3-a66b-24b4585c6385 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:10.596040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a35eee08-5037-47d3-a66b-24b4585c6385 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:10.604549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a35eee08-5037-47d3-a66b-24b4585c6385 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:10.605057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a35eee08-5037-47d3-a66b-24b4585c6385 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:10.605985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a35eee08-5037-47d3-a66b-24b4585c6385 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:10.606421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a35eee08-5037-47d3-a66b-24b4585c6385 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:10.829621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:10.830409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:10.843467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:10.848133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:10.849846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:10.851830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:11.311206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:11.329876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:11.335502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:11.336500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2c727f0-c223-4064-9593-72a270d0390b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1284 microversion: 2.20 time: 0.511223 Apr 11 19:48:11.341218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 17/30] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1284 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:11.343510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a35eee08-5037-47d3-a66b-24b4585c6385 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:11.354704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4ba6843-78f6-4aa6-915a-5c6d13789d76 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:11.357242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4ba6843-78f6-4aa6-915a-5c6d13789d76 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:11.364511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a35eee08-5037-47d3-a66b-24b4585c6385 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.767395 Apr 11 19:48:11.368076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 14/31] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:10 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:11.369740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ba6843-78f6-4aa6-915a-5c6d13789d76 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:11.374465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ba6843-78f6-4aa6-915a-5c6d13789d76 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:11.378006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ba6843-78f6-4aa6-915a-5c6d13789d76 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:11.378518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ba6843-78f6-4aa6-915a-5c6d13789d76 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:11.379491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b8f9334-5f28-40a2-adbc-d5e6cd771e72 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:11.380144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b8f9334-5f28-40a2-adbc-d5e6cd771e72 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:11.409453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b8f9334-5f28-40a2-adbc-d5e6cd771e72 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:11.411977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b8f9334-5f28-40a2-adbc-d5e6cd771e72 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:11.412957 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b8f9334-5f28-40a2-adbc-d5e6cd771e72 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:11.414937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b8f9334-5f28-40a2-adbc-d5e6cd771e72 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:11.592314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4ba6843-78f6-4aa6-915a-5c6d13789d76 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:11.601676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4ba6843-78f6-4aa6-915a-5c6d13789d76 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1298 microversion: 2.1 time: 0.259180 Apr 11 19:48:11.603420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 18/32] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:11.645247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b8f9334-5f28-40a2-adbc-d5e6cd771e72 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:11.657655 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b8f9334-5f28-40a2-adbc-d5e6cd771e72 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1273 microversion: 2.1 time: 0.288384 Apr 11 19:48:11.666140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 15/33] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:11 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:12.372364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:12.374459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:12.386368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db708f89-eef5-4568-bbd3-42bdb47b0954 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:12.386991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db708f89-eef5-4568-bbd3-42bdb47b0954 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:12.394123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db708f89-eef5-4568-bbd3-42bdb47b0954 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:12.398943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db708f89-eef5-4568-bbd3-42bdb47b0954 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:12.400023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db708f89-eef5-4568-bbd3-42bdb47b0954 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:12.401718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:12.402430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db708f89-eef5-4568-bbd3-42bdb47b0954 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:12.405185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:12.407263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:12.408510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:12.579748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:12.594762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:12.601869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:12.605239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a74855e0-5422-46e2-b13b-86868fb3cbda tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1338 microversion: 2.20 time: 0.248367 Apr 11 19:48:12.605891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 19/34] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1338 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:12.628776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07d07983-d50c-437f-968b-6be6883028bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:12.629420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07d07983-d50c-437f-968b-6be6883028bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:12.650280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db708f89-eef5-4568-bbd3-42bdb47b0954 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:12.655925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07d07983-d50c-437f-968b-6be6883028bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:12.660472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db708f89-eef5-4568-bbd3-42bdb47b0954 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.278537 Apr 11 19:48:12.661571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07d07983-d50c-437f-968b-6be6883028bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:12.662561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 16/35] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:12 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:12.663303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07d07983-d50c-437f-968b-6be6883028bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:12.664071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07d07983-d50c-437f-968b-6be6883028bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:12.677762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cb5fa985-a1d4-4f11-9e73-4d2f9a860eac tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:12.678928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cb5fa985-a1d4-4f11-9e73-4d2f9a860eac tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:12.689438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb5fa985-a1d4-4f11-9e73-4d2f9a860eac tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:12.690380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb5fa985-a1d4-4f11-9e73-4d2f9a860eac tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:12.691397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb5fa985-a1d4-4f11-9e73-4d2f9a860eac tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:12.692011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb5fa985-a1d4-4f11-9e73-4d2f9a860eac tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:12.877937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb5fa985-a1d4-4f11-9e73-4d2f9a860eac tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:12.895408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cb5fa985-a1d4-4f11-9e73-4d2f9a860eac tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1279 microversion: 2.1 time: 0.222124 Apr 11 19:48:12.896656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 17/36] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:12 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:13.055254 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07d07983-d50c-437f-968b-6be6883028bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:13.064936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07d07983-d50c-437f-968b-6be6883028bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.440059 Apr 11 19:48:13.067835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 20/37] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:13.624943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:13.625958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:13.642242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:13.643195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:13.647538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:13.649302 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:13.679272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc5b9ecf-4c8d-4143-ad6b-357e5558865d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:13.680084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc5b9ecf-4c8d-4143-ad6b-357e5558865d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:13.691557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc5b9ecf-4c8d-4143-ad6b-357e5558865d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:13.692253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc5b9ecf-4c8d-4143-ad6b-357e5558865d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:13.693422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc5b9ecf-4c8d-4143-ad6b-357e5558865d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:13.700351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc5b9ecf-4c8d-4143-ad6b-357e5558865d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:13.884378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:13.896533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:13.903378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:13.907907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0a687202-9dca-4c2d-aac6-a2548ce0854e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1338 microversion: 2.20 time: 0.287197 Apr 11 19:48:13.912178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 18/38] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1338 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:13.926860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c85a89e9-a99b-49da-bdc2-19d93b289d66 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:13.930969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c85a89e9-a99b-49da-bdc2-19d93b289d66 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:13.961258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c85a89e9-a99b-49da-bdc2-19d93b289d66 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:13.961718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c85a89e9-a99b-49da-bdc2-19d93b289d66 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:13.962528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c85a89e9-a99b-49da-bdc2-19d93b289d66 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:13.963018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c85a89e9-a99b-49da-bdc2-19d93b289d66 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:14.136138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c85a89e9-a99b-49da-bdc2-19d93b289d66 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:14.172429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c85a89e9-a99b-49da-bdc2-19d93b289d66 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1279 microversion: 2.1 time: 0.258849 Apr 11 19:48:14.174260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 19/39] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:13 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:14.211783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f7caa03-1d35-4bfb-8238-53a86f343175 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:14.221115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f7caa03-1d35-4bfb-8238-53a86f343175 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:14.246377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f7caa03-1d35-4bfb-8238-53a86f343175 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:14.248017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f7caa03-1d35-4bfb-8238-53a86f343175 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:14.251296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f7caa03-1d35-4bfb-8238-53a86f343175 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:14.254058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f7caa03-1d35-4bfb-8238-53a86f343175 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:14.286008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dc5b9ecf-4c8d-4143-ad6b-357e5558865d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:14.305598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc5b9ecf-4c8d-4143-ad6b-357e5558865d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.626472 Apr 11 19:48:14.307073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 21/40] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:13 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:14.687622 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2f7caa03-1d35-4bfb-8238-53a86f343175 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:14.705902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f7caa03-1d35-4bfb-8238-53a86f343175 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.528019 Apr 11 19:48:14.717753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 20/41] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:14.930431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:14.931164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:14.940436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:14.943762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-b71b70b3-0666-41b2-9715-15e3be90eecd req-cfef1545-1893-48c8-be29-9def19bcebba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d175e143-0fb4-46bc-acbf-99ed3710c59f", "name": "network-vif-plugged", "status": "completed", "tag": "e355d285-c51d-412d-84be-6b4cfc168e42"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:14.945026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:14.950294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:14.950747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:14.957069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-b71b70b3-0666-41b2-9715-15e3be90eecd req-cfef1545-1893-48c8-be29-9def19bcebba service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:14.960779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-b71b70b3-0666-41b2-9715-15e3be90eecd req-cfef1545-1893-48c8-be29-9def19bcebba service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:14.982148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-b71b70b3-0666-41b2-9715-15e3be90eecd req-cfef1545-1893-48c8-be29-9def19bcebba service nova] Creating event network-vif-plugged:e355d285-c51d-412d-84be-6b4cfc168e42 for instance d175e143-0fb4-46bc-acbf-99ed3710c59f on hv-cinder-83078 Apr 11 19:48:14.993265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-b71b70b3-0666-41b2-9715-15e3be90eecd req-cfef1545-1893-48c8-be29-9def19bcebba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295284 Apr 11 19:48:14.993935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 22/42] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:48:15.268792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:15.279607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:15.281191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:15.284223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a54fabcb-1907-4aa6-a38a-549f1b5adda3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1338 microversion: 2.20 time: 0.358769 Apr 11 19:48:15.298098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 21/43] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1338 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:48:15.311113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2b97a5cf-9562-4e09-8cce-944e57134176 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:15.314746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2b97a5cf-9562-4e09-8cce-944e57134176 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:15.329364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b97a5cf-9562-4e09-8cce-944e57134176 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:15.334081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b97a5cf-9562-4e09-8cce-944e57134176 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:15.335416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b97a5cf-9562-4e09-8cce-944e57134176 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:15.336104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b97a5cf-9562-4e09-8cce-944e57134176 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:15.359589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-977ae7eb-6043-4905-ab4f-76cffedcb52d req-9ddbe899-2355-4f38-801e-4e9d8db368a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4", "tag": "acea41a3-8241-49f7-8452-ffb966c45bfa"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:15.377883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-977ae7eb-6043-4905-ab4f-76cffedcb52d req-9ddbe899-2355-4f38-801e-4e9d8db368a7 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:15.378331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-977ae7eb-6043-4905-ab4f-76cffedcb52d req-9ddbe899-2355-4f38-801e-4e9d8db368a7 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:15.400789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-977ae7eb-6043-4905-ab4f-76cffedcb52d req-9ddbe899-2355-4f38-801e-4e9d8db368a7 service nova] Creating event network-changed:acea41a3-8241-49f7-8452-ffb966c45bfa for instance 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 on hv-cinder-83078 Apr 11 19:48:15.418259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-977ae7eb-6043-4905-ab4f-76cffedcb52d req-9ddbe899-2355-4f38-801e-4e9d8db368a7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247371 Apr 11 19:48:15.419234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 23/44] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:48:15.424512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0e218c67-e4ec-4afa-a3a1-3158415256a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:15.431798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0e218c67-e4ec-4afa-a3a1-3158415256a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:15.444922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e218c67-e4ec-4afa-a3a1-3158415256a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:15.445417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e218c67-e4ec-4afa-a3a1-3158415256a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:15.447551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e218c67-e4ec-4afa-a3a1-3158415256a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:15.447991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e218c67-e4ec-4afa-a3a1-3158415256a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:15.518856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b97a5cf-9562-4e09-8cce-944e57134176 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:15.536875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2b97a5cf-9562-4e09-8cce-944e57134176 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1279 microversion: 2.1 time: 0.235669 Apr 11 19:48:15.537658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 22/45] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:15 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:15.726917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df63bd21-345e-4d6d-8bf0-6a5d1ae972a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:15.727808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df63bd21-345e-4d6d-8bf0-6a5d1ae972a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:15.742527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df63bd21-345e-4d6d-8bf0-6a5d1ae972a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:15.743874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df63bd21-345e-4d6d-8bf0-6a5d1ae972a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:15.747193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df63bd21-345e-4d6d-8bf0-6a5d1ae972a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:15.748854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df63bd21-345e-4d6d-8bf0-6a5d1ae972a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:15.885180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0e218c67-e4ec-4afa-a3a1-3158415256a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:15.902460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0e218c67-e4ec-4afa-a3a1-3158415256a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.481333 Apr 11 19:48:15.909797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 24/46] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:15 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:16.268715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df63bd21-345e-4d6d-8bf0-6a5d1ae972a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:16.279992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df63bd21-345e-4d6d-8bf0-6a5d1ae972a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.559033 Apr 11 19:48:16.280594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 23/47] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:16.307399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:16.309685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:16.330288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:16.332063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:16.337371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:16.339045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:16.557437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94a65867-aa75-40ca-8e51-02437b907104 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:16.558473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94a65867-aa75-40ca-8e51-02437b907104 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:16.573932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94a65867-aa75-40ca-8e51-02437b907104 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:16.575607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94a65867-aa75-40ca-8e51-02437b907104 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:16.579703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94a65867-aa75-40ca-8e51-02437b907104 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:16.580324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94a65867-aa75-40ca-8e51-02437b907104 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:16.819957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:16.830434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:16.837054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:16.842740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b7e617f-cd26-47a9-be25-b5eb027d0114 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.537757 Apr 11 19:48:16.845980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94a65867-aa75-40ca-8e51-02437b907104 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:16.854297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 25/48] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:16.855111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94a65867-aa75-40ca-8e51-02437b907104 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.303224 Apr 11 19:48:16.856495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 24/49] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:16 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:16.925364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1bc24321-bc45-496f-9154-29903569325e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:16.926171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1bc24321-bc45-496f-9154-29903569325e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:16.934919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bc24321-bc45-496f-9154-29903569325e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:16.937818 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bc24321-bc45-496f-9154-29903569325e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:16.946321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bc24321-bc45-496f-9154-29903569325e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:16.947766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bc24321-bc45-496f-9154-29903569325e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:17.297716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-85784a93-a609-414f-9cb0-3229b6dcfd2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:17.300955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1bc24321-bc45-496f-9154-29903569325e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:17.304638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-85784a93-a609-414f-9cb0-3229b6dcfd2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:17.311748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1bc24321-bc45-496f-9154-29903569325e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.390146 Apr 11 19:48:17.312334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 26/50] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:16 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:17.323029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85784a93-a609-414f-9cb0-3229b6dcfd2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:17.323699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85784a93-a609-414f-9cb0-3229b6dcfd2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:17.324618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85784a93-a609-414f-9cb0-3229b6dcfd2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:17.325205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85784a93-a609-414f-9cb0-3229b6dcfd2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:17.585750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85784a93-a609-414f-9cb0-3229b6dcfd2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:17.602342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-85784a93-a609-414f-9cb0-3229b6dcfd2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.304999 Apr 11 19:48:17.603385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 25/51] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:17.861871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:17.862477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:17.871702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:17.872150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:17.872937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:17.873947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:17.876915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a1a7aeef-8ad8-465f-ae5b-037194240429 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:17.880808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a1a7aeef-8ad8-465f-ae5b-037194240429 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:17.897712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1a7aeef-8ad8-465f-ae5b-037194240429 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:17.898383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1a7aeef-8ad8-465f-ae5b-037194240429 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:17.899175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1a7aeef-8ad8-465f-ae5b-037194240429 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:17.899599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1a7aeef-8ad8-465f-ae5b-037194240429 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:18.289125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1a7aeef-8ad8-465f-ae5b-037194240429 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:18.297630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a1a7aeef-8ad8-465f-ae5b-037194240429 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.424763 Apr 11 19:48:18.298235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 26/52] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:17 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:18.312812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-ef23a4c9-8ad2-4ffb-8e1c-c47b822d3ceb req-8cc9ada8-7326-46ea-9553-c2571d6cfc79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e337b2e-3267-4f57-952b-3d398b9ef338", "tag": "7ac0655e-7efe-4268-ad4b-20c2b11fb3fb"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:18.323493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:18.326502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ef23a4c9-8ad2-4ffb-8e1c-c47b822d3ceb req-8cc9ada8-7326-46ea-9553-c2571d6cfc79 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:18.327098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ef23a4c9-8ad2-4ffb-8e1c-c47b822d3ceb req-8cc9ada8-7326-46ea-9553-c2571d6cfc79 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:18.331990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:18.333503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:18.334832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b65078b4-f2f6-4332-a6ee-00b7f00baffa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.476777 Apr 11 19:48:18.335174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 27/53] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:18.345931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3028873-8c02-460e-bcdc-6d1da5d74e2d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:18.357892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3028873-8c02-460e-bcdc-6d1da5d74e2d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:18.361247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-ef23a4c9-8ad2-4ffb-8e1c-c47b822d3ceb req-8cc9ada8-7326-46ea-9553-c2571d6cfc79 service nova] Creating event network-changed:7ac0655e-7efe-4268-ad4b-20c2b11fb3fb for instance 5e337b2e-3267-4f57-952b-3d398b9ef338 on hv-cinder-83078 Apr 11 19:48:18.361786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ef23a4c9-8ad2-4ffb-8e1c-c47b822d3ceb req-8cc9ada8-7326-46ea-9553-c2571d6cfc79 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 11 19:48:18.362914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9c30558-7720-4f82-8dd0-a6849878e1af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:18.363347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9c30558-7720-4f82-8dd0-a6849878e1af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:18.364125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9c30558-7720-4f82-8dd0-a6849878e1af None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:18.364545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9c30558-7720-4f82-8dd0-a6849878e1af None None] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:18.370831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3028873-8c02-460e-bcdc-6d1da5d74e2d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:18.371274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3028873-8c02-460e-bcdc-6d1da5d74e2d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:18.376285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3028873-8c02-460e-bcdc-6d1da5d74e2d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:18.377039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3028873-8c02-460e-bcdc-6d1da5d74e2d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:18.385180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.compute.rpcapi [None req-b9c30558-7720-4f82-8dd0-a6849878e1af None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 11 19:48:18.386991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9c30558-7720-4f82-8dd0-a6849878e1af None None] Releasing lock "compute-rpcapi-router" {{(pid=123638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 19:48:18.422216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9c30558-7720-4f82-8dd0-a6849878e1af None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113004 Apr 11 19:48:18.422758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 27/54] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:18.567174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3028873-8c02-460e-bcdc-6d1da5d74e2d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:18.575814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3028873-8c02-460e-bcdc-6d1da5d74e2d tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1315 microversion: 2.1 time: 0.233634 Apr 11 19:48:18.577030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 28/55] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:18 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:18.622969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04c0a6b3-10c5-4b2b-a7af-7dac85e65d70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:18.624302 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04c0a6b3-10c5-4b2b-a7af-7dac85e65d70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:18.641597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04c0a6b3-10c5-4b2b-a7af-7dac85e65d70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:18.642395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04c0a6b3-10c5-4b2b-a7af-7dac85e65d70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:18.643504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04c0a6b3-10c5-4b2b-a7af-7dac85e65d70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:18.644876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04c0a6b3-10c5-4b2b-a7af-7dac85e65d70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:18.947800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04c0a6b3-10c5-4b2b-a7af-7dac85e65d70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:18.978586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04c0a6b3-10c5-4b2b-a7af-7dac85e65d70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.356822 Apr 11 19:48:18.981133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 28/56] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:19.315497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1dc47506-f2cc-4e06-98b5-e9d7a5d55ac2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:19.316444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1dc47506-f2cc-4e06-98b5-e9d7a5d55ac2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:19.323014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dc47506-f2cc-4e06-98b5-e9d7a5d55ac2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:19.324421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dc47506-f2cc-4e06-98b5-e9d7a5d55ac2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:19.326637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dc47506-f2cc-4e06-98b5-e9d7a5d55ac2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:19.327458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dc47506-f2cc-4e06-98b5-e9d7a5d55ac2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:19.354453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:19.355074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:19.364248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:19.367366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:19.370514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:19.371993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:19.615648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1dc47506-f2cc-4e06-98b5-e9d7a5d55ac2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:19.623772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1dc47506-f2cc-4e06-98b5-e9d7a5d55ac2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.312666 Apr 11 19:48:19.627434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 29/57] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:19 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:19.643259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3d6a7f09-e765-4da2-a019-87d1eaa702b8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:19.644073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3d6a7f09-e765-4da2-a019-87d1eaa702b8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:19.651642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d6a7f09-e765-4da2-a019-87d1eaa702b8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:19.652280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d6a7f09-e765-4da2-a019-87d1eaa702b8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:19.653320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d6a7f09-e765-4da2-a019-87d1eaa702b8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:19.653885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d6a7f09-e765-4da2-a019-87d1eaa702b8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:19.856890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:19.869695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:19.878807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:19.880496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-792143da-10b4-4b79-8829-1ba2cb6bfc78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.530257 Apr 11 19:48:19.888981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 29/58] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:48:20.006631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7dc747b-5ea4-4bc5-a19b-bf6add680d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:20.009639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7dc747b-5ea4-4bc5-a19b-bf6add680d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:20.025600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7dc747b-5ea4-4bc5-a19b-bf6add680d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:20.027994 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7dc747b-5ea4-4bc5-a19b-bf6add680d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:20.032231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7dc747b-5ea4-4bc5-a19b-bf6add680d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:20.034278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7dc747b-5ea4-4bc5-a19b-bf6add680d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:20.034765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3d6a7f09-e765-4da2-a019-87d1eaa702b8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:20.047204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3d6a7f09-e765-4da2-a019-87d1eaa702b8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1501 microversion: 2.1 time: 0.403944 Apr 11 19:48:20.049273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 30/59] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:19 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1501 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:20.366447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7dc747b-5ea4-4bc5-a19b-bf6add680d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:20.381538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7dc747b-5ea4-4bc5-a19b-bf6add680d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.388280 Apr 11 19:48:20.386007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 30/60] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:20.645775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da53140b-8abe-472d-851a-d091bbba90bc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:20.647555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da53140b-8abe-472d-851a-d091bbba90bc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:20.663735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da53140b-8abe-472d-851a-d091bbba90bc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:20.664437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da53140b-8abe-472d-851a-d091bbba90bc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:20.665438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da53140b-8abe-472d-851a-d091bbba90bc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:20.666019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da53140b-8abe-472d-851a-d091bbba90bc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:20.691336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-c0b962fb-92e6-4e19-a1bd-7192b6235538 req-17d230e4-bf78-467b-8cac-5a8331d20cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6aea71-8b17-46b8-ab07-b42b41b573a5", "tag": "043741af-b872-498e-a793-2860d820736a"}, {"name": "network-changed", "server_uuid": "4395837c-0771-4542-9331-ae83b23b125f", "tag": "504bc5b6-2930-407b-bbaf-dee62a4ab45a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:20.712938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c0b962fb-92e6-4e19-a1bd-7192b6235538 req-17d230e4-bf78-467b-8cac-5a8331d20cfa service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:20.716867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c0b962fb-92e6-4e19-a1bd-7192b6235538 req-17d230e4-bf78-467b-8cac-5a8331d20cfa service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:20.771649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-c0b962fb-92e6-4e19-a1bd-7192b6235538 req-17d230e4-bf78-467b-8cac-5a8331d20cfa service nova] Creating event network-changed:043741af-b872-498e-a793-2860d820736a for instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 on hv-cinder-83078 Apr 11 19:48:20.784848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-c0b962fb-92e6-4e19-a1bd-7192b6235538 req-17d230e4-bf78-467b-8cac-5a8331d20cfa service nova] Creating event network-changed:504bc5b6-2930-407b-bbaf-dee62a4ab45a for instance 4395837c-0771-4542-9331-ae83b23b125f on hv-cinder-83078 Apr 11 19:48:20.795280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-c0b962fb-92e6-4e19-a1bd-7192b6235538 req-17d230e4-bf78-467b-8cac-5a8331d20cfa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109084 Apr 11 19:48:20.804207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 31/61] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:20.900149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:20.907554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:20.921020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:20.924439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:20.925484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:20.926364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:21.169088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:21.193892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:21.197662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:21.201559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-11615193-98c5-4913-b713-dac415983da7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.303320 Apr 11 19:48:21.202211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:48:21.245498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da53140b-8abe-472d-851a-d091bbba90bc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:21.254073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da53140b-8abe-472d-851a-d091bbba90bc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.613962 Apr 11 19:48:21.254665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 31/63] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:20 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:21.405781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f9ed5af-266f-46b4-a1a5-156bfbcc4cf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:21.406970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f9ed5af-266f-46b4-a1a5-156bfbcc4cf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:21.413266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f9ed5af-266f-46b4-a1a5-156bfbcc4cf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:21.413973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f9ed5af-266f-46b4-a1a5-156bfbcc4cf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:21.414898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f9ed5af-266f-46b4-a1a5-156bfbcc4cf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:21.415490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f9ed5af-266f-46b4-a1a5-156bfbcc4cf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:21.566837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f9ed5af-266f-46b4-a1a5-156bfbcc4cf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:21.576016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f9ed5af-266f-46b4-a1a5-156bfbcc4cf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.174264 Apr 11 19:48:21.576595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 33/64] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:22.220841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:22.222338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:22.235573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.236018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.237343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.238079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.271564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f4d5e04a-338c-4d57-b955-74c3eb30ffc1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:22.272191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f4d5e04a-338c-4d57-b955-74c3eb30ffc1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:22.297458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4d5e04a-338c-4d57-b955-74c3eb30ffc1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.297458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4d5e04a-338c-4d57-b955-74c3eb30ffc1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.297458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4d5e04a-338c-4d57-b955-74c3eb30ffc1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.297458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4d5e04a-338c-4d57-b955-74c3eb30ffc1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.567845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:22.579587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:22.583652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:22.588776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e580ca3b-7692-46f6-bf91-325abe175edb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.371698 Apr 11 19:48:22.597694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:22.610583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-602a8930-a051-4c8b-b14b-80223a69e144 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e194db3a-58d4-4e1e-a216-ce8ea7ca4434"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:22.612739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-602a8930-a051-4c8b-b14b-80223a69e144 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:22.630658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-602a8930-a051-4c8b-b14b-80223a69e144 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.631118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-602a8930-a051-4c8b-b14b-80223a69e144 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.631891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-602a8930-a051-4c8b-b14b-80223a69e144 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.637485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-602a8930-a051-4c8b-b14b-80223a69e144 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.643740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f4d5e04a-338c-4d57-b955-74c3eb30ffc1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:22.652774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f4d5e04a-338c-4d57-b955-74c3eb30ffc1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.385536 Apr 11 19:48:22.653796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 34/66] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:22 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:22.658798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-897f00cd-8fb9-403a-812e-52aac381e3e6 req-12ee638b-b8c0-4ee2-9417-668412bae8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4", "name": "network-vif-plugged", "status": "completed", "tag": "acea41a3-8241-49f7-8452-ffb966c45bfa"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:22.667803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-897f00cd-8fb9-403a-812e-52aac381e3e6 req-12ee638b-b8c0-4ee2-9417-668412bae8c9 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.668557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-897f00cd-8fb9-403a-812e-52aac381e3e6 req-12ee638b-b8c0-4ee2-9417-668412bae8c9 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.681081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-897f00cd-8fb9-403a-812e-52aac381e3e6 req-12ee638b-b8c0-4ee2-9417-668412bae8c9 service nova] Creating event network-vif-plugged:acea41a3-8241-49f7-8452-ffb966c45bfa for instance 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 on hv-cinder-83078 Apr 11 19:48:22.688057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-897f00cd-8fb9-403a-812e-52aac381e3e6 req-12ee638b-b8c0-4ee2-9417-668412bae8c9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032750 Apr 11 19:48:22.689789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 35/67] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:22.698314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e911d88c-6e82-4934-b2e4-cffad6604e80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:22.699370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e911d88c-6e82-4934-b2e4-cffad6604e80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:22.706161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e911d88c-6e82-4934-b2e4-cffad6604e80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.706936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e911d88c-6e82-4934-b2e4-cffad6604e80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.708023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e911d88c-6e82-4934-b2e4-cffad6604e80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:22.708808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e911d88c-6e82-4934-b2e4-cffad6604e80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:22.875285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e911d88c-6e82-4934-b2e4-cffad6604e80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:22.884480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e911d88c-6e82-4934-b2e4-cffad6604e80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.190769 Apr 11 19:48:22.894382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 36/68] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:23.623890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:23.625231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:23.634174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:23.635506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:23.638808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:23.640378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:23.840315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:23.849611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:23.851570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:23.852696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b3fa192-b5cc-4e46-bdd8-50be9068f45d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.234514 Apr 11 19:48:23.853292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 37/69] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:23.858177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f384b4f5-2182-4455-b899-19b1ad637257 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:23.858988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f384b4f5-2182-4455-b899-19b1ad637257 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:23.866543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f384b4f5-2182-4455-b899-19b1ad637257 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:23.867028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f384b4f5-2182-4455-b899-19b1ad637257 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:23.867938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f384b4f5-2182-4455-b899-19b1ad637257 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:23.868345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f384b4f5-2182-4455-b899-19b1ad637257 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:24.129588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f384b4f5-2182-4455-b899-19b1ad637257 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:24.140779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f384b4f5-2182-4455-b899-19b1ad637257 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.286295 Apr 11 19:48:24.155537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 38/70] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:23 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:24.160926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7ff1324-6466-4a3b-b252-7c290e98f2bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:24.166796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7ff1324-6466-4a3b-b252-7c290e98f2bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:24.193199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7ff1324-6466-4a3b-b252-7c290e98f2bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:24.195556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7ff1324-6466-4a3b-b252-7c290e98f2bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:24.198266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7ff1324-6466-4a3b-b252-7c290e98f2bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:24.200038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7ff1324-6466-4a3b-b252-7c290e98f2bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:24.543721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7ff1324-6466-4a3b-b252-7c290e98f2bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:24.557535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7ff1324-6466-4a3b-b252-7c290e98f2bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.400499 Apr 11 19:48:24.558129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 39/71] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:24.871331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:24.871867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:24.881505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:24.883366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:24.886057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:24.887963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:25.057713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-602a8930-a051-4c8b-b14b-80223a69e144 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "POST /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.455306 Apr 11 19:48:25.063978 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 33/72] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 19:48:22 2022] POST /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f/os-volume_attachments => generated 194 bytes in 2465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:25.160852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b2021ecb-2a49-4b78-b27c-f4d089e6dcb0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:25.162804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b2021ecb-2a49-4b78-b27c-f4d089e6dcb0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:25.170146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2021ecb-2a49-4b78-b27c-f4d089e6dcb0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:25.170777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2021ecb-2a49-4b78-b27c-f4d089e6dcb0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:25.171569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2021ecb-2a49-4b78-b27c-f4d089e6dcb0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:25.172313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2021ecb-2a49-4b78-b27c-f4d089e6dcb0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:25.198845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:25.207662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:25.209313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:25.210502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7ef4a6e5-2007-47ed-ac06-2f677a50f25f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.343645 Apr 11 19:48:25.211386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 40/73] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:48:25.350760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2021ecb-2a49-4b78-b27c-f4d089e6dcb0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:25.359648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b2021ecb-2a49-4b78-b27c-f4d089e6dcb0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.204252 Apr 11 19:48:25.360932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 34/74] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:25 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:25.574961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-67001f07-1831-419b-b666-bf0096fa0a70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:25.575569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-67001f07-1831-419b-b666-bf0096fa0a70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:25.581736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67001f07-1831-419b-b666-bf0096fa0a70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:25.582179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67001f07-1831-419b-b666-bf0096fa0a70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:25.582943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67001f07-1831-419b-b666-bf0096fa0a70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:25.583364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67001f07-1831-419b-b666-bf0096fa0a70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:25.759106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67001f07-1831-419b-b666-bf0096fa0a70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:25.767092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-67001f07-1831-419b-b666-bf0096fa0a70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1365 microversion: 2.1 time: 0.195798 Apr 11 19:48:25.767670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 41/75] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:26.230239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:26.231487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:26.247563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:26.248016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:26.248970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:26.249744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:26.377467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9946cc7c-b3a1-4153-aa66-60d0c256960a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:26.378092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9946cc7c-b3a1-4153-aa66-60d0c256960a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:26.388737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9946cc7c-b3a1-4153-aa66-60d0c256960a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:26.390187 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9946cc7c-b3a1-4153-aa66-60d0c256960a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:26.395979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9946cc7c-b3a1-4153-aa66-60d0c256960a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:26.396523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9946cc7c-b3a1-4153-aa66-60d0c256960a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:26.526430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:26.555426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:26.560512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:26.563520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58bbcb76-6219-4e3e-a356-2d3dd3027b00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.337233 Apr 11 19:48:26.564111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 35/76] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:26.633780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9946cc7c-b3a1-4153-aa66-60d0c256960a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:26.644260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9946cc7c-b3a1-4153-aa66-60d0c256960a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.271287 Apr 11 19:48:26.647143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 42/77] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:26 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:26.785334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb4be804-eb75-41f2-9fcc-bfbc24e0bf0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:26.786141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb4be804-eb75-41f2-9fcc-bfbc24e0bf0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:26.798250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb4be804-eb75-41f2-9fcc-bfbc24e0bf0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:26.799490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb4be804-eb75-41f2-9fcc-bfbc24e0bf0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:26.800422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb4be804-eb75-41f2-9fcc-bfbc24e0bf0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:26.801267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb4be804-eb75-41f2-9fcc-bfbc24e0bf0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:26.884536 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-3dfb2439-6d4f-4da7-83de-d11b476e573a req-1e56e60f-91d9-4bb3-a488-5cc4c833a4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e337b2e-3267-4f57-952b-3d398b9ef338", "name": "network-vif-plugged", "status": "completed", "tag": "7ac0655e-7efe-4268-ad4b-20c2b11fb3fb"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:26.895148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3dfb2439-6d4f-4da7-83de-d11b476e573a req-1e56e60f-91d9-4bb3-a488-5cc4c833a4bd service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:26.895858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3dfb2439-6d4f-4da7-83de-d11b476e573a req-1e56e60f-91d9-4bb3-a488-5cc4c833a4bd service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:26.923110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-3dfb2439-6d4f-4da7-83de-d11b476e573a req-1e56e60f-91d9-4bb3-a488-5cc4c833a4bd service nova] Creating event network-vif-plugged:7ac0655e-7efe-4268-ad4b-20c2b11fb3fb for instance 5e337b2e-3267-4f57-952b-3d398b9ef338 on hv-cinder-83078 Apr 11 19:48:26.934508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-3dfb2439-6d4f-4da7-83de-d11b476e573a req-1e56e60f-91d9-4bb3-a488-5cc4c833a4bd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053732 Apr 11 19:48:26.936928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 43/78] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:48:27.167210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eb4be804-eb75-41f2-9fcc-bfbc24e0bf0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:27.178238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb4be804-eb75-41f2-9fcc-bfbc24e0bf0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1556 microversion: 2.1 time: 0.398216 Apr 11 19:48:27.189271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 36/79] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1556 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:27.198260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ff5d38a0-c016-4d01-98b0-c4a946d29814 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:27.198260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ff5d38a0-c016-4d01-98b0-c4a946d29814 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:27.211739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff5d38a0-c016-4d01-98b0-c4a946d29814 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:27.212184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff5d38a0-c016-4d01-98b0-c4a946d29814 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:27.212992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff5d38a0-c016-4d01-98b0-c4a946d29814 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:27.213449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff5d38a0-c016-4d01-98b0-c4a946d29814 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:27.358550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ff5d38a0-c016-4d01-98b0-c4a946d29814 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165968 Apr 11 19:48:27.359153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 44/80] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Apr 11 19:48:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:27.581854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:27.582456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:27.589212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:27.589650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:27.590685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:27.591349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:27.664867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64b85874-eecb-4de4-ae73-004209a594b7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:27.667246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64b85874-eecb-4de4-ae73-004209a594b7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:27.673879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64b85874-eecb-4de4-ae73-004209a594b7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:27.674847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64b85874-eecb-4de4-ae73-004209a594b7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:27.675857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64b85874-eecb-4de4-ae73-004209a594b7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:27.676644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64b85874-eecb-4de4-ae73-004209a594b7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:27.916563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:27.933184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:27.935942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:27.938272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0827131d-aad6-4b95-8beb-9ceccb8753d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.359861 Apr 11 19:48:27.939257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 37/81] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:27.986377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64b85874-eecb-4de4-ae73-004209a594b7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:28.004635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64b85874-eecb-4de4-ae73-004209a594b7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.344626 Apr 11 19:48:28.005308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 45/82] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:27 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:28.957699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:28.958477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:28.968566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:28.969653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:28.971283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:28.971851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:29.027734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9822864a-d172-4f96-aa38-9cce9bcbd58f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:29.028621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9822864a-d172-4f96-aa38-9cce9bcbd58f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:29.037349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9822864a-d172-4f96-aa38-9cce9bcbd58f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:29.039674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9822864a-d172-4f96-aa38-9cce9bcbd58f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:29.041108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9822864a-d172-4f96-aa38-9cce9bcbd58f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:29.042702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9822864a-d172-4f96-aa38-9cce9bcbd58f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:29.211747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:29.222538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:29.224316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:29.225756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b855517-7f4c-4d5b-bda3-c9d8ff15844f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.273710 Apr 11 19:48:29.226849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 38/83] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:29.232678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-46da3a31-812d-4feb-9900-7ac5953d1885 req-655e8ef0-1b2f-419a-b9a4-b98bcff85a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4", "tag": "acea41a3-8241-49f7-8452-ffb966c45bfa"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:29.243971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-46da3a31-812d-4feb-9900-7ac5953d1885 req-655e8ef0-1b2f-419a-b9a4-b98bcff85a1e service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:29.244796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-46da3a31-812d-4feb-9900-7ac5953d1885 req-655e8ef0-1b2f-419a-b9a4-b98bcff85a1e service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:29.263445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-46da3a31-812d-4feb-9900-7ac5953d1885 req-655e8ef0-1b2f-419a-b9a4-b98bcff85a1e service nova] Creating event network-changed:acea41a3-8241-49f7-8452-ffb966c45bfa for instance 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 on hv-cinder-83078 Apr 11 19:48:29.273773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-46da3a31-812d-4feb-9900-7ac5953d1885 req-655e8ef0-1b2f-419a-b9a4-b98bcff85a1e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042666 Apr 11 19:48:29.275802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 39/84] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:29.291986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9822864a-d172-4f96-aa38-9cce9bcbd58f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:29.299856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9822864a-d172-4f96-aa38-9cce9bcbd58f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.276847 Apr 11 19:48:29.312641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 46/85] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:29 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:30.247341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:30.248222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:30.255433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:30.255885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:30.256669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:30.257127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:30.318851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37a1008d-66ad-46b5-826f-1fc204a3ab29 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:30.319516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37a1008d-66ad-46b5-826f-1fc204a3ab29 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:30.328841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37a1008d-66ad-46b5-826f-1fc204a3ab29 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:30.329339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37a1008d-66ad-46b5-826f-1fc204a3ab29 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:30.330126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37a1008d-66ad-46b5-826f-1fc204a3ab29 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:30.330559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37a1008d-66ad-46b5-826f-1fc204a3ab29 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:30.557688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:30.583397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:30.589888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:30.590088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37a1008d-66ad-46b5-826f-1fc204a3ab29 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:30.592802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-23a1d805-fe61-4019-83d0-200e0a2cca82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.352219 Apr 11 19:48:30.593486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 40/86] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:30.598272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37a1008d-66ad-46b5-826f-1fc204a3ab29 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.283269 Apr 11 19:48:30.598856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 47/87] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:30 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:31.612562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:31.613188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:31.621373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f9141746-4d5f-42c9-ba88-23c59cee05e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:31.621949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f9141746-4d5f-42c9-ba88-23c59cee05e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:31.627295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:31.627851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:31.628434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9141746-4d5f-42c9-ba88-23c59cee05e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:31.628753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:31.629028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9141746-4d5f-42c9-ba88-23c59cee05e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:31.629535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:31.629854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9141746-4d5f-42c9-ba88-23c59cee05e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:31.630285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9141746-4d5f-42c9-ba88-23c59cee05e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:31.834375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f9141746-4d5f-42c9-ba88-23c59cee05e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:31.838755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:31.845028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f9141746-4d5f-42c9-ba88-23c59cee05e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.227381 Apr 11 19:48:31.845712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 48/88] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:31 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:31.852835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:31.854468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:31.855679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dbd68645-1554-4a29-93e7-6c301ce75e48 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.248377 Apr 11 19:48:31.856342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 41/89] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:32.863184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10405f29-b684-4ebf-a9c6-6eeb31a0a737 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:32.864077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10405f29-b684-4ebf-a9c6-6eeb31a0a737 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:32.875071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:32.875755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:32.881336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10405f29-b684-4ebf-a9c6-6eeb31a0a737 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:32.881873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10405f29-b684-4ebf-a9c6-6eeb31a0a737 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:32.882714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10405f29-b684-4ebf-a9c6-6eeb31a0a737 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:32.882821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:32.883225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10405f29-b684-4ebf-a9c6-6eeb31a0a737 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:32.883332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:32.884126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:32.884917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:33.083936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:33.087450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10405f29-b684-4ebf-a9c6-6eeb31a0a737 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:33.092079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:33.093731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:33.094850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f01a76d0-c179-472f-9f10-e166e2384357 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.224821 Apr 11 19:48:33.095177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10405f29-b684-4ebf-a9c6-6eeb31a0a737 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.236510 Apr 11 19:48:33.095993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 49/90] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:32 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:33.105448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 42/91] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:34.112763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7c19526-d8a4-4fe8-9fa4-898dd1370610 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:34.113459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7c19526-d8a4-4fe8-9fa4-898dd1370610 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:34.120601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7c19526-d8a4-4fe8-9fa4-898dd1370610 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:34.120891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:34.121678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7c19526-d8a4-4fe8-9fa4-898dd1370610 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:34.121800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:34.121943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7c19526-d8a4-4fe8-9fa4-898dd1370610 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:34.122399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7c19526-d8a4-4fe8-9fa4-898dd1370610 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:34.132209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:34.132670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:34.133768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:34.134207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:34.348390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7c19526-d8a4-4fe8-9fa4-898dd1370610 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:34.361382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7c19526-d8a4-4fe8-9fa4-898dd1370610 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.252728 Apr 11 19:48:34.362327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 50/92] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:34 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:34.382199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:34.390200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:34.391636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:34.392763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-037212cd-e0c8-48d4-9e45-593086f6edc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.276512 Apr 11 19:48:34.393579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 43/93] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:34.927210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-e211ce78-4e34-4854-8dcd-6f064c75ea80 req-92631339-3b3c-4f0c-b808-132f7deab3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4395837c-0771-4542-9331-ae83b23b125f", "name": "network-vif-plugged", "status": "completed", "tag": "504bc5b6-2930-407b-bbaf-dee62a4ab45a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:34.935947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-e211ce78-4e34-4854-8dcd-6f064c75ea80 req-92631339-3b3c-4f0c-b808-132f7deab3f9 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:34.936386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-e211ce78-4e34-4854-8dcd-6f064c75ea80 req-92631339-3b3c-4f0c-b808-132f7deab3f9 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:34.948641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-e211ce78-4e34-4854-8dcd-6f064c75ea80 req-92631339-3b3c-4f0c-b808-132f7deab3f9 service nova] Creating event network-vif-plugged:504bc5b6-2930-407b-bbaf-dee62a4ab45a for instance 4395837c-0771-4542-9331-ae83b23b125f on hv-cinder-83078 Apr 11 19:48:34.955829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-e211ce78-4e34-4854-8dcd-6f064c75ea80 req-92631339-3b3c-4f0c-b808-132f7deab3f9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032319 Apr 11 19:48:34.956662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 51/94] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:35.384456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-87393ca5-c3c8-4a4c-b1c8-d1f226fa9b1c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:35.384456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-87393ca5-c3c8-4a4c-b1c8-d1f226fa9b1c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:35.387416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87393ca5-c3c8-4a4c-b1c8-d1f226fa9b1c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:35.387930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87393ca5-c3c8-4a4c-b1c8-d1f226fa9b1c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:35.388776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87393ca5-c3c8-4a4c-b1c8-d1f226fa9b1c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:35.389302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87393ca5-c3c8-4a4c-b1c8-d1f226fa9b1c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:35.411809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:35.412517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:35.419540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:35.420298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:35.421174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:35.421697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:35.605522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-87393ca5-c3c8-4a4c-b1c8-d1f226fa9b1c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:35.619221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:35.628435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-87393ca5-c3c8-4a4c-b1c8-d1f226fa9b1c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.253422 Apr 11 19:48:35.630523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 44/95] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:35 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:35.644469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:35.645768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:35.649848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0789cb72-30b9-476d-ab74-03640a8db17f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.239916 Apr 11 19:48:35.649848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 52/96] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:36.649228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b15d1bc7-7173-457e-b2b4-4fbe87828003 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:36.649946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b15d1bc7-7173-457e-b2b4-4fbe87828003 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:36.656766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b15d1bc7-7173-457e-b2b4-4fbe87828003 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:36.657248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b15d1bc7-7173-457e-b2b4-4fbe87828003 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:36.658114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b15d1bc7-7173-457e-b2b4-4fbe87828003 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:36.658423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b15d1bc7-7173-457e-b2b4-4fbe87828003 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:36.667535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:36.668339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:36.674530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:36.674995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:36.675767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:36.676199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:37.123577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b15d1bc7-7173-457e-b2b4-4fbe87828003 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:37.137907 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b15d1bc7-7173-457e-b2b4-4fbe87828003 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.492455 Apr 11 19:48:37.145263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 45/97] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:36 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:37.152051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-cb6a9d9b-fa51-42dc-a5e6-f3cd02d55381 req-be625708-d73e-4cf1-b466-cb430e623465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6aea71-8b17-46b8-ab07-b42b41b573a5", "name": "network-vif-plugged", "status": "completed", "tag": "043741af-b872-498e-a793-2860d820736a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:37.182536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-cb6a9d9b-fa51-42dc-a5e6-f3cd02d55381 req-be625708-d73e-4cf1-b466-cb430e623465 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:37.185353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-cb6a9d9b-fa51-42dc-a5e6-f3cd02d55381 req-be625708-d73e-4cf1-b466-cb430e623465 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:37.221320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-cb6a9d9b-fa51-42dc-a5e6-f3cd02d55381 req-be625708-d73e-4cf1-b466-cb430e623465 service nova] Creating event network-vif-plugged:043741af-b872-498e-a793-2860d820736a for instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 on hv-cinder-83078 Apr 11 19:48:37.235513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-cb6a9d9b-fa51-42dc-a5e6-f3cd02d55381 req-be625708-d73e-4cf1-b466-cb430e623465 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088618 Apr 11 19:48:37.252751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 46/98] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:37.283344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:37.296219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:37.298849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:37.300447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e6f13631-c0e4-4d1c-97a7-66323fb6978d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.636853 Apr 11 19:48:37.312197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 53/99] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:37.338310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f3733716-9150-411b-8d92-6d5bb696299e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:37.339052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f3733716-9150-411b-8d92-6d5bb696299e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:37.346513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3733716-9150-411b-8d92-6d5bb696299e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:37.347082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3733716-9150-411b-8d92-6d5bb696299e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:37.347912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3733716-9150-411b-8d92-6d5bb696299e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:37.348371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3733716-9150-411b-8d92-6d5bb696299e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:37.378374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f3733716-9150-411b-8d92-6d5bb696299e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 19:48:37.552637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f3733716-9150-411b-8d92-6d5bb696299e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 204 len: 0 microversion: 2.1 time: 0.218676 Apr 11 19:48:37.553259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 47/100] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 19:48:37 2022] DELETE /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:48:37.567131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-38e86de8-b43d-442b-acd9-6ad2e65a1c49 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:37.567750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-38e86de8-b43d-442b-acd9-6ad2e65a1c49 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:37.574155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38e86de8-b43d-442b-acd9-6ad2e65a1c49 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:37.574836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38e86de8-b43d-442b-acd9-6ad2e65a1c49 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:37.576402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38e86de8-b43d-442b-acd9-6ad2e65a1c49 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:37.577139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38e86de8-b43d-442b-acd9-6ad2e65a1c49 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:37.771984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38e86de8-b43d-442b-acd9-6ad2e65a1c49 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:37.781159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-38e86de8-b43d-442b-acd9-6ad2e65a1c49 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1553 microversion: 2.1 time: 0.217805 Apr 11 19:48:37.782236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 54/101] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:37 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:38.161895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5560767c-8763-4fde-a3e7-9b54b7c45b63 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:38.162584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5560767c-8763-4fde-a3e7-9b54b7c45b63 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:38.170567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5560767c-8763-4fde-a3e7-9b54b7c45b63 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:38.171302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5560767c-8763-4fde-a3e7-9b54b7c45b63 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:38.172089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5560767c-8763-4fde-a3e7-9b54b7c45b63 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:38.172523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5560767c-8763-4fde-a3e7-9b54b7c45b63 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:38.321012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:38.321012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:38.326448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:38.326892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:38.327666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:38.328140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:38.426081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5560767c-8763-4fde-a3e7-9b54b7c45b63 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:38.440536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5560767c-8763-4fde-a3e7-9b54b7c45b63 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.283034 Apr 11 19:48:38.441635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 48/102] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:38 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:38.524322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:38.533884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:38.535482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:38.537293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65396251-8a6a-499b-87ca-0f092edfcd7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.222581 Apr 11 19:48:38.538558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 55/103] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:38.801882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3f60fa86-3240-41f2-a5a4-4f3df44b2cc8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:38.802625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3f60fa86-3240-41f2-a5a4-4f3df44b2cc8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:38.808846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f60fa86-3240-41f2-a5a4-4f3df44b2cc8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:38.809619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f60fa86-3240-41f2-a5a4-4f3df44b2cc8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:38.810748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f60fa86-3240-41f2-a5a4-4f3df44b2cc8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:38.811267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f60fa86-3240-41f2-a5a4-4f3df44b2cc8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:38.971315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f60fa86-3240-41f2-a5a4-4f3df44b2cc8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:38.979755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3f60fa86-3240-41f2-a5a4-4f3df44b2cc8 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1553 microversion: 2.1 time: 0.181936 Apr 11 19:48:38.980353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 49/104] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:38 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:39.461333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7ac6a989-6c45-4193-a113-3322befc5f5e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:39.462162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7ac6a989-6c45-4193-a113-3322befc5f5e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:39.468597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ac6a989-6c45-4193-a113-3322befc5f5e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:39.469070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ac6a989-6c45-4193-a113-3322befc5f5e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:39.470178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ac6a989-6c45-4193-a113-3322befc5f5e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:39.470756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ac6a989-6c45-4193-a113-3322befc5f5e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:39.559189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:39.560635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:39.571629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:39.574017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:39.575031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:39.575793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:39.662418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7ac6a989-6c45-4193-a113-3322befc5f5e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:39.678165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7ac6a989-6c45-4193-a113-3322befc5f5e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.219306 Apr 11 19:48:39.679224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 56/105] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:39 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:39.827778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:39.843013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:39.846275 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:39.848267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-69d9f3ae-1530-4bd8-a462-02c1298359a8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.293199 Apr 11 19:48:39.850063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 50/106] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:39.997483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53858afe-b9b0-4f7c-986b-ea69e97c9328 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:39.998359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53858afe-b9b0-4f7c-986b-ea69e97c9328 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:40.005491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53858afe-b9b0-4f7c-986b-ea69e97c9328 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:40.006282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53858afe-b9b0-4f7c-986b-ea69e97c9328 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:40.007882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53858afe-b9b0-4f7c-986b-ea69e97c9328 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:40.009465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53858afe-b9b0-4f7c-986b-ea69e97c9328 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:40.268604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53858afe-b9b0-4f7c-986b-ea69e97c9328 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:40.282286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53858afe-b9b0-4f7c-986b-ea69e97c9328 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1553 microversion: 2.1 time: 0.288565 Apr 11 19:48:40.283304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 57/107] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:39 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:40.703527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2c41b214-4dbd-4d9c-9b82-0dd27811d110 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:40.704471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2c41b214-4dbd-4d9c-9b82-0dd27811d110 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:40.711541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c41b214-4dbd-4d9c-9b82-0dd27811d110 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:40.712388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c41b214-4dbd-4d9c-9b82-0dd27811d110 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:40.713348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c41b214-4dbd-4d9c-9b82-0dd27811d110 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:40.713788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c41b214-4dbd-4d9c-9b82-0dd27811d110 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:40.868777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:40.869349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:40.875190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2c41b214-4dbd-4d9c-9b82-0dd27811d110 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:40.881577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:40.882012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:40.886510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2c41b214-4dbd-4d9c-9b82-0dd27811d110 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.187021 Apr 11 19:48:40.887410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 51/108] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:40 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:40.894349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:40.894792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:41.036815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:41.046084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:41.047811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:41.048870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-99a137df-acab-450f-95e4-ed82f866a725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.184081 Apr 11 19:48:41.053097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 58/109] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:48:41.299689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-063482bd-b66f-4b1a-87f2-87bf56a10dc7 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:41.300304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-063482bd-b66f-4b1a-87f2-87bf56a10dc7 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:41.306529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-063482bd-b66f-4b1a-87f2-87bf56a10dc7 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:41.307169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-063482bd-b66f-4b1a-87f2-87bf56a10dc7 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:41.307947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-063482bd-b66f-4b1a-87f2-87bf56a10dc7 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:41.308378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-063482bd-b66f-4b1a-87f2-87bf56a10dc7 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:41.451075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-063482bd-b66f-4b1a-87f2-87bf56a10dc7 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:41.459354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-063482bd-b66f-4b1a-87f2-87bf56a10dc7 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1553 microversion: 2.1 time: 0.163393 Apr 11 19:48:41.465047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 52/110] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:41 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:41.903738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6fa4650d-c58e-45cd-8718-c36b2b410fe0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:41.904584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6fa4650d-c58e-45cd-8718-c36b2b410fe0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:41.911427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fa4650d-c58e-45cd-8718-c36b2b410fe0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:41.911715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fa4650d-c58e-45cd-8718-c36b2b410fe0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:41.912737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fa4650d-c58e-45cd-8718-c36b2b410fe0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:41.913362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fa4650d-c58e-45cd-8718-c36b2b410fe0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:42.068690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:42.069501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:42.085481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:42.088594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:42.101904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:42.101904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:42.102270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6fa4650d-c58e-45cd-8718-c36b2b410fe0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:42.107495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6fa4650d-c58e-45cd-8718-c36b2b410fe0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1321 microversion: 2.1 time: 0.207755 Apr 11 19:48:42.108842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 59/111] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:41 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:42.327729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:42.337633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:42.339128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:42.343766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-08d4d351-b8d6-4e20-a907-9ce07f2efba3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.275876 Apr 11 19:48:42.344429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 53/112] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:48:42.475796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-11b18390-602a-44de-aa74-00a686c512c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:42.476440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-11b18390-602a-44de-aa74-00a686c512c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:42.483194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11b18390-602a-44de-aa74-00a686c512c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:42.483701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11b18390-602a-44de-aa74-00a686c512c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:42.484918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11b18390-602a-44de-aa74-00a686c512c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:42.485526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11b18390-602a-44de-aa74-00a686c512c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:42.789602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11b18390-602a-44de-aa74-00a686c512c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:42.802266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-11b18390-602a-44de-aa74-00a686c512c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1553 microversion: 2.1 time: 0.330238 Apr 11 19:48:42.804428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 60/113] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:42 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1553 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:43.126473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-28f57f6b-8dd2-4cbd-8d00-735b8fa8bf35 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:43.127329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-28f57f6b-8dd2-4cbd-8d00-735b8fa8bf35 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:43.134533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28f57f6b-8dd2-4cbd-8d00-735b8fa8bf35 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.135242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28f57f6b-8dd2-4cbd-8d00-735b8fa8bf35 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.136428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28f57f6b-8dd2-4cbd-8d00-735b8fa8bf35 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.137957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28f57f6b-8dd2-4cbd-8d00-735b8fa8bf35 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.327363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-28f57f6b-8dd2-4cbd-8d00-735b8fa8bf35 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:43.336619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-28f57f6b-8dd2-4cbd-8d00-735b8fa8bf35 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1515 microversion: 2.1 time: 0.214262 Apr 11 19:48:43.337584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 54/114] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:43 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:43.359777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e97fb7b6-2c1d-460b-a246-4db54bf80ce4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:43.361040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e97fb7b6-2c1d-460b-a246-4db54bf80ce4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:43.365357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:43.365357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:43.368802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e97fb7b6-2c1d-460b-a246-4db54bf80ce4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.369414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e97fb7b6-2c1d-460b-a246-4db54bf80ce4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.370456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e97fb7b6-2c1d-460b-a246-4db54bf80ce4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.371095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.371210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e97fb7b6-2c1d-460b-a246-4db54bf80ce4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.371537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.372505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.373016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.404604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-e97fb7b6-2c1d-460b-a246-4db54bf80ce4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lazy-loading 'flavor' on Instance uuid 4395837c-0771-4542-9331-ae83b23b125f {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:48:43.568692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:43.582849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:43.584610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:43.585725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e97fb7b6-2c1d-460b-a246-4db54bf80ce4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f/action" status: 200 len: 32 microversion: 2.1 time: 0.222826 Apr 11 19:48:43.586340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2d511d5-f7cc-4bb7-a534-1ac2b5ea2033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1406 microversion: 2.20 time: 0.226902 Apr 11 19:48:43.589220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 55/115] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:43.593212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 61/116] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 19:48:43 2022] POST /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:48:43.607123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bf182296-5d5c-459a-95b1-08f14afbf0c8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:43.607751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bf182296-5d5c-459a-95b1-08f14afbf0c8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:43.614174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf182296-5d5c-459a-95b1-08f14afbf0c8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.614624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf182296-5d5c-459a-95b1-08f14afbf0c8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.615398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf182296-5d5c-459a-95b1-08f14afbf0c8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.615833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf182296-5d5c-459a-95b1-08f14afbf0c8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.823500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bf182296-5d5c-459a-95b1-08f14afbf0c8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:43.824710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1a4adf1-1c75-4581-a4f3-17f121655d33 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:43.825483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1a4adf1-1c75-4581-a4f3-17f121655d33 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:43.833073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1a4adf1-1c75-4581-a4f3-17f121655d33 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.833797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1a4adf1-1c75-4581-a4f3-17f121655d33 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.834766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1a4adf1-1c75-4581-a4f3-17f121655d33 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:43.835174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1a4adf1-1c75-4581-a4f3-17f121655d33 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:43.841614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bf182296-5d5c-459a-95b1-08f14afbf0c8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.238497 Apr 11 19:48:43.851568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 56/117] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:43 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:44.039465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1a4adf1-1c75-4581-a4f3-17f121655d33 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:44.054763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1a4adf1-1c75-4581-a4f3-17f121655d33 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1553 microversion: 2.1 time: 0.236209 Apr 11 19:48:44.055519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 62/118] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:43 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:44.439166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-a9f26539-1061-40d6-9d22-0c7796763692 req-220a306e-a258-4e21-bc23-6ed3aa55fcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d175e143-0fb4-46bc-acbf-99ed3710c59f", "name": "network-vif-deleted", "tag": "e355d285-c51d-412d-84be-6b4cfc168e42"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:44.453428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-a9f26539-1061-40d6-9d22-0c7796763692 req-220a306e-a258-4e21-bc23-6ed3aa55fcbc service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:44.453740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-a9f26539-1061-40d6-9d22-0c7796763692 req-220a306e-a258-4e21-bc23-6ed3aa55fcbc service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:44.471986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-a9f26539-1061-40d6-9d22-0c7796763692 req-220a306e-a258-4e21-bc23-6ed3aa55fcbc service nova] Creating event network-vif-deleted:e355d285-c51d-412d-84be-6b4cfc168e42 for instance d175e143-0fb4-46bc-acbf-99ed3710c59f on hv-cinder-83078 Apr 11 19:48:44.478193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-a9f26539-1061-40d6-9d22-0c7796763692 req-220a306e-a258-4e21-bc23-6ed3aa55fcbc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053268 Apr 11 19:48:44.478614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 57/119] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:44.612433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:44.613365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:44.621708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:44.625307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:44.626523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:44.628810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:44.788174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:44.798385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:44.799699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:44.801784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-62305078-6050-4082-8648-574e0adbf1f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1598 microversion: 2.20 time: 0.193502 Apr 11 19:48:44.802229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 63/120] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:48:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:48:44.821279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b9a5a5e0-4e2f-44d1-983d-0d60dab086c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:44.821860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b9a5a5e0-4e2f-44d1-983d-0d60dab086c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:44.828397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9a5a5e0-4e2f-44d1-983d-0d60dab086c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:44.828838 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9a5a5e0-4e2f-44d1-983d-0d60dab086c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:44.829634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9a5a5e0-4e2f-44d1-983d-0d60dab086c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:44.830058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9a5a5e0-4e2f-44d1-983d-0d60dab086c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:44.861777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5b26663-62aa-4585-a1af-190e8522d1e4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:44.862723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5b26663-62aa-4585-a1af-190e8522d1e4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:44.882781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5b26663-62aa-4585-a1af-190e8522d1e4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:44.883372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5b26663-62aa-4585-a1af-190e8522d1e4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:44.886111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5b26663-62aa-4585-a1af-190e8522d1e4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:44.888744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5b26663-62aa-4585-a1af-190e8522d1e4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:44.944111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b9a5a5e0-4e2f-44d1-983d-0d60dab086c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.127260 Apr 11 19:48:44.944772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 58/121] 10.222.0.62 () {60 vars in 1315 bytes} [Mon Apr 11 19:48:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:48:45.071761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3c5792f-3608-4ea5-8cd2-5e6a3d7cdb65 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:45.071897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5b26663-62aa-4585-a1af-190e8522d1e4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:45.074908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3c5792f-3608-4ea5-8cd2-5e6a3d7cdb65 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:45.086643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5b26663-62aa-4585-a1af-190e8522d1e4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.229691 Apr 11 19:48:45.087946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 64/122] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:44 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:45.091852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3c5792f-3608-4ea5-8cd2-5e6a3d7cdb65 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:45.091852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3c5792f-3608-4ea5-8cd2-5e6a3d7cdb65 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:45.091852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3c5792f-3608-4ea5-8cd2-5e6a3d7cdb65 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:45.091852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3c5792f-3608-4ea5-8cd2-5e6a3d7cdb65 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:45.173753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3c5792f-3608-4ea5-8cd2-5e6a3d7cdb65 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20929015e45493ebcf4faf78aeeab78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ee47275a8f47118b9684a347efca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:45.185403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3c5792f-3608-4ea5-8cd2-5e6a3d7cdb65 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 200 len: 1346 microversion: 2.1 time: 0.117573 Apr 11 19:48:45.186140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 59/123] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:45 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 1346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:46.104988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-93fe9788-05b3-4bc4-b763-c5c6f3816e46 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:46.106780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-93fe9788-05b3-4bc4-b763-c5c6f3816e46 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:46.118508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93fe9788-05b3-4bc4-b763-c5c6f3816e46 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:46.119954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93fe9788-05b3-4bc4-b763-c5c6f3816e46 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:46.120838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93fe9788-05b3-4bc4-b763-c5c6f3816e46 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:46.121314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93fe9788-05b3-4bc4-b763-c5c6f3816e46 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:46.172009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1692807793", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "networks": [{"uuid": "eecf317c-0082-46e6-b978-6412201514db"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:46.262921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] validate_networks() for [('eecf317c-0082-46e6-b978-6412201514db', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:48:46.447801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-93fe9788-05b3-4bc4-b763-c5c6f3816e46 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:46.469215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-93fe9788-05b3-4bc4-b763-c5c6f3816e46 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.368548 Apr 11 19:48:46.472357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 65/124] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:46 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:46.485702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:46.486321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:46.497363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:46.497796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:46.499119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:46.501062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:46.526428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] HTTP exception thrown: Instance d175e143-0fb4-46bc-acbf-99ed3710c59f could not be found. Apr 11 19:48:46.527322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Returning 404 to user: Instance d175e143-0fb4-46bc-acbf-99ed3710c59f could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:48:46.528378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82c42ee7-a9a6-42cd-b883-30e21579030e tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 404 len: 111 microversion: 2.1 time: 0.054800 Apr 11 19:48:46.532617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 66/125] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:46 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:48:46.686668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:46.687718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:46.694848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:46.695529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:46.697451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:46.698375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:46.720095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] HTTP exception thrown: Instance d175e143-0fb4-46bc-acbf-99ed3710c59f could not be found. Apr 11 19:48:46.721077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Returning 404 to user: Instance d175e143-0fb4-46bc-acbf-99ed3710c59f could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:48:46.722127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1940e17-92b9-4ee0-a6c1-3dc3efdb36c0 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040783 Apr 11 19:48:46.724443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 67/126] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:48:46 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:48:46.846288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-31ccaa0b-4114-4910-96d8-497214e27af1 req-d4a67702-52fe-4894-8054-c9ea7e6cc8ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6aea71-8b17-46b8-ab07-b42b41b573a5", "tag": "043741af-b872-498e-a793-2860d820736a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:46.908189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-31ccaa0b-4114-4910-96d8-497214e27af1 req-d4a67702-52fe-4894-8054-c9ea7e6cc8ba service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:46.912270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-31ccaa0b-4114-4910-96d8-497214e27af1 req-d4a67702-52fe-4894-8054-c9ea7e6cc8ba service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:46.968027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-31ccaa0b-4114-4910-96d8-497214e27af1 req-d4a67702-52fe-4894-8054-c9ea7e6cc8ba service nova] Creating event network-changed:043741af-b872-498e-a793-2860d820736a for instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 on hv-cinder-83078 Apr 11 19:48:46.997032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-31ccaa0b-4114-4910-96d8-497214e27af1 req-d4a67702-52fe-4894-8054-c9ea7e6cc8ba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159025 Apr 11 19:48:47.003726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 68/127] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:48:47.125314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:48:47.125804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:48:47.126580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:48:47.127244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:48:47.127659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:48:47.139971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:47.140421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:47.141234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:47.141664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:47.188711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Getting quotas for project 96adb977ddc74b588e3cdefe024cf6c2. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:48:47.208122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Getting quotas for user 29485f7ab35d4ad08a4001a005de4a71 and project 96adb977ddc74b588e3cdefe024cf6c2. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:48:47.229111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:48:47.233646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:48:47.326815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c373988-516a-4c84-87c5-ae56ef693d42 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159679 Apr 11 19:48:47.327505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 60/128] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:48:47.339223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3e52857a-548e-4f26-b76b-5975b59616ea tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:47.342669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3e52857a-548e-4f26-b76b-5975b59616ea tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:47.471876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3e52857a-548e-4f26-b76b-5975b59616ea tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:47.480894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3e52857a-548e-4f26-b76b-5975b59616ea tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1214 microversion: 2.1 time: 0.146735 Apr 11 19:48:47.485028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 69/129] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:47 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:47.498458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e02e5ac8-0342-4c1c-82d9-a2ff0ecdf3af tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:47.499623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e02e5ac8-0342-4c1c-82d9-a2ff0ecdf3af tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:47.508371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e02e5ac8-0342-4c1c-82d9-a2ff0ecdf3af tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:47.508822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e02e5ac8-0342-4c1c-82d9-a2ff0ecdf3af tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:47.513036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e02e5ac8-0342-4c1c-82d9-a2ff0ecdf3af tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:47.513495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e02e5ac8-0342-4c1c-82d9-a2ff0ecdf3af tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:47.773434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e02e5ac8-0342-4c1c-82d9-a2ff0ecdf3af tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:47.785144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e02e5ac8-0342-4c1c-82d9-a2ff0ecdf3af tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.301185 Apr 11 19:48:47.787568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 61/130] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:47 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:48.116359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:48.116866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:48.133767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:48.134528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:48.135936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:48.136580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:48.181896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] HTTP exception thrown: Instance d175e143-0fb4-46bc-acbf-99ed3710c59f could not be found. Apr 11 19:48:48.182518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Returning 404 to user: Instance d175e143-0fb4-46bc-acbf-99ed3710c59f could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:48:48.183945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f58da9c5-a2d2-445a-b214-85ca813db0a1 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 404 len: 111 microversion: 2.1 time: 0.073003 Apr 11 19:48:48.184974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 70/131] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 19:48:48 2022] DELETE /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:48:48.203392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:48.204786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] [instance: d175e143-0fb4-46bc-acbf-99ed3710c59f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:48.224753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:48.225653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:48.229272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:48.232852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:48.275616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] HTTP exception thrown: Instance d175e143-0fb4-46bc-acbf-99ed3710c59f could not be found. Apr 11 19:48:48.276443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] Returning 404 to user: Instance d175e143-0fb4-46bc-acbf-99ed3710c59f could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:48:48.278540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6fff3aff-eda4-4286-9ca2-626832a18d54 tempest-DeleteServersTestJSON-1524559095 tempest-DeleteServersTestJSON-1524559095-project] 10.222.0.62 "GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f" status: 404 len: 111 microversion: 2.1 time: 0.088244 Apr 11 19:48:48.279341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 62/132] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:48 2022] GET /compute/v2.1/servers/d175e143-0fb4-46bc-acbf-99ed3710c59f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:48:48.501611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-be614467-e886-4e9e-a318-788a2c7a2e6d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:48.502494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-be614467-e886-4e9e-a318-788a2c7a2e6d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:48.509087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be614467-e886-4e9e-a318-788a2c7a2e6d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:48.514482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be614467-e886-4e9e-a318-788a2c7a2e6d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:48.515951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be614467-e886-4e9e-a318-788a2c7a2e6d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:48.516606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be614467-e886-4e9e-a318-788a2c7a2e6d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:48.642382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-be614467-e886-4e9e-a318-788a2c7a2e6d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:48.653210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-be614467-e886-4e9e-a318-788a2c7a2e6d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1266 microversion: 2.1 time: 0.153445 Apr 11 19:48:48.653210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 71/133] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:48 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:48.804078 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f60839f4-05dc-458d-b88a-494dd0747e01 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:48.807729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f60839f4-05dc-458d-b88a-494dd0747e01 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:48.819250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f60839f4-05dc-458d-b88a-494dd0747e01 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:48.819716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f60839f4-05dc-458d-b88a-494dd0747e01 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:48.820514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f60839f4-05dc-458d-b88a-494dd0747e01 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:48.821004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f60839f4-05dc-458d-b88a-494dd0747e01 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:49.048668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f60839f4-05dc-458d-b88a-494dd0747e01 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:49.064554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f60839f4-05dc-458d-b88a-494dd0747e01 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.265462 Apr 11 19:48:49.065172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 63/134] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:48 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:49.668437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-28faade6-4508-46fb-9a81-70615946ec61 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:49.669207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-28faade6-4508-46fb-9a81-70615946ec61 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:49.679402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28faade6-4508-46fb-9a81-70615946ec61 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:49.680564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28faade6-4508-46fb-9a81-70615946ec61 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:49.682090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28faade6-4508-46fb-9a81-70615946ec61 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:49.682721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28faade6-4508-46fb-9a81-70615946ec61 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:49.759654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-28faade6-4508-46fb-9a81-70615946ec61 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:49.785015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-28faade6-4508-46fb-9a81-70615946ec61 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1272 microversion: 2.1 time: 0.105957 Apr 11 19:48:49.799029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 72/135] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:49 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:50.083563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3f37d7ad-d125-4e6d-a746-d34d22614746 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:50.084442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3f37d7ad-d125-4e6d-a746-d34d22614746 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:50.100973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f37d7ad-d125-4e6d-a746-d34d22614746 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:50.103021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f37d7ad-d125-4e6d-a746-d34d22614746 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:50.103798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f37d7ad-d125-4e6d-a746-d34d22614746 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:50.104550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f37d7ad-d125-4e6d-a746-d34d22614746 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:50.367741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f37d7ad-d125-4e6d-a746-d34d22614746 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:50.380889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3f37d7ad-d125-4e6d-a746-d34d22614746 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.301602 Apr 11 19:48:50.382220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 64/136] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:50 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:50.805769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dd0b0f0c-53ab-4a9f-8977-fdfde8d67f32 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:50.807233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dd0b0f0c-53ab-4a9f-8977-fdfde8d67f32 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:50.828484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd0b0f0c-53ab-4a9f-8977-fdfde8d67f32 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:50.833217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd0b0f0c-53ab-4a9f-8977-fdfde8d67f32 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:50.834065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd0b0f0c-53ab-4a9f-8977-fdfde8d67f32 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:50.834590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd0b0f0c-53ab-4a9f-8977-fdfde8d67f32 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:51.073345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dd0b0f0c-53ab-4a9f-8977-fdfde8d67f32 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:51.081285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-5ffab5e1-6453-49d2-8d19-1aec9d8f4fb4 req-167e7756-3478-4a9a-b41a-1017569157e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a38f63-7c71-4371-a3b7-92ccd91b0609", "tag": "c93e43c5-0788-44e4-9a0c-3ca9bdd1a2ce"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:51.084021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dd0b0f0c-53ab-4a9f-8977-fdfde8d67f32 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1314 microversion: 2.1 time: 0.280657 Apr 11 19:48:51.086503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 73/137] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:50 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:51.096220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-5ffab5e1-6453-49d2-8d19-1aec9d8f4fb4 req-167e7756-3478-4a9a-b41a-1017569157e0 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:51.097298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-5ffab5e1-6453-49d2-8d19-1aec9d8f4fb4 req-167e7756-3478-4a9a-b41a-1017569157e0 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:51.131906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-5ffab5e1-6453-49d2-8d19-1aec9d8f4fb4 req-167e7756-3478-4a9a-b41a-1017569157e0 service nova] Creating event network-changed:c93e43c5-0788-44e4-9a0c-3ca9bdd1a2ce for instance e3a38f63-7c71-4371-a3b7-92ccd91b0609 on hv-cinder-83078 Apr 11 19:48:51.138329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-5ffab5e1-6453-49d2-8d19-1aec9d8f4fb4 req-167e7756-3478-4a9a-b41a-1017569157e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061314 Apr 11 19:48:51.140378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 65/138] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:48:51.401577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-431263a4-9c4c-405f-a5b7-95afea548925 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:51.402263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-431263a4-9c4c-405f-a5b7-95afea548925 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:51.411670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-431263a4-9c4c-405f-a5b7-95afea548925 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:51.412426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-431263a4-9c4c-405f-a5b7-95afea548925 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:51.413609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-431263a4-9c4c-405f-a5b7-95afea548925 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:51.414396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-431263a4-9c4c-405f-a5b7-95afea548925 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:51.646353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-431263a4-9c4c-405f-a5b7-95afea548925 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:51.659899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-431263a4-9c4c-405f-a5b7-95afea548925 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.263062 Apr 11 19:48:51.669485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 74/139] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:51 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:52.103974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7ce095c3-1a27-4e95-a29f-4567e315909d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:52.105278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7ce095c3-1a27-4e95-a29f-4567e315909d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:52.112575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ce095c3-1a27-4e95-a29f-4567e315909d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:52.113231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ce095c3-1a27-4e95-a29f-4567e315909d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:52.113973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ce095c3-1a27-4e95-a29f-4567e315909d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:52.114488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ce095c3-1a27-4e95-a29f-4567e315909d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:52.292192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7ce095c3-1a27-4e95-a29f-4567e315909d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:52.300124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7ce095c3-1a27-4e95-a29f-4567e315909d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1314 microversion: 2.1 time: 0.200938 Apr 11 19:48:52.300706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 66/140] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:52 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:52.677644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bcd6c8f5-fb4f-49c5-be0a-54dc5c3f63eb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:52.678983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bcd6c8f5-fb4f-49c5-be0a-54dc5c3f63eb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:52.688938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcd6c8f5-fb4f-49c5-be0a-54dc5c3f63eb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:52.689384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcd6c8f5-fb4f-49c5-be0a-54dc5c3f63eb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:52.701778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcd6c8f5-fb4f-49c5-be0a-54dc5c3f63eb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:52.702338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcd6c8f5-fb4f-49c5-be0a-54dc5c3f63eb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:52.886445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bcd6c8f5-fb4f-49c5-be0a-54dc5c3f63eb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:52.896003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bcd6c8f5-fb4f-49c5-be0a-54dc5c3f63eb tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.222449 Apr 11 19:48:52.896596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 75/141] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:52 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:53.172487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a7e823a-a97b-4d44-99c3-0b1054df10c6 tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c05da60>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:53.233880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a7e823a-a97b-4d44-99c3-0b1054df10c6 tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/6bbbd7c4-ab2a-49d1-98dd-78093a1c872d" status: 200 len: 351 microversion: 2.1 time: 0.066292 Apr 11 19:48:53.234482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 67/142] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 19:48:53 2022] GET /compute/v2.1/os-volumes/6bbbd7c4-ab2a-49d1-98dd-78093a1c872d => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:53.322776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a77b50ec-c07d-4834-92d8-044ecc7178c7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:53.324052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a77b50ec-c07d-4834-92d8-044ecc7178c7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:53.344943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a77b50ec-c07d-4834-92d8-044ecc7178c7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:53.347686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a77b50ec-c07d-4834-92d8-044ecc7178c7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:53.350645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a77b50ec-c07d-4834-92d8-044ecc7178c7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:53.351349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a77b50ec-c07d-4834-92d8-044ecc7178c7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:53.436527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1241907297", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "networks": [{"uuid": "403e412b-2ece-4ae4-8456-d4543cf343c1"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:53.555919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] validate_networks() for [('403e412b-2ece-4ae4-8456-d4543cf343c1', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:48:53.733246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a77b50ec-c07d-4834-92d8-044ecc7178c7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:53.759630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a77b50ec-c07d-4834-92d8-044ecc7178c7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1314 microversion: 2.1 time: 0.444770 Apr 11 19:48:53.760654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 76/143] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:53 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:53.913283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-055469ac-285e-49a4-ac13-6a74688bf124 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:53.914105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-055469ac-285e-49a4-ac13-6a74688bf124 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:53.920195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-055469ac-285e-49a4-ac13-6a74688bf124 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:53.920645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-055469ac-285e-49a4-ac13-6a74688bf124 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:53.921445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-055469ac-285e-49a4-ac13-6a74688bf124 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:53.921873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-055469ac-285e-49a4-ac13-6a74688bf124 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:54.413716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-055469ac-285e-49a4-ac13-6a74688bf124 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:54.423799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-055469ac-285e-49a4-ac13-6a74688bf124 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.514508 Apr 11 19:48:54.424725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 77/144] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:53 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:54.478460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:48:54.479015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:48:54.481279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:48:54.481878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:48:54.482955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:48:54.497989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:54.499784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:54.505069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:54.505558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:54.526521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Getting quotas for project 5a4efeb8e17b4f9daa20a62fad70daa1. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:48:54.531822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Getting quotas for user a27238068e724556bf6f5b3d6ee5e721 and project 5a4efeb8e17b4f9daa20a62fad70daa1. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:48:54.552961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:48:54.557113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:48:54.628540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3c548015-4ca5-432a-a77d-ba93dd55db4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195786 Apr 11 19:48:54.629449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 68/145] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 19:48:54.642410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c188cdd-08d1-41ed-bbf8-9a42f32722f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:54.643783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4c188cdd-08d1-41ed-bbf8-9a42f32722f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:54.765193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4c188cdd-08d1-41ed-bbf8-9a42f32722f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:54.777069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c188cdd-08d1-41ed-bbf8-9a42f32722f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1219 microversion: 2.1 time: 0.136590 Apr 11 19:48:54.777811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7946df38-2160-4a11-aa0f-666679b90df9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:54.778209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 78/146] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:54 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:54.789220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7946df38-2160-4a11-aa0f-666679b90df9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:54.796965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7946df38-2160-4a11-aa0f-666679b90df9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:54.797582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7946df38-2160-4a11-aa0f-666679b90df9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:54.798553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7946df38-2160-4a11-aa0f-666679b90df9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:54.798980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7946df38-2160-4a11-aa0f-666679b90df9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:54.814108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-49903bb4-8f68-4383-8535-c4258abf0eb9 tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c187a60>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:54.934608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-49903bb4-8f68-4383-8535-c4258abf0eb9 tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bab26d67-7d86-4a8e-8b70-a3ee8b54af32" status: 200 len: 350 microversion: 2.1 time: 0.127603 Apr 11 19:48:54.936258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 79/147] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 19:48:54 2022] GET /compute/v2.1/os-volumes/bab26d67-7d86-4a8e-8b70-a3ee8b54af32 => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:55.106952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7946df38-2160-4a11-aa0f-666679b90df9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:55.119089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7946df38-2160-4a11-aa0f-666679b90df9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1314 microversion: 2.1 time: 0.345050 Apr 11 19:48:55.131028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 69/148] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:54 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:55.167469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-9615dab9-cfd4-4ada-bc44-3d6ffb546767 req-7df6ea02-5738-4d8c-99df-3b18f2e0ce55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a38f63-7c71-4371-a3b7-92ccd91b0609", "name": "network-vif-plugged", "status": "completed", "tag": "c93e43c5-0788-44e4-9a0c-3ca9bdd1a2ce"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:55.176216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9615dab9-cfd4-4ada-bc44-3d6ffb546767 req-7df6ea02-5738-4d8c-99df-3b18f2e0ce55 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:55.176645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9615dab9-cfd4-4ada-bc44-3d6ffb546767 req-7df6ea02-5738-4d8c-99df-3b18f2e0ce55 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:55.206681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-9615dab9-cfd4-4ada-bc44-3d6ffb546767 req-7df6ea02-5738-4d8c-99df-3b18f2e0ce55 service nova] Creating event network-vif-plugged:c93e43c5-0788-44e4-9a0c-3ca9bdd1a2ce for instance e3a38f63-7c71-4371-a3b7-92ccd91b0609 on hv-cinder-83078 Apr 11 19:48:55.217687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-9615dab9-cfd4-4ada-bc44-3d6ffb546767 req-7df6ea02-5738-4d8c-99df-3b18f2e0ce55 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057501 Apr 11 19:48:55.219434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 80/149] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:48:55.451346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a0829825-9994-4d93-b5f4-050c42d7f643 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:55.452140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a0829825-9994-4d93-b5f4-050c42d7f643 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:55.465349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0829825-9994-4d93-b5f4-050c42d7f643 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:55.476409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0829825-9994-4d93-b5f4-050c42d7f643 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:55.477607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0829825-9994-4d93-b5f4-050c42d7f643 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:55.478212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0829825-9994-4d93-b5f4-050c42d7f643 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:55.685590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a0829825-9994-4d93-b5f4-050c42d7f643 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:55.694549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a0829825-9994-4d93-b5f4-050c42d7f643 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.247221 Apr 11 19:48:55.695251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 70/150] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:55 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:55.798292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-96512fa5-c608-4bf3-b672-df7bff190c3a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:55.799503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-96512fa5-c608-4bf3-b672-df7bff190c3a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:55.811899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96512fa5-c608-4bf3-b672-df7bff190c3a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:55.812872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96512fa5-c608-4bf3-b672-df7bff190c3a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:55.813874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96512fa5-c608-4bf3-b672-df7bff190c3a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:55.814606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96512fa5-c608-4bf3-b672-df7bff190c3a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:55.887146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-96512fa5-c608-4bf3-b672-df7bff190c3a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:55.895662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-96512fa5-c608-4bf3-b672-df7bff190c3a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1271 microversion: 2.1 time: 0.104348 Apr 11 19:48:55.896249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 81/151] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:55 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:56.144210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6dce6251-d54d-46d3-a0fa-06a44239f411 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:56.145138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6dce6251-d54d-46d3-a0fa-06a44239f411 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:56.152203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6dce6251-d54d-46d3-a0fa-06a44239f411 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:56.152652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6dce6251-d54d-46d3-a0fa-06a44239f411 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:56.153475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6dce6251-d54d-46d3-a0fa-06a44239f411 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:56.153911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6dce6251-d54d-46d3-a0fa-06a44239f411 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:56.290752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6dce6251-d54d-46d3-a0fa-06a44239f411 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:56.298221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6dce6251-d54d-46d3-a0fa-06a44239f411 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1314 microversion: 2.1 time: 0.158502 Apr 11 19:48:56.298802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 71/152] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:56 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:56.513020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b19bb87c-2bed-47bd-8d77-43d4b0110e53 tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c07e940>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:56.561331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b19bb87c-2bed-47bd-8d77-43d4b0110e53 tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/e684a8e8-6fe4-4a7f-9ffb-3e560cab1791" status: 200 len: 351 microversion: 2.1 time: 0.052134 Apr 11 19:48:56.561911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 82/153] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 19:48:56 2022] GET /compute/v2.1/os-volumes/e684a8e8-6fe4-4a7f-9ffb-3e560cab1791 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:56.573902 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-190c2545-b8b9-4fd8-86e0-9fb202b75faa tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c05db80>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:56.658811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-190c2545-b8b9-4fd8-86e0-9fb202b75faa tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089473 Apr 11 19:48:56.659550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 72/154] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Apr 11 19:48:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:56.672161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-027d4655-6700-437f-be85-73c1e5884ddb tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408cb1df70>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:56.712142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f003c61-bdbb-48ce-a1c4-79d20b421f75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:56.713739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f003c61-bdbb-48ce-a1c4-79d20b421f75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:56.727854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f003c61-bdbb-48ce-a1c4-79d20b421f75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:56.728726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f003c61-bdbb-48ce-a1c4-79d20b421f75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:56.729915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f003c61-bdbb-48ce-a1c4-79d20b421f75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:56.730597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f003c61-bdbb-48ce-a1c4-79d20b421f75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:56.782328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-027d4655-6700-437f-be85-73c1e5884ddb tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.113898 Apr 11 19:48:56.783315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 83/155] 10.222.0.62 () {58 vars in 1148 bytes} [Mon Apr 11 19:48:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:56.795141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df9047ee-7752-4862-85d8-954a4d9b7c2c tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c08f040>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:56.904271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df9047ee-7752-4862-85d8-954a4d9b7c2c tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.113077 Apr 11 19:48:56.906310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 84/156] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Apr 11 19:48:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:56.920798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-355a93e9-3d07-46ab-8b0d-4305c05b5912 tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c07e820>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:56.941264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f003c61-bdbb-48ce-a1c4-79d20b421f75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:56.950804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f003c61-bdbb-48ce-a1c4-79d20b421f75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.242985 Apr 11 19:48:56.951648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 73/157] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:56 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:56.960634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d1348512-5552-4273-b0ab-1eb34b91dfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:56.961670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d1348512-5552-4273-b0ab-1eb34b91dfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:56.971306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1348512-5552-4273-b0ab-1eb34b91dfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:56.971997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1348512-5552-4273-b0ab-1eb34b91dfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:56.972793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1348512-5552-4273-b0ab-1eb34b91dfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:56.973261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1348512-5552-4273-b0ab-1eb34b91dfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:57.027568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-355a93e9-3d07-46ab-8b0d-4305c05b5912 tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.113863 Apr 11 19:48:57.028884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 85/158] 10.222.0.62 () {58 vars in 1166 bytes} [Mon Apr 11 19:48:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:57.044753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc40c471-fd58-4af0-aa5d-cebcc4e8b0bf tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c067c10>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:57.060006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d1348512-5552-4273-b0ab-1eb34b91dfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:57.068703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d1348512-5552-4273-b0ab-1eb34b91dfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1277 microversion: 2.1 time: 0.115901 Apr 11 19:48:57.069570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 74/159] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:56 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:57.145994 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc40c471-fd58-4af0-aa5d-cebcc4e8b0bf tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.105300 Apr 11 19:48:57.146755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 86/160] 10.222.0.62 () {58 vars in 1169 bytes} [Mon Apr 11 19:48:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:57.158951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b15079df-be9f-4bfc-b578-a9410b29c1bf tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c05d280>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:57.250713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b15079df-be9f-4bfc-b578-a9410b29c1bf tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095779 Apr 11 19:48:57.251287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 75/161] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Apr 11 19:48:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:57.262539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-26edb519-b31d-474d-8fe1-98cfaa0fb5dd tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c08f820>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:57.315649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b22e0e4-31ee-4591-a82a-78dfa680cb0f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:57.316260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7b22e0e4-31ee-4591-a82a-78dfa680cb0f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:57.323000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b22e0e4-31ee-4591-a82a-78dfa680cb0f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:57.323445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b22e0e4-31ee-4591-a82a-78dfa680cb0f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:57.324212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b22e0e4-31ee-4591-a82a-78dfa680cb0f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:57.324697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b22e0e4-31ee-4591-a82a-78dfa680cb0f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:57.356336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-26edb519-b31d-474d-8fe1-98cfaa0fb5dd tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097418 Apr 11 19:48:57.356979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 87/162] 10.222.0.62 () {58 vars in 1187 bytes} [Mon Apr 11 19:48:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:57.373130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d262425c-fbe6-4dbd-b8b6-b3a10b20205d tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] Calling method '.version_select at 0x7f408c067d30>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:57.461092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d262425c-fbe6-4dbd-b8b6-b3a10b20205d tempest-VolumesTestJSON-1007797766 tempest-VolumesTestJSON-1007797766-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091595 Apr 11 19:48:57.462296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 88/163] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Apr 11 19:48:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:57.492249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7b22e0e4-31ee-4591-a82a-78dfa680cb0f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:57.501192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7b22e0e4-31ee-4591-a82a-78dfa680cb0f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1314 microversion: 2.1 time: 0.189313 Apr 11 19:48:57.502139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 76/164] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:57 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:57.968986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1c321e9b-9f44-439b-a20e-31b051c21968 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:57.970421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1c321e9b-9f44-439b-a20e-31b051c21968 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:57.978190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c321e9b-9f44-439b-a20e-31b051c21968 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:57.979086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c321e9b-9f44-439b-a20e-31b051c21968 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:57.979927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c321e9b-9f44-439b-a20e-31b051c21968 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:57.980457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c321e9b-9f44-439b-a20e-31b051c21968 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:58.095279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-23f9476e-1569-400d-86a5-0db09fbe9fe4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:58.096069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-23f9476e-1569-400d-86a5-0db09fbe9fe4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:58.102638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23f9476e-1569-400d-86a5-0db09fbe9fe4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:58.103084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23f9476e-1569-400d-86a5-0db09fbe9fe4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:58.104033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23f9476e-1569-400d-86a5-0db09fbe9fe4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:58.104657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23f9476e-1569-400d-86a5-0db09fbe9fe4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:58.114892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1c321e9b-9f44-439b-a20e-31b051c21968 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:58.128229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1c321e9b-9f44-439b-a20e-31b051c21968 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.163110 Apr 11 19:48:58.129396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 89/165] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:57 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:58.264274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-23f9476e-1569-400d-86a5-0db09fbe9fe4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:58.274041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-23f9476e-1569-400d-86a5-0db09fbe9fe4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1319 microversion: 2.1 time: 0.182721 Apr 11 19:48:58.274793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 77/166] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:58 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:58.521932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-364ae27a-9c25-4f78-98dc-a559991f2476 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:58.522623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-364ae27a-9c25-4f78-98dc-a559991f2476 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:58.539913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-364ae27a-9c25-4f78-98dc-a559991f2476 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:58.540349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-364ae27a-9c25-4f78-98dc-a559991f2476 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:58.541144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-364ae27a-9c25-4f78-98dc-a559991f2476 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:58.541625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-364ae27a-9c25-4f78-98dc-a559991f2476 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:58.721241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-364ae27a-9c25-4f78-98dc-a559991f2476 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:58.729147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-364ae27a-9c25-4f78-98dc-a559991f2476 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1499 microversion: 2.1 time: 0.214241 Apr 11 19:48:58.729732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 90/167] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:58 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1499 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:48:58.989151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-3099139f-abdf-4acb-9975-c01ff4955185 req-67272073-f8c6-4ec1-a513-409dfde051ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58fd1a5-0f59-4337-85ac-8d9f2969aeb4", "tag": "8831ee5a-2f6b-4fe4-8f04-3e143842ecf0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:48:59.002532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-3099139f-abdf-4acb-9975-c01ff4955185 req-67272073-f8c6-4ec1-a513-409dfde051ee service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.002995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-3099139f-abdf-4acb-9975-c01ff4955185 req-67272073-f8c6-4ec1-a513-409dfde051ee service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.028819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-3099139f-abdf-4acb-9975-c01ff4955185 req-67272073-f8c6-4ec1-a513-409dfde051ee service nova] Creating event network-changed:8831ee5a-2f6b-4fe4-8f04-3e143842ecf0 for instance a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 on hv-cinder-83078 Apr 11 19:48:59.034921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-3099139f-abdf-4acb-9975-c01ff4955185 req-67272073-f8c6-4ec1-a513-409dfde051ee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060514 Apr 11 19:48:59.035883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 78/168] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:48:59.150262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b20921a3-4958-45f5-8df8-bae13e2c82db tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:59.151488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b20921a3-4958-45f5-8df8-bae13e2c82db tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:59.162894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b20921a3-4958-45f5-8df8-bae13e2c82db tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.163601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b20921a3-4958-45f5-8df8-bae13e2c82db tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.164952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b20921a3-4958-45f5-8df8-bae13e2c82db tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.165880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b20921a3-4958-45f5-8df8-bae13e2c82db tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.298846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1f66d982-f6a6-457f-967b-a909ae03ef47 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:59.300131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1f66d982-f6a6-457f-967b-a909ae03ef47 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:59.308855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f66d982-f6a6-457f-967b-a909ae03ef47 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.309636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f66d982-f6a6-457f-967b-a909ae03ef47 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.310371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f66d982-f6a6-457f-967b-a909ae03ef47 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.310808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f66d982-f6a6-457f-967b-a909ae03ef47 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.343827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b20921a3-4958-45f5-8df8-bae13e2c82db tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:59.352725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b20921a3-4958-45f5-8df8-bae13e2c82db tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.210166 Apr 11 19:48:59.353831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 91/169] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:59 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:59.368673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-151b2875-6ab2-4469-a8db-25419b626043 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:59.369351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-151b2875-6ab2-4469-a8db-25419b626043 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:59.377637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-151b2875-6ab2-4469-a8db-25419b626043 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.378157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-151b2875-6ab2-4469-a8db-25419b626043 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.378998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-151b2875-6ab2-4469-a8db-25419b626043 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.379456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-151b2875-6ab2-4469-a8db-25419b626043 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.412799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-151b2875-6ab2-4469-a8db-25419b626043 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 19:48:59.482441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1f66d982-f6a6-457f-967b-a909ae03ef47 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:59.491392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1f66d982-f6a6-457f-967b-a909ae03ef47 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1319 microversion: 2.1 time: 0.196836 Apr 11 19:48:59.492307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 79/170] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:59 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:48:59.544357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-151b2875-6ab2-4469-a8db-25419b626043 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 204 len: 0 microversion: 2.1 time: 0.179459 Apr 11 19:48:59.545068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 92/171] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 19:48:59 2022] DELETE /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:48:59.556667 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b120d5e7-6dee-40ce-8a03-718064f26c6a tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:48:59.557500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b120d5e7-6dee-40ce-8a03-718064f26c6a tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:48:59.564183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b120d5e7-6dee-40ce-8a03-718064f26c6a tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.564751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b120d5e7-6dee-40ce-8a03-718064f26c6a tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.565650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b120d5e7-6dee-40ce-8a03-718064f26c6a tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:48:59.566197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b120d5e7-6dee-40ce-8a03-718064f26c6a tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:48:59.712780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b120d5e7-6dee-40ce-8a03-718064f26c6a tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:48:59.720481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b120d5e7-6dee-40ce-8a03-718064f26c6a tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1505 microversion: 2.1 time: 0.169506 Apr 11 19:48:59.721093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 80/172] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:48:59 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:00.376074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b357d06d-e3b6-4d2b-826f-4fd105d5efba tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:00.377265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b357d06d-e3b6-4d2b-826f-4fd105d5efba tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:00.388995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b357d06d-e3b6-4d2b-826f-4fd105d5efba tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:00.389444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b357d06d-e3b6-4d2b-826f-4fd105d5efba tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:00.390259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b357d06d-e3b6-4d2b-826f-4fd105d5efba tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:00.390686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b357d06d-e3b6-4d2b-826f-4fd105d5efba tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:00.508612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7fda967f-b9aa-4ce1-903c-67f5071b744a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:00.509867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7fda967f-b9aa-4ce1-903c-67f5071b744a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:00.517304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fda967f-b9aa-4ce1-903c-67f5071b744a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:00.517901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fda967f-b9aa-4ce1-903c-67f5071b744a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:00.518814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fda967f-b9aa-4ce1-903c-67f5071b744a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:00.519351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fda967f-b9aa-4ce1-903c-67f5071b744a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:00.523644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b357d06d-e3b6-4d2b-826f-4fd105d5efba tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:00.531293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b357d06d-e3b6-4d2b-826f-4fd105d5efba tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.162716 Apr 11 19:49:00.532299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 93/173] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:00 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:00.668733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7fda967f-b9aa-4ce1-903c-67f5071b744a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:00.678061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7fda967f-b9aa-4ce1-903c-67f5071b744a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1319 microversion: 2.1 time: 0.172982 Apr 11 19:49:00.678643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 81/174] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:00 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:00.739022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa1ad51e-98f9-4fd6-b773-400df2c7c894 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:00.739738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa1ad51e-98f9-4fd6-b773-400df2c7c894 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:00.746374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa1ad51e-98f9-4fd6-b773-400df2c7c894 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:00.746811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa1ad51e-98f9-4fd6-b773-400df2c7c894 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:00.747657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa1ad51e-98f9-4fd6-b773-400df2c7c894 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:00.748082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa1ad51e-98f9-4fd6-b773-400df2c7c894 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:00.891741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aa1ad51e-98f9-4fd6-b773-400df2c7c894 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:00.906455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa1ad51e-98f9-4fd6-b773-400df2c7c894 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1505 microversion: 2.1 time: 0.171276 Apr 11 19:49:00.907424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 94/175] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:00 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:01.554628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-757a7d17-ad7b-42ad-b9b9-8efd159498e5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:01.555315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-757a7d17-ad7b-42ad-b9b9-8efd159498e5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:01.565761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-757a7d17-ad7b-42ad-b9b9-8efd159498e5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:01.566201 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-757a7d17-ad7b-42ad-b9b9-8efd159498e5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:01.566975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-757a7d17-ad7b-42ad-b9b9-8efd159498e5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:01.567962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-757a7d17-ad7b-42ad-b9b9-8efd159498e5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:01.699574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0c982ef-6f60-4cb1-b7c7-283dbb78d3bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:01.703465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0c982ef-6f60-4cb1-b7c7-283dbb78d3bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:01.713634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0c982ef-6f60-4cb1-b7c7-283dbb78d3bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:01.714291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0c982ef-6f60-4cb1-b7c7-283dbb78d3bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:01.715234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0c982ef-6f60-4cb1-b7c7-283dbb78d3bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:01.716001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0c982ef-6f60-4cb1-b7c7-283dbb78d3bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:01.774115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-757a7d17-ad7b-42ad-b9b9-8efd159498e5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:01.783540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-757a7d17-ad7b-42ad-b9b9-8efd159498e5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.235647 Apr 11 19:49:01.784139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 82/176] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:01 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:01.879696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0c982ef-6f60-4cb1-b7c7-283dbb78d3bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:01.888652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0c982ef-6f60-4cb1-b7c7-283dbb78d3bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1319 microversion: 2.1 time: 0.193372 Apr 11 19:49:01.889847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 95/177] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:01 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:01.923994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-52746b43-a852-43bd-aff5-37c9a55be77d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:01.924599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-52746b43-a852-43bd-aff5-37c9a55be77d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:01.931552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52746b43-a852-43bd-aff5-37c9a55be77d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:01.931891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52746b43-a852-43bd-aff5-37c9a55be77d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:01.932657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52746b43-a852-43bd-aff5-37c9a55be77d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:01.933160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52746b43-a852-43bd-aff5-37c9a55be77d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:02.129719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-52746b43-a852-43bd-aff5-37c9a55be77d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:02.144446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-52746b43-a852-43bd-aff5-37c9a55be77d tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1505 microversion: 2.1 time: 0.224381 Apr 11 19:49:02.145898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 83/178] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:01 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:02.802204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e133b81-7db9-48f0-b717-5c0be0daf2c9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:02.804127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e133b81-7db9-48f0-b717-5c0be0daf2c9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:02.811433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e133b81-7db9-48f0-b717-5c0be0daf2c9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:02.812247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e133b81-7db9-48f0-b717-5c0be0daf2c9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:02.825453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e133b81-7db9-48f0-b717-5c0be0daf2c9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:02.826721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e133b81-7db9-48f0-b717-5c0be0daf2c9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:02.907109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a4d8a7e-8ac8-4dd4-ad01-80e51ac7de03 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:02.907748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a4d8a7e-8ac8-4dd4-ad01-80e51ac7de03 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:02.918613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a4d8a7e-8ac8-4dd4-ad01-80e51ac7de03 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:02.919326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a4d8a7e-8ac8-4dd4-ad01-80e51ac7de03 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:02.921365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a4d8a7e-8ac8-4dd4-ad01-80e51ac7de03 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:02.928222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a4d8a7e-8ac8-4dd4-ad01-80e51ac7de03 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:03.045908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e133b81-7db9-48f0-b717-5c0be0daf2c9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:03.053526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e133b81-7db9-48f0-b717-5c0be0daf2c9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.257677 Apr 11 19:49:03.054119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 96/179] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:02 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:03.140220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a4d8a7e-8ac8-4dd4-ad01-80e51ac7de03 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:03.154442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a4d8a7e-8ac8-4dd4-ad01-80e51ac7de03 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1319 microversion: 2.1 time: 0.252079 Apr 11 19:49:03.163142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04cf4506-8afc-4065-9b11-40899b36487c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:03.163780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04cf4506-8afc-4065-9b11-40899b36487c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:03.172583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 84/180] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:02 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:03.177380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04cf4506-8afc-4065-9b11-40899b36487c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:03.177823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04cf4506-8afc-4065-9b11-40899b36487c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:03.178627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04cf4506-8afc-4065-9b11-40899b36487c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:03.179060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04cf4506-8afc-4065-9b11-40899b36487c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:03.207825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-1ea80e38-1dbb-4345-9660-44503f007522 req-7fad4b1e-a5b6-49d1-9639-a6e3b63ec69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a38f63-7c71-4371-a3b7-92ccd91b0609", "name": "network-vif-deleted", "tag": "c93e43c5-0788-44e4-9a0c-3ca9bdd1a2ce"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:03.218115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-1ea80e38-1dbb-4345-9660-44503f007522 req-7fad4b1e-a5b6-49d1-9639-a6e3b63ec69b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:03.218677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-1ea80e38-1dbb-4345-9660-44503f007522 req-7fad4b1e-a5b6-49d1-9639-a6e3b63ec69b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:03.238586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-1ea80e38-1dbb-4345-9660-44503f007522 req-7fad4b1e-a5b6-49d1-9639-a6e3b63ec69b service nova] Creating event network-vif-deleted:c93e43c5-0788-44e4-9a0c-3ca9bdd1a2ce for instance e3a38f63-7c71-4371-a3b7-92ccd91b0609 on hv-cinder-83078 Apr 11 19:49:03.245709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-1ea80e38-1dbb-4345-9660-44503f007522 req-7fad4b1e-a5b6-49d1-9639-a6e3b63ec69b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040968 Apr 11 19:49:03.246357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 85/181] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:49:03.259095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-ce66005a-32b7-49d8-ad81-5112986d6ef8 req-9305c78e-3a01-40cc-b0d0-f93435631eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58fd1a5-0f59-4337-85ac-8d9f2969aeb4", "name": "network-vif-plugged", "status": "completed", "tag": "8831ee5a-2f6b-4fe4-8f04-3e143842ecf0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:03.305074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ce66005a-32b7-49d8-ad81-5112986d6ef8 req-9305c78e-3a01-40cc-b0d0-f93435631eca service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:03.305527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ce66005a-32b7-49d8-ad81-5112986d6ef8 req-9305c78e-3a01-40cc-b0d0-f93435631eca service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:03.335239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04cf4506-8afc-4065-9b11-40899b36487c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:03.342538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-ce66005a-32b7-49d8-ad81-5112986d6ef8 req-9305c78e-3a01-40cc-b0d0-f93435631eca service nova] Creating event network-vif-plugged:8831ee5a-2f6b-4fe4-8f04-3e143842ecf0 for instance a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 on hv-cinder-83078 Apr 11 19:49:03.343132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04cf4506-8afc-4065-9b11-40899b36487c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 200 len: 1463 microversion: 2.1 time: 0.184213 Apr 11 19:49:03.343725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 97/182] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:03 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 1463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:03.352233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-ce66005a-32b7-49d8-ad81-5112986d6ef8 req-9305c78e-3a01-40cc-b0d0-f93435631eca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100885 Apr 11 19:49:03.355765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 86/183] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:04.070402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec67db14-ac72-40da-9d78-b430bce2dd73 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:04.071198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec67db14-ac72-40da-9d78-b430bce2dd73 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:04.078352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec67db14-ac72-40da-9d78-b430bce2dd73 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:04.078794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec67db14-ac72-40da-9d78-b430bce2dd73 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:04.080241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec67db14-ac72-40da-9d78-b430bce2dd73 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:04.081145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec67db14-ac72-40da-9d78-b430bce2dd73 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:04.179173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f52531ba-35d8-4570-9274-c35d31db2ce5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:04.180505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f52531ba-35d8-4570-9274-c35d31db2ce5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:04.187690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52531ba-35d8-4570-9274-c35d31db2ce5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:04.188125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52531ba-35d8-4570-9274-c35d31db2ce5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:04.188888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52531ba-35d8-4570-9274-c35d31db2ce5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:04.189574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52531ba-35d8-4570-9274-c35d31db2ce5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:04.228373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ec67db14-ac72-40da-9d78-b430bce2dd73 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:04.237023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec67db14-ac72-40da-9d78-b430bce2dd73 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.170578 Apr 11 19:49:04.237733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 98/184] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:04 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:04.343388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f52531ba-35d8-4570-9274-c35d31db2ce5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:04.350721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f52531ba-35d8-4570-9274-c35d31db2ce5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1319 microversion: 2.1 time: 0.176096 Apr 11 19:49:04.361060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 87/185] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:04 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:04.363800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:04.364405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: e3a38f63-7c71-4371-a3b7-92ccd91b0609] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:04.370447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:04.370873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:04.371713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:04.372075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:04.385758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] HTTP exception thrown: Instance e3a38f63-7c71-4371-a3b7-92ccd91b0609 could not be found. Apr 11 19:49:04.386461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Returning 404 to user: Instance e3a38f63-7c71-4371-a3b7-92ccd91b0609 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:49:04.387279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2416cb84-4ad7-4e9c-a7ea-d993d4f75b86 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609" status: 404 len: 111 microversion: 2.1 time: 0.027477 Apr 11 19:49:04.387881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 99/186] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:04 2022] GET /compute/v2.1/servers/e3a38f63-7c71-4371-a3b7-92ccd91b0609 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:49:04.501934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-775685442", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "networks": [{"uuid": "eecf317c-0082-46e6-b978-6412201514db"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:04.571240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] validate_networks() for [('eecf317c-0082-46e6-b978-6412201514db', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:49:04.958497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:49:04.958980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:49:04.959511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:49:04.959983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:49:04.960454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:49:04.973011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:04.973524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:04.974379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:04.974821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:04.992103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Getting quotas for project 96adb977ddc74b588e3cdefe024cf6c2. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:49:04.996088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Getting quotas for user 29485f7ab35d4ad08a4001a005de4a71 and project 96adb977ddc74b588e3cdefe024cf6c2. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:49:05.007374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:49:05.009755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:49:05.060408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-117bdeb9-0c3e-4a72-90b4-f635495d44b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562565 Apr 11 19:49:05.061289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 88/187] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:49:05.072570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a236833-bce0-4c44-aae4-9ced94d714c0 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:05.073300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a236833-bce0-4c44-aae4-9ced94d714c0 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:05.148081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a236833-bce0-4c44-aae4-9ced94d714c0 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:05.157808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a236833-bce0-4c44-aae4-9ced94d714c0 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1213 microversion: 2.1 time: 0.090369 Apr 11 19:49:05.158589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 100/188] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:05 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:05.256070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-044594df-b324-446f-8401-5810af669098 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:05.256715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-044594df-b324-446f-8401-5810af669098 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:05.267141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-044594df-b324-446f-8401-5810af669098 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:05.267583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-044594df-b324-446f-8401-5810af669098 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:05.271302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-044594df-b324-446f-8401-5810af669098 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:05.271722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-044594df-b324-446f-8401-5810af669098 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:05.373000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ca4c68d-4b69-40e7-979a-968143dfb2bb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:05.373789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ca4c68d-4b69-40e7-979a-968143dfb2bb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:05.386587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ca4c68d-4b69-40e7-979a-968143dfb2bb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:05.386587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ca4c68d-4b69-40e7-979a-968143dfb2bb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:05.388772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ca4c68d-4b69-40e7-979a-968143dfb2bb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:05.391111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ca4c68d-4b69-40e7-979a-968143dfb2bb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:05.479878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-044594df-b324-446f-8401-5810af669098 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:05.487548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-044594df-b324-446f-8401-5810af669098 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.236830 Apr 11 19:49:05.488502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 89/189] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:05 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:05.593232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ca4c68d-4b69-40e7-979a-968143dfb2bb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:05.613651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ca4c68d-4b69-40e7-979a-968143dfb2bb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1319 microversion: 2.1 time: 0.245341 Apr 11 19:49:05.614437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 101/190] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:05 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:06.174986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-abb7d438-cf71-4097-8685-5139174cb675 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:06.175609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-abb7d438-cf71-4097-8685-5139174cb675 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:06.182133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abb7d438-cf71-4097-8685-5139174cb675 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:06.182578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abb7d438-cf71-4097-8685-5139174cb675 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:06.183351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abb7d438-cf71-4097-8685-5139174cb675 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:06.183787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abb7d438-cf71-4097-8685-5139174cb675 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:06.251249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-abb7d438-cf71-4097-8685-5139174cb675 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:06.263294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-abb7d438-cf71-4097-8685-5139174cb675 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1265 microversion: 2.1 time: 0.091607 Apr 11 19:49:06.263294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 90/191] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:06 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:06.505674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1bf0756-17a3-416f-8345-d8954b669269 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:06.506952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1bf0756-17a3-416f-8345-d8954b669269 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:06.518191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1bf0756-17a3-416f-8345-d8954b669269 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:06.518647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1bf0756-17a3-416f-8345-d8954b669269 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:06.520965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1bf0756-17a3-416f-8345-d8954b669269 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:06.522228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1bf0756-17a3-416f-8345-d8954b669269 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:06.632181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90786947-75e1-4af5-96e3-1c549bba1442 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:06.633167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90786947-75e1-4af5-96e3-1c549bba1442 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:06.639148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90786947-75e1-4af5-96e3-1c549bba1442 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:06.645378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90786947-75e1-4af5-96e3-1c549bba1442 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:06.646399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90786947-75e1-4af5-96e3-1c549bba1442 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:06.648297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90786947-75e1-4af5-96e3-1c549bba1442 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:06.689963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1bf0756-17a3-416f-8345-d8954b669269 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:06.705120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1bf0756-17a3-416f-8345-d8954b669269 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.202825 Apr 11 19:49:06.706727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 102/192] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:06 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:06.865592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90786947-75e1-4af5-96e3-1c549bba1442 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:06.874908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90786947-75e1-4af5-96e3-1c549bba1442 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1507 microversion: 2.1 time: 0.247030 Apr 11 19:49:06.875815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 91/193] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:06 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:07.283734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c84ae68a-6b92-44e0-90e2-5943323ce20c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:07.284343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c84ae68a-6b92-44e0-90e2-5943323ce20c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:07.291894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c84ae68a-6b92-44e0-90e2-5943323ce20c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:07.292464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c84ae68a-6b92-44e0-90e2-5943323ce20c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:07.293323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c84ae68a-6b92-44e0-90e2-5943323ce20c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:07.293761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c84ae68a-6b92-44e0-90e2-5943323ce20c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:07.499223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c84ae68a-6b92-44e0-90e2-5943323ce20c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:07.516279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c84ae68a-6b92-44e0-90e2-5943323ce20c tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1313 microversion: 2.1 time: 0.233487 Apr 11 19:49:07.527293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 103/194] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:07 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:07.724044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7428dc0b-4e93-4c3e-9802-1d8b37c13df8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:07.725315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7428dc0b-4e93-4c3e-9802-1d8b37c13df8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:07.732552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7428dc0b-4e93-4c3e-9802-1d8b37c13df8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:07.733976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7428dc0b-4e93-4c3e-9802-1d8b37c13df8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:07.735253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7428dc0b-4e93-4c3e-9802-1d8b37c13df8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:07.735852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7428dc0b-4e93-4c3e-9802-1d8b37c13df8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:07.951473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7428dc0b-4e93-4c3e-9802-1d8b37c13df8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:07.967345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7428dc0b-4e93-4c3e-9802-1d8b37c13df8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.244929 Apr 11 19:49:07.968205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 92/195] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:07 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:08.007007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-03f20595-9b23-40eb-95ca-06e89e6f9d4b req-eb86334c-b59a-4a64-bffd-ffee46f1326c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2400020-3100-4902-b384-e27512f51b19", "tag": "37835328-d128-4abc-ab05-62f473e4ba7b"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:08.036454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-03f20595-9b23-40eb-95ca-06e89e6f9d4b req-eb86334c-b59a-4a64-bffd-ffee46f1326c service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:08.037498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-03f20595-9b23-40eb-95ca-06e89e6f9d4b req-eb86334c-b59a-4a64-bffd-ffee46f1326c service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:08.072357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-03f20595-9b23-40eb-95ca-06e89e6f9d4b req-eb86334c-b59a-4a64-bffd-ffee46f1326c service nova] Creating event network-changed:37835328-d128-4abc-ab05-62f473e4ba7b for instance b2400020-3100-4902-b384-e27512f51b19 on hv-cinder-83078 Apr 11 19:49:08.093444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-03f20595-9b23-40eb-95ca-06e89e6f9d4b req-eb86334c-b59a-4a64-bffd-ffee46f1326c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081599 Apr 11 19:49:08.094171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 104/196] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:49:08.535815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7bf4b27f-e21b-4372-9604-ad927c2f5ca3 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:08.536811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7bf4b27f-e21b-4372-9604-ad927c2f5ca3 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:08.546702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf4b27f-e21b-4372-9604-ad927c2f5ca3 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:08.547910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf4b27f-e21b-4372-9604-ad927c2f5ca3 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:08.549771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf4b27f-e21b-4372-9604-ad927c2f5ca3 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:08.550488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf4b27f-e21b-4372-9604-ad927c2f5ca3 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:08.712732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7bf4b27f-e21b-4372-9604-ad927c2f5ca3 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:08.723230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7bf4b27f-e21b-4372-9604-ad927c2f5ca3 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1313 microversion: 2.1 time: 0.190555 Apr 11 19:49:08.723230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 93/197] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:08 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:08.985962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1aa41e11-8a21-47f7-ac43-3c6016352ad2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:08.986645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1aa41e11-8a21-47f7-ac43-3c6016352ad2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:08.994906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aa41e11-8a21-47f7-ac43-3c6016352ad2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:08.996526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aa41e11-8a21-47f7-ac43-3c6016352ad2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:08.998454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aa41e11-8a21-47f7-ac43-3c6016352ad2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:08.999990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aa41e11-8a21-47f7-ac43-3c6016352ad2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:09.141094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1aa41e11-8a21-47f7-ac43-3c6016352ad2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:09.150897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1aa41e11-8a21-47f7-ac43-3c6016352ad2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.169460 Apr 11 19:49:09.151491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 105/198] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:08 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:09.739514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c103477f-e015-4ece-9433-999399eb1168 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:09.740715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c103477f-e015-4ece-9433-999399eb1168 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:09.750259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c103477f-e015-4ece-9433-999399eb1168 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:09.751006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c103477f-e015-4ece-9433-999399eb1168 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:09.751945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c103477f-e015-4ece-9433-999399eb1168 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:09.752594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c103477f-e015-4ece-9433-999399eb1168 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:09.960749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c103477f-e015-4ece-9433-999399eb1168 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:09.969265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c103477f-e015-4ece-9433-999399eb1168 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1313 microversion: 2.1 time: 0.234222 Apr 11 19:49:09.970216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 94/199] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:09 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:10.167689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7581570f-65af-4a9f-a36b-070ac7f3703b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:10.168365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7581570f-65af-4a9f-a36b-070ac7f3703b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:10.192127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7581570f-65af-4a9f-a36b-070ac7f3703b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:10.193160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7581570f-65af-4a9f-a36b-070ac7f3703b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:10.194155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7581570f-65af-4a9f-a36b-070ac7f3703b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:10.194740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7581570f-65af-4a9f-a36b-070ac7f3703b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:10.560235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7581570f-65af-4a9f-a36b-070ac7f3703b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:10.568367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7581570f-65af-4a9f-a36b-070ac7f3703b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.404552 Apr 11 19:49:10.569786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 106/200] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:10 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:10.987495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e500612-0e8b-4da2-969c-1dac92b14de9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:10.988804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e500612-0e8b-4da2-969c-1dac92b14de9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:10.995689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e500612-0e8b-4da2-969c-1dac92b14de9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:10.996557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e500612-0e8b-4da2-969c-1dac92b14de9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:10.997485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e500612-0e8b-4da2-969c-1dac92b14de9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:10.998023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e500612-0e8b-4da2-969c-1dac92b14de9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:11.181428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e500612-0e8b-4da2-969c-1dac92b14de9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:11.193135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e500612-0e8b-4da2-969c-1dac92b14de9 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1313 microversion: 2.1 time: 0.209577 Apr 11 19:49:11.200424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 95/201] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:10 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:11.589816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94ac97bb-b730-4ddc-83fa-3f5f87dcc8c3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:11.590435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94ac97bb-b730-4ddc-83fa-3f5f87dcc8c3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:11.596862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94ac97bb-b730-4ddc-83fa-3f5f87dcc8c3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:11.597690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94ac97bb-b730-4ddc-83fa-3f5f87dcc8c3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:11.603527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94ac97bb-b730-4ddc-83fa-3f5f87dcc8c3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:11.603527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94ac97bb-b730-4ddc-83fa-3f5f87dcc8c3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:11.830491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94ac97bb-b730-4ddc-83fa-3f5f87dcc8c3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:11.841481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94ac97bb-b730-4ddc-83fa-3f5f87dcc8c3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.259226 Apr 11 19:49:11.852666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 107/202] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:11 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:12.215338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c68f0d2-dd31-49cc-b662-0a79724b0012 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:12.216224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c68f0d2-dd31-49cc-b662-0a79724b0012 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:12.227146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c68f0d2-dd31-49cc-b662-0a79724b0012 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:12.227924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c68f0d2-dd31-49cc-b662-0a79724b0012 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:12.229315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c68f0d2-dd31-49cc-b662-0a79724b0012 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:12.230080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c68f0d2-dd31-49cc-b662-0a79724b0012 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:12.450374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4c68f0d2-dd31-49cc-b662-0a79724b0012 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:12.458357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c68f0d2-dd31-49cc-b662-0a79724b0012 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1313 microversion: 2.1 time: 0.251676 Apr 11 19:49:12.459122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 96/203] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:12 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:12.859148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ddff0a4-7b57-491a-8bfd-44c918d37411 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:12.860482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ddff0a4-7b57-491a-8bfd-44c918d37411 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:12.867719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ddff0a4-7b57-491a-8bfd-44c918d37411 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:12.868264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ddff0a4-7b57-491a-8bfd-44c918d37411 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:12.870068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ddff0a4-7b57-491a-8bfd-44c918d37411 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:12.871002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ddff0a4-7b57-491a-8bfd-44c918d37411 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:13.036204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ddff0a4-7b57-491a-8bfd-44c918d37411 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:13.045912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ddff0a4-7b57-491a-8bfd-44c918d37411 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.190548 Apr 11 19:49:13.055828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 108/204] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:12 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:13.177373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-62b35aa0-899b-4468-8662-2cfd117846f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:13.177373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-62b35aa0-899b-4468-8662-2cfd117846f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:13.181451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62b35aa0-899b-4468-8662-2cfd117846f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:13.182264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62b35aa0-899b-4468-8662-2cfd117846f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:13.183298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62b35aa0-899b-4468-8662-2cfd117846f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:13.183992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62b35aa0-899b-4468-8662-2cfd117846f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:13.185414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-41d297f3-e4a8-4073-86fb-6a88d802f2c6 req-d4bd3433-74a9-4303-83cb-6311eeeb14f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2400020-3100-4902-b384-e27512f51b19", "name": "network-vif-plugged", "status": "completed", "tag": "37835328-d128-4abc-ab05-62f473e4ba7b"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:13.199551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-41d297f3-e4a8-4073-86fb-6a88d802f2c6 req-d4bd3433-74a9-4303-83cb-6311eeeb14f2 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:13.200453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-41d297f3-e4a8-4073-86fb-6a88d802f2c6 req-d4bd3433-74a9-4303-83cb-6311eeeb14f2 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:13.215773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-62b35aa0-899b-4468-8662-2cfd117846f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/ips" status: 200 len: 151 microversion: 2.1 time: 0.045432 Apr 11 19:49:13.216381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 97/205] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 19:49:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:13.220826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-41d297f3-e4a8-4073-86fb-6a88d802f2c6 req-d4bd3433-74a9-4303-83cb-6311eeeb14f2 service nova] Creating event network-vif-plugged:37835328-d128-4abc-ab05-62f473e4ba7b for instance b2400020-3100-4902-b384-e27512f51b19 on hv-cinder-83078 Apr 11 19:49:13.228193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-41d297f3-e4a8-4073-86fb-6a88d802f2c6 req-d4bd3433-74a9-4303-83cb-6311eeeb14f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047414 Apr 11 19:49:13.229390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 109/206] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:13.477993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5f6b503-917c-4b7d-8710-edb9d7d3c10b tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:13.479744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5f6b503-917c-4b7d-8710-edb9d7d3c10b tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:13.489552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5f6b503-917c-4b7d-8710-edb9d7d3c10b tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:13.490839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5f6b503-917c-4b7d-8710-edb9d7d3c10b tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:13.492503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5f6b503-917c-4b7d-8710-edb9d7d3c10b tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:13.493631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5f6b503-917c-4b7d-8710-edb9d7d3c10b tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:13.747312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5f6b503-917c-4b7d-8710-edb9d7d3c10b tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:13.755810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5f6b503-917c-4b7d-8710-edb9d7d3c10b tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1313 microversion: 2.1 time: 0.283133 Apr 11 19:49:13.756400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 98/207] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:13 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:14.066297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1193586c-32c3-4d92-995a-d254696d69be tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:14.067250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1193586c-32c3-4d92-995a-d254696d69be tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:14.074076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1193586c-32c3-4d92-995a-d254696d69be tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:14.074794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1193586c-32c3-4d92-995a-d254696d69be tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:14.075599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1193586c-32c3-4d92-995a-d254696d69be tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:14.076033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1193586c-32c3-4d92-995a-d254696d69be tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:14.338279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1193586c-32c3-4d92-995a-d254696d69be tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:14.346134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1193586c-32c3-4d92-995a-d254696d69be tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.285014 Apr 11 19:49:14.346674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 110/208] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:14 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:14.774475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90fa96f3-a1e9-4e70-869c-9aa20e330e35 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:14.775724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90fa96f3-a1e9-4e70-869c-9aa20e330e35 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:14.784854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90fa96f3-a1e9-4e70-869c-9aa20e330e35 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:14.785503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90fa96f3-a1e9-4e70-869c-9aa20e330e35 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:14.786685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90fa96f3-a1e9-4e70-869c-9aa20e330e35 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:14.787308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90fa96f3-a1e9-4e70-869c-9aa20e330e35 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:14.857002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f037adbc-1c8b-4895-83ba-7a2c0399a07f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cf1a015-a355-46ae-a828-097410192a8a"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:14.858559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f037adbc-1c8b-4895-83ba-7a2c0399a07f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:14.865861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f037adbc-1c8b-4895-83ba-7a2c0399a07f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:14.866626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f037adbc-1c8b-4895-83ba-7a2c0399a07f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:14.868328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f037adbc-1c8b-4895-83ba-7a2c0399a07f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:14.868959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f037adbc-1c8b-4895-83ba-7a2c0399a07f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:15.187698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90fa96f3-a1e9-4e70-869c-9aa20e330e35 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:15.196225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90fa96f3-a1e9-4e70-869c-9aa20e330e35 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1313 microversion: 2.1 time: 0.426925 Apr 11 19:49:15.196792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 99/209] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:14 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:15.367327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56e3f957-30bb-4fa6-a38c-d0b3e29c41a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:15.368290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56e3f957-30bb-4fa6-a38c-d0b3e29c41a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:15.375435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56e3f957-30bb-4fa6-a38c-d0b3e29c41a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:15.375885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56e3f957-30bb-4fa6-a38c-d0b3e29c41a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:15.376713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56e3f957-30bb-4fa6-a38c-d0b3e29c41a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:15.377180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56e3f957-30bb-4fa6-a38c-d0b3e29c41a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:15.556380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56e3f957-30bb-4fa6-a38c-d0b3e29c41a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:15.564508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56e3f957-30bb-4fa6-a38c-d0b3e29c41a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.204174 Apr 11 19:49:15.574335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 100/210] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:15 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:16.050002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f037adbc-1c8b-4895-83ba-7a2c0399a07f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.199595 Apr 11 19:49:16.055758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 111/211] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 19:49:14 2022] POST /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 194 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:49:16.221010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53af2731-ab4c-4583-9f09-2651e2006643 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:16.224125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53af2731-ab4c-4583-9f09-2651e2006643 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:16.238836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53af2731-ab4c-4583-9f09-2651e2006643 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:16.239787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53af2731-ab4c-4583-9f09-2651e2006643 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:16.240841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53af2731-ab4c-4583-9f09-2651e2006643 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:16.241628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53af2731-ab4c-4583-9f09-2651e2006643 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:16.467739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-53af2731-ab4c-4583-9f09-2651e2006643 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:16.476378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53af2731-ab4c-4583-9f09-2651e2006643 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1498 microversion: 2.1 time: 0.265682 Apr 11 19:49:16.501771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 101/212] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:16 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1498 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:16.586416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81804307-b186-4562-b859-11da6cebc9c5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:16.587184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81804307-b186-4562-b859-11da6cebc9c5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:16.600046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81804307-b186-4562-b859-11da6cebc9c5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:16.600577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81804307-b186-4562-b859-11da6cebc9c5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:16.601491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81804307-b186-4562-b859-11da6cebc9c5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:16.601986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81804307-b186-4562-b859-11da6cebc9c5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:16.768472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-81804307-b186-4562-b859-11da6cebc9c5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:16.776495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81804307-b186-4562-b859-11da6cebc9c5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.196700 Apr 11 19:49:16.777111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 112/213] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:16 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:17.796052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0185202a-a3dd-46a7-9655-ed48a12b3c99 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:17.796669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0185202a-a3dd-46a7-9655-ed48a12b3c99 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:17.803551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0185202a-a3dd-46a7-9655-ed48a12b3c99 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:17.804236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0185202a-a3dd-46a7-9655-ed48a12b3c99 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:17.805200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0185202a-a3dd-46a7-9655-ed48a12b3c99 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:17.805804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0185202a-a3dd-46a7-9655-ed48a12b3c99 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:18.003689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0185202a-a3dd-46a7-9655-ed48a12b3c99 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:18.018516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0185202a-a3dd-46a7-9655-ed48a12b3c99 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.224997 Apr 11 19:49:18.019794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 102/214] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:17 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:19.037274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8c97add-4407-413c-bf00-ec810362274c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:19.038985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8c97add-4407-413c-bf00-ec810362274c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:19.046250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8c97add-4407-413c-bf00-ec810362274c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:19.046939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8c97add-4407-413c-bf00-ec810362274c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:19.047722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8c97add-4407-413c-bf00-ec810362274c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:19.048180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8c97add-4407-413c-bf00-ec810362274c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:19.215220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8c97add-4407-413c-bf00-ec810362274c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:19.233980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8c97add-4407-413c-bf00-ec810362274c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.201319 Apr 11 19:49:19.235146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 113/215] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:19 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:19.715017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6498b38-82aa-4590-a4ab-bfa5b593a93f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:19.717044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6498b38-82aa-4590-a4ab-bfa5b593a93f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:19.723960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6498b38-82aa-4590-a4ab-bfa5b593a93f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:19.724413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6498b38-82aa-4590-a4ab-bfa5b593a93f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:19.725205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6498b38-82aa-4590-a4ab-bfa5b593a93f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:19.725807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6498b38-82aa-4590-a4ab-bfa5b593a93f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:19.756190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6498b38-82aa-4590-a4ab-bfa5b593a93f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 19:49:19.847825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6498b38-82aa-4590-a4ab-bfa5b593a93f tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 204 len: 0 microversion: 2.1 time: 0.136950 Apr 11 19:49:19.849042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 103/216] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 19:49:19 2022] DELETE /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:49:19.858992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a161f56c-8640-4c26-9340-4c41082d1372 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:19.858992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a161f56c-8640-4c26-9340-4c41082d1372 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:19.864224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a161f56c-8640-4c26-9340-4c41082d1372 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:19.864741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a161f56c-8640-4c26-9340-4c41082d1372 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:19.865590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a161f56c-8640-4c26-9340-4c41082d1372 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:19.866209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a161f56c-8640-4c26-9340-4c41082d1372 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:20.095872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a161f56c-8640-4c26-9340-4c41082d1372 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:20.107998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a161f56c-8640-4c26-9340-4c41082d1372 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1504 microversion: 2.1 time: 0.254519 Apr 11 19:49:20.109533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 114/217] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:19 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:20.259337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b45a03d-5d24-46dd-9e9b-257f5a24edf0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:20.260817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b45a03d-5d24-46dd-9e9b-257f5a24edf0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:20.271625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b45a03d-5d24-46dd-9e9b-257f5a24edf0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:20.272246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b45a03d-5d24-46dd-9e9b-257f5a24edf0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:20.273227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b45a03d-5d24-46dd-9e9b-257f5a24edf0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:20.274177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b45a03d-5d24-46dd-9e9b-257f5a24edf0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:20.556161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b45a03d-5d24-46dd-9e9b-257f5a24edf0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:20.569450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b45a03d-5d24-46dd-9e9b-257f5a24edf0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.321079 Apr 11 19:49:20.570586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 104/218] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:20 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:21.127090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0598b66b-529c-44a7-8227-27a7c2f46bce tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:21.127830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0598b66b-529c-44a7-8227-27a7c2f46bce tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:21.134571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0598b66b-529c-44a7-8227-27a7c2f46bce tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:21.135354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0598b66b-529c-44a7-8227-27a7c2f46bce tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:21.136301 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0598b66b-529c-44a7-8227-27a7c2f46bce tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:21.136893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0598b66b-529c-44a7-8227-27a7c2f46bce tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:21.306781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0598b66b-529c-44a7-8227-27a7c2f46bce tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:21.315374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0598b66b-529c-44a7-8227-27a7c2f46bce tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1504 microversion: 2.1 time: 0.192698 Apr 11 19:49:21.316097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 115/219] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:21 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:21.590964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f429d892-8660-4401-ab3e-a2bef42e1b7b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:21.592010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f429d892-8660-4401-ab3e-a2bef42e1b7b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:21.610991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f429d892-8660-4401-ab3e-a2bef42e1b7b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:21.612112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f429d892-8660-4401-ab3e-a2bef42e1b7b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:21.613774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f429d892-8660-4401-ab3e-a2bef42e1b7b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:21.614751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f429d892-8660-4401-ab3e-a2bef42e1b7b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:21.835355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f429d892-8660-4401-ab3e-a2bef42e1b7b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:21.844425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f429d892-8660-4401-ab3e-a2bef42e1b7b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.260912 Apr 11 19:49:21.845791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 105/220] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:21 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:22.347187 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-97fdc399-5c48-46d5-90c4-84ad685ee6b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:22.354767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-97fdc399-5c48-46d5-90c4-84ad685ee6b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:22.418613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97fdc399-5c48-46d5-90c4-84ad685ee6b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:22.421051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97fdc399-5c48-46d5-90c4-84ad685ee6b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:22.423393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97fdc399-5c48-46d5-90c4-84ad685ee6b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:22.423995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97fdc399-5c48-46d5-90c4-84ad685ee6b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:22.720030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97fdc399-5c48-46d5-90c4-84ad685ee6b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:22.730239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-97fdc399-5c48-46d5-90c4-84ad685ee6b7 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1504 microversion: 2.1 time: 0.392003 Apr 11 19:49:22.741420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 116/221] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:22 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:22.863739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-451f2029-6ea0-49d9-8704-4a2bc4ed63a1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:22.865056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-451f2029-6ea0-49d9-8704-4a2bc4ed63a1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:22.873362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-451f2029-6ea0-49d9-8704-4a2bc4ed63a1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:22.878463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-451f2029-6ea0-49d9-8704-4a2bc4ed63a1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:22.880267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-451f2029-6ea0-49d9-8704-4a2bc4ed63a1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:22.881116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-451f2029-6ea0-49d9-8704-4a2bc4ed63a1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:23.111473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-451f2029-6ea0-49d9-8704-4a2bc4ed63a1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:23.121490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-451f2029-6ea0-49d9-8704-4a2bc4ed63a1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.262290 Apr 11 19:49:23.122586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 106/222] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:22 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:23.750569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81b60130-d28b-4288-8d7b-904df0a6cebf tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:23.752708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81b60130-d28b-4288-8d7b-904df0a6cebf tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:23.781361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81b60130-d28b-4288-8d7b-904df0a6cebf tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:23.781976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81b60130-d28b-4288-8d7b-904df0a6cebf tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:23.782942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81b60130-d28b-4288-8d7b-904df0a6cebf tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:23.783593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81b60130-d28b-4288-8d7b-904df0a6cebf tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:24.095199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-81b60130-d28b-4288-8d7b-904df0a6cebf tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:24.139167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aa8001e9-a6cf-4e93-8ab4-c5f8db513bb5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:24.139983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aa8001e9-a6cf-4e93-8ab4-c5f8db513bb5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:24.141087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81b60130-d28b-4288-8d7b-904df0a6cebf tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1504 microversion: 2.1 time: 0.394383 Apr 11 19:49:24.143514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 117/223] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:23 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:24.167491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa8001e9-a6cf-4e93-8ab4-c5f8db513bb5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:24.168689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa8001e9-a6cf-4e93-8ab4-c5f8db513bb5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:24.169765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa8001e9-a6cf-4e93-8ab4-c5f8db513bb5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:24.171023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa8001e9-a6cf-4e93-8ab4-c5f8db513bb5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:24.544991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aa8001e9-a6cf-4e93-8ab4-c5f8db513bb5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:24.562841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aa8001e9-a6cf-4e93-8ab4-c5f8db513bb5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1521 microversion: 2.1 time: 0.427482 Apr 11 19:49:24.563694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 107/224] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:24 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:24.810805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-0a2b60f7-2da1-4655-90e6-7bbcab5526e3 req-a81d5930-d982-470a-bc59-9505f3443356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2400020-3100-4902-b384-e27512f51b19", "name": "network-vif-deleted", "tag": "37835328-d128-4abc-ab05-62f473e4ba7b"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:24.833991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-0a2b60f7-2da1-4655-90e6-7bbcab5526e3 req-a81d5930-d982-470a-bc59-9505f3443356 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:24.834534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-0a2b60f7-2da1-4655-90e6-7bbcab5526e3 req-a81d5930-d982-470a-bc59-9505f3443356 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:24.856650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-0a2b60f7-2da1-4655-90e6-7bbcab5526e3 req-a81d5930-d982-470a-bc59-9505f3443356 service nova] Creating event network-vif-deleted:37835328-d128-4abc-ab05-62f473e4ba7b for instance b2400020-3100-4902-b384-e27512f51b19 on hv-cinder-83078 Apr 11 19:49:24.863422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-0a2b60f7-2da1-4655-90e6-7bbcab5526e3 req-a81d5930-d982-470a-bc59-9505f3443356 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065088 Apr 11 19:49:24.866243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 118/225] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:25.159743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:25.160395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:25.168176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:25.168626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:25.169547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:25.169982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:25.249259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:25.250053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:25.250500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lazy-loading 'fault' on Instance uuid b2400020-3100-4902-b384-e27512f51b19 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:49:25.339895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29485f7ab35d4ad08a4001a005de4a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96adb977ddc74b588e3cdefe024cf6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:25.354262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-321446cd-2106-495e-91d6-d4d22759b087 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 200 len: 1303 microversion: 2.1 time: 0.198431 Apr 11 19:49:25.354777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 108/226] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:25 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:25.598828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1afce24c-7f77-4ac7-8757-8001b53b28b1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:25.599887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1afce24c-7f77-4ac7-8757-8001b53b28b1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:25.607154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1afce24c-7f77-4ac7-8757-8001b53b28b1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:25.608125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1afce24c-7f77-4ac7-8757-8001b53b28b1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:25.609247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1afce24c-7f77-4ac7-8757-8001b53b28b1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:25.609905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1afce24c-7f77-4ac7-8757-8001b53b28b1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:25.837530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1afce24c-7f77-4ac7-8757-8001b53b28b1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:25.857208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1afce24c-7f77-4ac7-8757-8001b53b28b1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1501 microversion: 2.1 time: 0.269072 Apr 11 19:49:25.859876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 119/227] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:25 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:25.892334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-46e7577c-8ee7-4708-923a-cacd49bf6ca2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:25.894135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-46e7577c-8ee7-4708-923a-cacd49bf6ca2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:25.907145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46e7577c-8ee7-4708-923a-cacd49bf6ca2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:25.908106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46e7577c-8ee7-4708-923a-cacd49bf6ca2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:25.909755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46e7577c-8ee7-4708-923a-cacd49bf6ca2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:25.911185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46e7577c-8ee7-4708-923a-cacd49bf6ca2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:26.186406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-46e7577c-8ee7-4708-923a-cacd49bf6ca2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:26.202897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-46e7577c-8ee7-4708-923a-cacd49bf6ca2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1515 microversion: 2.1 time: 0.330255 Apr 11 19:49:26.203571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 109/228] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:25 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:26.372798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:26.373481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] [instance: b2400020-3100-4902-b384-e27512f51b19] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:26.382784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:26.393115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:26.396339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:26.396875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:26.430009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] HTTP exception thrown: Instance b2400020-3100-4902-b384-e27512f51b19 could not be found. Apr 11 19:49:26.430630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] Returning 404 to user: Instance b2400020-3100-4902-b384-e27512f51b19 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:49:26.431700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dd372962-27db-49d7-8fd3-faf071963414 tempest-VolumesActionsTest-1423012100 tempest-VolumesActionsTest-1423012100-project] 10.222.0.62 "GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19" status: 404 len: 111 microversion: 2.1 time: 0.063011 Apr 11 19:49:26.432338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 120/229] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:26 2022] GET /compute/v2.1/servers/b2400020-3100-4902-b384-e27512f51b19 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:49:27.225116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-12051204-2785-4b1a-b72b-ce99c07588d9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: .version_select at 0x7f408c064310>, body: {"keypair": {"name": "tempest-keypair-916147136"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:27.247964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-12051204-2785-4b1a-b72b-ce99c07588d9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:49:27.253745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-12051204-2785-4b1a-b72b-ce99c07588d9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:49:27.417665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-12051204-2785-4b1a-b72b-ce99c07588d9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:49:27.426873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-12051204-2785-4b1a-b72b-ce99c07588d9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:49:27.449646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-12051204-2785-4b1a-b72b-ce99c07588d9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.229141 Apr 11 19:49:27.451057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 110/230] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 19:49:27 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:27.896416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6da929f8-8579-4948-b6ec-be5386a301cc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:27.897495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6da929f8-8579-4948-b6ec-be5386a301cc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:27.904382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6da929f8-8579-4948-b6ec-be5386a301cc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:27.904823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6da929f8-8579-4948-b6ec-be5386a301cc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:27.905642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6da929f8-8579-4948-b6ec-be5386a301cc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:27.906083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6da929f8-8579-4948-b6ec-be5386a301cc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:27.965424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-6da929f8-8579-4948-b6ec-be5386a301cc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lazy-loading 'flavor' on Instance uuid 5e337b2e-3267-4f57-952b-3d398b9ef338 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:49:28.107100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09cfda26-4737-4f5b-ae45-8e91bbc6fb7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13f2ac5e-a51d-4a7a-86aa-2951603084d7", "device": "/dev/sdb"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:28.109058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09cfda26-4737-4f5b-ae45-8e91bbc6fb7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:28.145256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09cfda26-4737-4f5b-ae45-8e91bbc6fb7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:28.145950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09cfda26-4737-4f5b-ae45-8e91bbc6fb7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:28.146755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09cfda26-4737-4f5b-ae45-8e91bbc6fb7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:28.147177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09cfda26-4737-4f5b-ae45-8e91bbc6fb7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:28.154730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6da929f8-8579-4948-b6ec-be5386a301cc tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338/action" status: 200 len: 32 microversion: 2.1 time: 0.262551 Apr 11 19:49:28.155717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 121/231] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 19:49:27 2022] POST /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 19:49:28.165506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-01e1831a-0cb8-4efe-92d5-4c3d7266085d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:28.165824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-01e1831a-0cb8-4efe-92d5-4c3d7266085d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:28.194437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01e1831a-0cb8-4efe-92d5-4c3d7266085d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:28.195641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01e1831a-0cb8-4efe-92d5-4c3d7266085d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:28.197385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01e1831a-0cb8-4efe-92d5-4c3d7266085d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:28.201168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01e1831a-0cb8-4efe-92d5-4c3d7266085d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:28.676238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01e1831a-0cb8-4efe-92d5-4c3d7266085d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:28.695650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-01e1831a-0cb8-4efe-92d5-4c3d7266085d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.534383 Apr 11 19:49:28.705333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 122/232] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:28 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:29.727384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4eb7760b-f2da-4ab8-8cbb-79a4826e94f7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:29.729133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4eb7760b-f2da-4ab8-8cbb-79a4826e94f7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:29.745947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4eb7760b-f2da-4ab8-8cbb-79a4826e94f7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:29.746876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4eb7760b-f2da-4ab8-8cbb-79a4826e94f7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:29.747964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4eb7760b-f2da-4ab8-8cbb-79a4826e94f7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:29.750111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4eb7760b-f2da-4ab8-8cbb-79a4826e94f7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:30.519566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4eb7760b-f2da-4ab8-8cbb-79a4826e94f7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:30.530186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4eb7760b-f2da-4ab8-8cbb-79a4826e94f7 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.812171 Apr 11 19:49:30.532606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 123/233] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:29 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:30.720810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-457636260", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31fd0e52-1286-4398-91da-eeb66b072c42"}], "security_groups": [{"name": "tempest-securitygroup--1724810963"}], "key_name": "tempest-keypair-916147136", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:30.927974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09cfda26-4737-4f5b-ae45-8e91bbc6fb7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "POST /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.824957 Apr 11 19:49:30.930435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 111/234] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 19:49:28 2022] POST /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4/os-volume_attachments => generated 194 bytes in 2828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:49:30.948958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] validate_networks() for [('31fd0e52-1286-4398-91da-eeb66b072c42', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:49:31.480175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:49:31.480732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:49:31.481444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:49:31.482122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:49:31.482392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:49:31.502048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:31.505971 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:31.507008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:31.508035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:31.528141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:49:31.534706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:49:31.548273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:49:31.550596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:49:31.556475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-06376d86-fda6-4c9f-a19f-735151d2b000 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:31.560394 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-06376d86-fda6-4c9f-a19f-735151d2b000 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:31.590744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06376d86-fda6-4c9f-a19f-735151d2b000 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:31.591958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06376d86-fda6-4c9f-a19f-735151d2b000 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:31.596843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06376d86-fda6-4c9f-a19f-735151d2b000 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:31.598084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06376d86-fda6-4c9f-a19f-735151d2b000 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:31.635228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce7ee1c1-adbe-48b9-864a-b0ebcd20820b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.919451 Apr 11 19:49:31.636748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 124/235] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:49:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:49:31.646832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dda109e2-fac2-48f6-87f0-30f591ab4a48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:31.647729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dda109e2-fac2-48f6-87f0-30f591ab4a48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:31.817349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dda109e2-fac2-48f6-87f0-30f591ab4a48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:31.830463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dda109e2-fac2-48f6-87f0-30f591ab4a48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1240 microversion: 2.1 time: 0.184510 Apr 11 19:49:31.831713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 125/236] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:31 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1240 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:31.890455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-06376d86-fda6-4c9f-a19f-735151d2b000 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:31.898636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-06376d86-fda6-4c9f-a19f-735151d2b000 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.351775 Apr 11 19:49:31.899216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 112/237] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:31 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:32.848321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c02bf90c-710c-40bc-91ea-b56f43c8a8f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:32.849042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c02bf90c-710c-40bc-91ea-b56f43c8a8f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:32.860805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c02bf90c-710c-40bc-91ea-b56f43c8a8f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:32.861628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c02bf90c-710c-40bc-91ea-b56f43c8a8f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:32.870369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c02bf90c-710c-40bc-91ea-b56f43c8a8f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:32.871281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c02bf90c-710c-40bc-91ea-b56f43c8a8f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:32.917219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d40cbe45-5701-47cb-b5a3-52194fdd25ce tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:32.918448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d40cbe45-5701-47cb-b5a3-52194fdd25ce tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:32.936265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d40cbe45-5701-47cb-b5a3-52194fdd25ce tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:32.937761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d40cbe45-5701-47cb-b5a3-52194fdd25ce tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:32.942087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d40cbe45-5701-47cb-b5a3-52194fdd25ce tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:32.943279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d40cbe45-5701-47cb-b5a3-52194fdd25ce tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:33.033643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c02bf90c-710c-40bc-91ea-b56f43c8a8f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:33.051853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c02bf90c-710c-40bc-91ea-b56f43c8a8f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1292 microversion: 2.1 time: 0.207285 Apr 11 19:49:33.059290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 126/238] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:32 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1292 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:33.462465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d40cbe45-5701-47cb-b5a3-52194fdd25ce tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:33.471271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d40cbe45-5701-47cb-b5a3-52194fdd25ce tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.558781 Apr 11 19:49:33.471853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 113/239] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:32 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:34.074882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-796c0225-f2c1-4e05-bf19-4d7688ae38ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:34.076227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-796c0225-f2c1-4e05-bf19-4d7688ae38ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:34.089720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-796c0225-f2c1-4e05-bf19-4d7688ae38ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:34.092602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-796c0225-f2c1-4e05-bf19-4d7688ae38ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:34.093794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-796c0225-f2c1-4e05-bf19-4d7688ae38ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:34.094906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-796c0225-f2c1-4e05-bf19-4d7688ae38ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:34.225023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-796c0225-f2c1-4e05-bf19-4d7688ae38ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:34.234551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-796c0225-f2c1-4e05-bf19-4d7688ae38ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1298 microversion: 2.1 time: 0.164656 Apr 11 19:49:34.245367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 127/240] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:34 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1298 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:34.492667 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-80edfd23-6c6f-4c31-962c-b9699f464e3f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:34.493664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-80edfd23-6c6f-4c31-962c-b9699f464e3f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:34.536964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80edfd23-6c6f-4c31-962c-b9699f464e3f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:34.537923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80edfd23-6c6f-4c31-962c-b9699f464e3f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:34.542334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80edfd23-6c6f-4c31-962c-b9699f464e3f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:34.545297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80edfd23-6c6f-4c31-962c-b9699f464e3f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:34.915335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-80edfd23-6c6f-4c31-962c-b9699f464e3f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:34.931667 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-80edfd23-6c6f-4c31-962c-b9699f464e3f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.445700 Apr 11 19:49:34.936591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 114/241] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:34 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:35.253391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a38cc8d7-5262-4962-8d98-6b19127f7e05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:35.254845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a38cc8d7-5262-4962-8d98-6b19127f7e05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:35.266518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a38cc8d7-5262-4962-8d98-6b19127f7e05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:35.267491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a38cc8d7-5262-4962-8d98-6b19127f7e05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:35.269124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a38cc8d7-5262-4962-8d98-6b19127f7e05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:35.269780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a38cc8d7-5262-4962-8d98-6b19127f7e05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:35.576030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a38cc8d7-5262-4962-8d98-6b19127f7e05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:35.586309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a38cc8d7-5262-4962-8d98-6b19127f7e05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.336137 Apr 11 19:49:35.588318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 128/242] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:35 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:35.953983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-54348601-439d-43b2-ace0-9958d821f5f2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:35.955231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-54348601-439d-43b2-ace0-9958d821f5f2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:35.978662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54348601-439d-43b2-ace0-9958d821f5f2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:35.992162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54348601-439d-43b2-ace0-9958d821f5f2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:35.993474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54348601-439d-43b2-ace0-9958d821f5f2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:35.997711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54348601-439d-43b2-ace0-9958d821f5f2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:36.287235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-54348601-439d-43b2-ace0-9958d821f5f2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:36.297864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-54348601-439d-43b2-ace0-9958d821f5f2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.348862 Apr 11 19:49:36.309357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 115/243] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:35 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:36.450015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-8355a49f-eb17-4871-8d36-93fb2a5cfd7d req-40b7ae1a-304c-4c2c-9a5e-8c1cf1779bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99731dc4-4495-4be7-88d0-764f481cab49", "tag": "60530c96-56a5-4c58-a966-719dd5fccd75"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:36.480624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-8355a49f-eb17-4871-8d36-93fb2a5cfd7d req-40b7ae1a-304c-4c2c-9a5e-8c1cf1779bff service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:36.481424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-8355a49f-eb17-4871-8d36-93fb2a5cfd7d req-40b7ae1a-304c-4c2c-9a5e-8c1cf1779bff service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:36.494976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-8355a49f-eb17-4871-8d36-93fb2a5cfd7d req-40b7ae1a-304c-4c2c-9a5e-8c1cf1779bff service nova] Creating event network-changed:60530c96-56a5-4c58-a966-719dd5fccd75 for instance 99731dc4-4495-4be7-88d0-764f481cab49 on hv-cinder-83078 Apr 11 19:49:36.503014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-8355a49f-eb17-4871-8d36-93fb2a5cfd7d req-40b7ae1a-304c-4c2c-9a5e-8c1cf1779bff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056852 Apr 11 19:49:36.504305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 129/244] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:49:36.610294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-816d3515-0d2e-4114-98e1-00b525027889 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:36.611305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-816d3515-0d2e-4114-98e1-00b525027889 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:36.621351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-816d3515-0d2e-4114-98e1-00b525027889 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:36.622160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-816d3515-0d2e-4114-98e1-00b525027889 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:36.623304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-816d3515-0d2e-4114-98e1-00b525027889 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:36.623976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-816d3515-0d2e-4114-98e1-00b525027889 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:36.918175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-816d3515-0d2e-4114-98e1-00b525027889 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:36.927912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-816d3515-0d2e-4114-98e1-00b525027889 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.323326 Apr 11 19:49:36.936936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 116/245] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:36 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:37.319952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-179a3b10-9e79-4ccb-b2c4-136168bd78ab tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:37.320755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-179a3b10-9e79-4ccb-b2c4-136168bd78ab tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:37.341743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-179a3b10-9e79-4ccb-b2c4-136168bd78ab tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:37.342501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-179a3b10-9e79-4ccb-b2c4-136168bd78ab tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:37.343482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-179a3b10-9e79-4ccb-b2c4-136168bd78ab tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:37.344092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-179a3b10-9e79-4ccb-b2c4-136168bd78ab tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:37.605475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-179a3b10-9e79-4ccb-b2c4-136168bd78ab tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:37.617814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-179a3b10-9e79-4ccb-b2c4-136168bd78ab tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.305952 Apr 11 19:49:37.623381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 130/246] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:37 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:37.948395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95a1b71e-4ebf-40cf-9068-6010bf7ea8b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:37.949160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95a1b71e-4ebf-40cf-9068-6010bf7ea8b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:37.974444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95a1b71e-4ebf-40cf-9068-6010bf7ea8b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:37.979300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95a1b71e-4ebf-40cf-9068-6010bf7ea8b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:37.980927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95a1b71e-4ebf-40cf-9068-6010bf7ea8b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:37.983331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95a1b71e-4ebf-40cf-9068-6010bf7ea8b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:38.237052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95a1b71e-4ebf-40cf-9068-6010bf7ea8b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:38.310600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95a1b71e-4ebf-40cf-9068-6010bf7ea8b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.367541 Apr 11 19:49:38.321092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 117/247] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:37 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:38.639006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d414837e-5740-4f62-8bc0-b7bb2e4f7084 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:38.640609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d414837e-5740-4f62-8bc0-b7bb2e4f7084 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:38.662856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d414837e-5740-4f62-8bc0-b7bb2e4f7084 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:38.671424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d414837e-5740-4f62-8bc0-b7bb2e4f7084 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:38.674064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d414837e-5740-4f62-8bc0-b7bb2e4f7084 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:38.674932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d414837e-5740-4f62-8bc0-b7bb2e4f7084 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:38.981187 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d414837e-5740-4f62-8bc0-b7bb2e4f7084 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:38.991516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d414837e-5740-4f62-8bc0-b7bb2e4f7084 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.357818 Apr 11 19:49:38.993686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 131/248] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:38 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:39.327608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-11cc9d97-4d33-4c6b-a201-c07ab89d4e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:39.328210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-11cc9d97-4d33-4c6b-a201-c07ab89d4e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:39.340864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11cc9d97-4d33-4c6b-a201-c07ab89d4e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:39.348139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11cc9d97-4d33-4c6b-a201-c07ab89d4e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:39.352049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11cc9d97-4d33-4c6b-a201-c07ab89d4e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:39.352648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11cc9d97-4d33-4c6b-a201-c07ab89d4e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:39.730278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-11cc9d97-4d33-4c6b-a201-c07ab89d4e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:39.738447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-11cc9d97-4d33-4c6b-a201-c07ab89d4e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.414577 Apr 11 19:49:39.749822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 118/249] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:39 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:40.012314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-507516ed-e10e-4750-bdae-9e29a8fc04ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:40.012988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-507516ed-e10e-4750-bdae-9e29a8fc04ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:40.020537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-507516ed-e10e-4750-bdae-9e29a8fc04ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:40.025849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-507516ed-e10e-4750-bdae-9e29a8fc04ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:40.026917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-507516ed-e10e-4750-bdae-9e29a8fc04ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:40.027507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-507516ed-e10e-4750-bdae-9e29a8fc04ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:40.327359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-507516ed-e10e-4750-bdae-9e29a8fc04ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:40.335162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-507516ed-e10e-4750-bdae-9e29a8fc04ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.326702 Apr 11 19:49:40.336792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 132/250] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:40 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:40.758989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e571c624-926b-4157-acb4-aebb3bbb0204 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:40.759716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e571c624-926b-4157-acb4-aebb3bbb0204 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:40.774656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e571c624-926b-4157-acb4-aebb3bbb0204 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:40.775110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e571c624-926b-4157-acb4-aebb3bbb0204 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:40.776341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e571c624-926b-4157-acb4-aebb3bbb0204 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:40.776777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e571c624-926b-4157-acb4-aebb3bbb0204 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:41.014808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e571c624-926b-4157-acb4-aebb3bbb0204 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:41.028390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e571c624-926b-4157-acb4-aebb3bbb0204 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.275065 Apr 11 19:49:41.028835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 119/251] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:40 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:41.351994 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6afd10be-5b54-4e38-b1ef-c8cfbffaad75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:41.353392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6afd10be-5b54-4e38-b1ef-c8cfbffaad75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:41.359904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afd10be-5b54-4e38-b1ef-c8cfbffaad75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:41.360629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afd10be-5b54-4e38-b1ef-c8cfbffaad75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:41.361594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afd10be-5b54-4e38-b1ef-c8cfbffaad75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:41.362166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afd10be-5b54-4e38-b1ef-c8cfbffaad75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:41.559645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6afd10be-5b54-4e38-b1ef-c8cfbffaad75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:41.567860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6afd10be-5b54-4e38-b1ef-c8cfbffaad75 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.219798 Apr 11 19:49:41.569742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 133/252] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:41 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:42.046156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15f6df7e-ea8c-4d09-89ef-15820a2aa6b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:42.046778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15f6df7e-ea8c-4d09-89ef-15820a2aa6b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:42.063326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f6df7e-ea8c-4d09-89ef-15820a2aa6b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:42.064179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f6df7e-ea8c-4d09-89ef-15820a2aa6b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:42.065191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f6df7e-ea8c-4d09-89ef-15820a2aa6b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:42.066069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f6df7e-ea8c-4d09-89ef-15820a2aa6b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:42.374363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15f6df7e-ea8c-4d09-89ef-15820a2aa6b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:42.384381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15f6df7e-ea8c-4d09-89ef-15820a2aa6b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.342435 Apr 11 19:49:42.388994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 120/253] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:42 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:42.595601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-51ab5ddd-338c-430e-8e6b-4be488f0c1e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:42.596271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-51ab5ddd-338c-430e-8e6b-4be488f0c1e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:42.613215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51ab5ddd-338c-430e-8e6b-4be488f0c1e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:42.613612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51ab5ddd-338c-430e-8e6b-4be488f0c1e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:42.614374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51ab5ddd-338c-430e-8e6b-4be488f0c1e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:42.615007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51ab5ddd-338c-430e-8e6b-4be488f0c1e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:42.883230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-51ab5ddd-338c-430e-8e6b-4be488f0c1e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:42.918776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-51ab5ddd-338c-430e-8e6b-4be488f0c1e1 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.329948 Apr 11 19:49:42.920959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 134/254] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:42 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:43.089061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ac78e06-fe84-4b86-a853-24894ebf5675 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:43.089832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ac78e06-fe84-4b86-a853-24894ebf5675 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:43.096213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ac78e06-fe84-4b86-a853-24894ebf5675 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:43.096648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ac78e06-fe84-4b86-a853-24894ebf5675 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:43.097442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ac78e06-fe84-4b86-a853-24894ebf5675 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:43.098729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ac78e06-fe84-4b86-a853-24894ebf5675 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:43.146913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ac78e06-fe84-4b86-a853-24894ebf5675 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/ips" status: 200 len: 152 microversion: 2.20 time: 0.060801 Apr 11 19:49:43.151299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 121/255] 10.222.0.62 () {60 vars in 1288 bytes} [Mon Apr 11 19:49:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/ips => generated 152 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:49:43.404593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00a475ec-6cc4-4a95-9f13-e8cfaff4f88e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:43.405139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00a475ec-6cc4-4a95-9f13-e8cfaff4f88e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:43.415727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00a475ec-6cc4-4a95-9f13-e8cfaff4f88e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:43.415727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00a475ec-6cc4-4a95-9f13-e8cfaff4f88e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:43.420353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00a475ec-6cc4-4a95-9f13-e8cfaff4f88e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:43.420876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00a475ec-6cc4-4a95-9f13-e8cfaff4f88e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:43.608444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-19f2cee0-a3ac-4c01-be5e-0ea4fe18f1f8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Action: 'create', calling method: .version_select at 0x7f4086fba9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1002203304"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:43.648444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-19f2cee0-a3ac-4c01-be5e-0ea4fe18f1f8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Getting quotas for project fc47acc2b2ec444eb55b1d32e5d9d97a. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:49:43.653169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-19f2cee0-a3ac-4c01-be5e-0ea4fe18f1f8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Getting quotas for user a01dbdcd378e4b8096cb2f6daba96ffb and project fc47acc2b2ec444eb55b1d32e5d9d97a. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:49:43.686790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00a475ec-6cc4-4a95-9f13-e8cfaff4f88e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:43.708226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00a475ec-6cc4-4a95-9f13-e8cfaff4f88e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.306917 Apr 11 19:49:43.710315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 135/256] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:43 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:43.954227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed61dde8-baa1-4a33-b286-ae3261ba4241 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:43.955117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed61dde8-baa1-4a33-b286-ae3261ba4241 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:43.966225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed61dde8-baa1-4a33-b286-ae3261ba4241 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:43.966665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed61dde8-baa1-4a33-b286-ae3261ba4241 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:43.971291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed61dde8-baa1-4a33-b286-ae3261ba4241 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:43.971912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed61dde8-baa1-4a33-b286-ae3261ba4241 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:43.984872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-19f2cee0-a3ac-4c01-be5e-0ea4fe18f1f8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Getting quotas for project fc47acc2b2ec444eb55b1d32e5d9d97a. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:49:43.996316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-19f2cee0-a3ac-4c01-be5e-0ea4fe18f1f8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Getting quotas for user a01dbdcd378e4b8096cb2f6daba96ffb and project fc47acc2b2ec444eb55b1d32e5d9d97a. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:49:44.021064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-19f2cee0-a3ac-4c01-be5e-0ea4fe18f1f8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.416234 Apr 11 19:49:44.023037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 122/257] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 19:49:43 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:44.174660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed61dde8-baa1-4a33-b286-ae3261ba4241 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:44.183190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed61dde8-baa1-4a33-b286-ae3261ba4241 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.241483 Apr 11 19:49:44.196514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 136/258] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:43 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:44.202819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2125087386", "imageRef": "0446c449-9e79-4432-9380-0367a7a06764", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1002203304", "networks": [{"uuid": "03c9fb45-07d3-4acd-bd5f-b487b569edbe"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:44.282122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] validate_networks() for [('03c9fb45-07d3-4acd-bd5f-b487b569edbe', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:49:44.727409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1067c770-df40-40dd-ad2a-1d2f4d94ce43 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:44.728448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1067c770-df40-40dd-ad2a-1d2f4d94ce43 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:44.746567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1067c770-df40-40dd-ad2a-1d2f4d94ce43 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:44.747009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1067c770-df40-40dd-ad2a-1d2f4d94ce43 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:44.748581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1067c770-df40-40dd-ad2a-1d2f4d94ce43 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:44.755145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1067c770-df40-40dd-ad2a-1d2f4d94ce43 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:44.807646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:49:44.808312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:49:44.808801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:49:44.809228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:49:44.809633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:49:44.819700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:44.820137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:44.820944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:44.826051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:44.848317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Getting quotas for project fc47acc2b2ec444eb55b1d32e5d9d97a. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:49:44.853111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Getting quotas for user a01dbdcd378e4b8096cb2f6daba96ffb and project fc47acc2b2ec444eb55b1d32e5d9d97a. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:49:44.868726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:49:44.871590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0446c449-9e79-4432-9380-0367a7a06764',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:49:44.926470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0330f67b-b476-40d9-bba4-d0d8a65f686d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728253 Apr 11 19:49:44.932482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 123/259] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:49:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 19:49:44.940399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59b5bdba-f074-4e56-be71-049262dfdaa9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:44.941484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59b5bdba-f074-4e56-be71-049262dfdaa9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:44.978039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1067c770-df40-40dd-ad2a-1d2f4d94ce43 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:44.988662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1067c770-df40-40dd-ad2a-1d2f4d94ce43 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.265630 Apr 11 19:49:45.000348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 137/260] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:44 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:45.045167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-59b5bdba-f074-4e56-be71-049262dfdaa9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:45.053720 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59b5bdba-f074-4e56-be71-049262dfdaa9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1259 microversion: 2.1 time: 0.118266 Apr 11 19:49:45.054513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 124/261] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1259 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:45.215411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-627cae7d-54ce-4625-a5f5-d5771f94db64 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:45.216089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-627cae7d-54ce-4625-a5f5-d5771f94db64 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:45.240190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-627cae7d-54ce-4625-a5f5-d5771f94db64 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:45.240190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-627cae7d-54ce-4625-a5f5-d5771f94db64 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:45.240190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-627cae7d-54ce-4625-a5f5-d5771f94db64 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:45.240190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-627cae7d-54ce-4625-a5f5-d5771f94db64 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:45.427951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9974d9f9-b6f2-45b0-9631-e51c7036be85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:49:45.428485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9974d9f9-b6f2-45b0-9631-e51c7036be85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:45.430013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-627cae7d-54ce-4625-a5f5-d5771f94db64 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:45.435280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9974d9f9-b6f2-45b0-9631-e51c7036be85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:45.435727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9974d9f9-b6f2-45b0-9631-e51c7036be85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:45.436493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9974d9f9-b6f2-45b0-9631-e51c7036be85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:45.436927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9974d9f9-b6f2-45b0-9631-e51c7036be85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:45.439036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-627cae7d-54ce-4625-a5f5-d5771f94db64 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.228304 Apr 11 19:49:45.439708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 138/262] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:45 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:45.464415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-9974d9f9-b6f2-45b0-9631-e51c7036be85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lazy-loading 'flavor' on Instance uuid fb6aea71-8b17-46b8-ab07-b42b41b573a5 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:49:45.780135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9974d9f9-b6f2-45b0-9631-e51c7036be85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "POST /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/action" status: 202 len: 0 microversion: 2.20 time: 0.356082 Apr 11 19:49:45.780837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 125/263] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Apr 11 19:49:45 2022] POST /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:49:45.793045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:45.794952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:45.805416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:45.806200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:45.807673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:45.808759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:45.950135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:45.958137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:45.959619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:45.960801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1e882905-c3fe-49cd-a9fb-0579688d7fe1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.174877 Apr 11 19:49:45.961371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 139/264] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:46.007311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4893f9cc-0960-45db-bc41-9aa8d2f18b9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:46.007988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4893f9cc-0960-45db-bc41-9aa8d2f18b9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:46.014970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4893f9cc-0960-45db-bc41-9aa8d2f18b9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:46.015329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4893f9cc-0960-45db-bc41-9aa8d2f18b9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:46.016091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4893f9cc-0960-45db-bc41-9aa8d2f18b9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:46.016579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4893f9cc-0960-45db-bc41-9aa8d2f18b9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:46.077951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-32494c55-9d6e-4399-a018-a7f212d4487d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:46.078554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-32494c55-9d6e-4399-a018-a7f212d4487d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:46.084605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32494c55-9d6e-4399-a018-a7f212d4487d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:46.085087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32494c55-9d6e-4399-a018-a7f212d4487d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:46.085842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32494c55-9d6e-4399-a018-a7f212d4487d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:46.086273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32494c55-9d6e-4399-a018-a7f212d4487d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:46.165964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-32494c55-9d6e-4399-a018-a7f212d4487d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:46.176824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-32494c55-9d6e-4399-a018-a7f212d4487d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1263 microversion: 2.1 time: 0.102448 Apr 11 19:49:46.177732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 140/265] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1263 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:46.183074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4893f9cc-0960-45db-bc41-9aa8d2f18b9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:46.192658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4893f9cc-0960-45db-bc41-9aa8d2f18b9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.189556 Apr 11 19:49:46.193539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 126/266] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:46 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:46.457385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3d371b7-7859-4fe7-8bd4-79bf3457ad27 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:46.458020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3d371b7-7859-4fe7-8bd4-79bf3457ad27 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:46.465600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3d371b7-7859-4fe7-8bd4-79bf3457ad27 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:46.466046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3d371b7-7859-4fe7-8bd4-79bf3457ad27 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:46.466822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3d371b7-7859-4fe7-8bd4-79bf3457ad27 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:46.467248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3d371b7-7859-4fe7-8bd4-79bf3457ad27 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:46.608815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3d371b7-7859-4fe7-8bd4-79bf3457ad27 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:46.616654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3d371b7-7859-4fe7-8bd4-79bf3457ad27 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.163357 Apr 11 19:49:46.617237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 141/267] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:46 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:46.982407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:46.982999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:46.990517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:46.990931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:46.991755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:46.992149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:47.137834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:47.146607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:47.148377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:47.149412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7773607c-9ef2-4946-bc53-357172dbdec5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.172256 Apr 11 19:49:47.149974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 127/268] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:47.201939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2de86877-ebcd-4428-9a4e-4e061d6b7bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:47.203046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2de86877-ebcd-4428-9a4e-4e061d6b7bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:47.214391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1ce00c31-caae-4acb-8fcc-bed3c394949c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:47.218442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1ce00c31-caae-4acb-8fcc-bed3c394949c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:47.227238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de86877-ebcd-4428-9a4e-4e061d6b7bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:47.228054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de86877-ebcd-4428-9a4e-4e061d6b7bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:47.229436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de86877-ebcd-4428-9a4e-4e061d6b7bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:47.231776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de86877-ebcd-4428-9a4e-4e061d6b7bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:47.242173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ce00c31-caae-4acb-8fcc-bed3c394949c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:47.242968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ce00c31-caae-4acb-8fcc-bed3c394949c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:47.244300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ce00c31-caae-4acb-8fcc-bed3c394949c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:47.244864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ce00c31-caae-4acb-8fcc-bed3c394949c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:47.338677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2de86877-ebcd-4428-9a4e-4e061d6b7bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:47.347052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2de86877-ebcd-4428-9a4e-4e061d6b7bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1263 microversion: 2.1 time: 0.152054 Apr 11 19:49:47.347822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 142/269] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:47.433952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ce00c31-caae-4acb-8fcc-bed3c394949c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:47.442656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1ce00c31-caae-4acb-8fcc-bed3c394949c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.235128 Apr 11 19:49:47.443524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 128/270] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:47 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:47.635068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fab2264e-bcda-4cba-aadd-ee69b356587b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:47.636040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fab2264e-bcda-4cba-aadd-ee69b356587b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:47.643100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab2264e-bcda-4cba-aadd-ee69b356587b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:47.643540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab2264e-bcda-4cba-aadd-ee69b356587b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:47.644433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab2264e-bcda-4cba-aadd-ee69b356587b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:47.644864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab2264e-bcda-4cba-aadd-ee69b356587b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:47.918163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fab2264e-bcda-4cba-aadd-ee69b356587b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:47.928971 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fab2264e-bcda-4cba-aadd-ee69b356587b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.298227 Apr 11 19:49:47.954732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 143/271] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:47 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:48.179938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:48.181298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:48.209751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:48.212103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:48.213279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:48.219559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:48.364483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0ed5532-4a86-4bfd-a09f-5d1043acd7cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:48.365222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0ed5532-4a86-4bfd-a09f-5d1043acd7cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:48.372416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0ed5532-4a86-4bfd-a09f-5d1043acd7cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:48.373015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0ed5532-4a86-4bfd-a09f-5d1043acd7cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:48.373874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0ed5532-4a86-4bfd-a09f-5d1043acd7cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:48.374372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0ed5532-4a86-4bfd-a09f-5d1043acd7cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:48.469652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0ed5532-4a86-4bfd-a09f-5d1043acd7cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:48.481666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:48.486029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0ed5532-4a86-4bfd-a09f-5d1043acd7cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1311 microversion: 2.1 time: 0.125809 Apr 11 19:49:48.486907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 144/272] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:48.491540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a9ca6d26-bf7e-4916-ae75-d993a8157feb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:48.492148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a9ca6d26-bf7e-4916-ae75-d993a8157feb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:48.493885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:48.496485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:48.497794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2c2019b1-980e-447f-b67a-1318b98b203e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.321831 Apr 11 19:49:48.498370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 129/273] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:49:48.498606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9ca6d26-bf7e-4916-ae75-d993a8157feb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:48.499087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9ca6d26-bf7e-4916-ae75-d993a8157feb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:48.500175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9ca6d26-bf7e-4916-ae75-d993a8157feb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:48.500606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9ca6d26-bf7e-4916-ae75-d993a8157feb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:48.657226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9ca6d26-bf7e-4916-ae75-d993a8157feb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:48.665304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a9ca6d26-bf7e-4916-ae75-d993a8157feb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.177579 Apr 11 19:49:48.666265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 145/274] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:48 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:48.950090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1f30b37e-598d-406a-891d-32a6018e2d6b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:48.951128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1f30b37e-598d-406a-891d-32a6018e2d6b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:48.960601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f30b37e-598d-406a-891d-32a6018e2d6b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:48.961433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f30b37e-598d-406a-891d-32a6018e2d6b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:48.962825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f30b37e-598d-406a-891d-32a6018e2d6b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:48.963598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f30b37e-598d-406a-891d-32a6018e2d6b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:49.142251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1f30b37e-598d-406a-891d-32a6018e2d6b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:49.152862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1f30b37e-598d-406a-891d-32a6018e2d6b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.209687 Apr 11 19:49:49.153490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 130/275] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:48 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:49.508563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-622dbdba-3e4e-4b24-8df8-9da6983bf9a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:49.510253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-622dbdba-3e4e-4b24-8df8-9da6983bf9a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:49.515706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:49.516315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:49.528370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-622dbdba-3e4e-4b24-8df8-9da6983bf9a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:49.529202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-622dbdba-3e4e-4b24-8df8-9da6983bf9a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:49.532088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:49.532582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:49.533450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:49.534058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:49.534231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-622dbdba-3e4e-4b24-8df8-9da6983bf9a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:49.534881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-622dbdba-3e4e-4b24-8df8-9da6983bf9a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:49.662652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-622dbdba-3e4e-4b24-8df8-9da6983bf9a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:49.676399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-622dbdba-3e4e-4b24-8df8-9da6983bf9a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1311 microversion: 2.1 time: 0.168370 Apr 11 19:49:49.692249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 146/276] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1311 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:49.704225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6191bbed-ee12-42d6-ad39-fabad0236c95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:49.705113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6191bbed-ee12-42d6-ad39-fabad0236c95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:49.719206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6191bbed-ee12-42d6-ad39-fabad0236c95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:49.720276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6191bbed-ee12-42d6-ad39-fabad0236c95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:49.721857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6191bbed-ee12-42d6-ad39-fabad0236c95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:49.722836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6191bbed-ee12-42d6-ad39-fabad0236c95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:49.750354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:49.761095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:49.762685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:49.763976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1fdecd80-60f5-4138-ba8a-b4af24ba3cc8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.252188 Apr 11 19:49:49.764621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 131/277] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:49.898881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6191bbed-ee12-42d6-ad39-fabad0236c95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:49.908485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6191bbed-ee12-42d6-ad39-fabad0236c95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.214273 Apr 11 19:49:49.909653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 147/278] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:49 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:50.174275 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6c9007a2-494d-4710-af48-967f52a4631c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:50.175065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6c9007a2-494d-4710-af48-967f52a4631c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:50.181662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c9007a2-494d-4710-af48-967f52a4631c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:50.182225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c9007a2-494d-4710-af48-967f52a4631c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:50.183003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c9007a2-494d-4710-af48-967f52a4631c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:50.183433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c9007a2-494d-4710-af48-967f52a4631c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:50.333195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6c9007a2-494d-4710-af48-967f52a4631c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:50.339774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6c9007a2-494d-4710-af48-967f52a4631c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.169463 Apr 11 19:49:50.340589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 132/279] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:50 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:50.713730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-425345fb-332a-458a-814f-eedd3c3d5c99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:50.714705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-425345fb-332a-458a-814f-eedd3c3d5c99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:50.725838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-425345fb-332a-458a-814f-eedd3c3d5c99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:50.726897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-425345fb-332a-458a-814f-eedd3c3d5c99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:50.728530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-425345fb-332a-458a-814f-eedd3c3d5c99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:50.729419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-425345fb-332a-458a-814f-eedd3c3d5c99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:50.788177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:50.788897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:50.800210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:50.800657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:50.801596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:50.802024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:50.825004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-425345fb-332a-458a-814f-eedd3c3d5c99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:50.835744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-425345fb-332a-458a-814f-eedd3c3d5c99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1311 microversion: 2.1 time: 0.126132 Apr 11 19:49:50.837196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 148/280] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:50.926582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a7d8c60d-65fb-4a22-b97a-fcffe34aa812 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:50.927206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a7d8c60d-65fb-4a22-b97a-fcffe34aa812 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:50.942051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7d8c60d-65fb-4a22-b97a-fcffe34aa812 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:50.942486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7d8c60d-65fb-4a22-b97a-fcffe34aa812 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:50.943327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7d8c60d-65fb-4a22-b97a-fcffe34aa812 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:50.943880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7d8c60d-65fb-4a22-b97a-fcffe34aa812 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:51.002958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:51.018885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:51.022069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:51.023962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-883dbf66-8b9b-4e50-8592-9b210d72f646 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.239656 Apr 11 19:49:51.037145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 133/281] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:51.138487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a7d8c60d-65fb-4a22-b97a-fcffe34aa812 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:51.149646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a7d8c60d-65fb-4a22-b97a-fcffe34aa812 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.227004 Apr 11 19:49:51.151416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 149/282] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:50 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:51.358919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2ab24782-00f6-487c-a852-29aeabe4908a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:51.359949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2ab24782-00f6-487c-a852-29aeabe4908a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:51.368834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ab24782-00f6-487c-a852-29aeabe4908a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:51.369816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ab24782-00f6-487c-a852-29aeabe4908a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:51.371327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ab24782-00f6-487c-a852-29aeabe4908a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:51.371915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ab24782-00f6-487c-a852-29aeabe4908a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:51.562061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2ab24782-00f6-487c-a852-29aeabe4908a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:51.573267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2ab24782-00f6-487c-a852-29aeabe4908a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.219335 Apr 11 19:49:51.588938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 134/283] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:51 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:51.857754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-755449a2-5c61-4e1a-b177-57707f3cc019 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:51.858889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-755449a2-5c61-4e1a-b177-57707f3cc019 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:51.865872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-755449a2-5c61-4e1a-b177-57707f3cc019 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:51.866746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-755449a2-5c61-4e1a-b177-57707f3cc019 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:51.867904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-755449a2-5c61-4e1a-b177-57707f3cc019 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:51.868516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-755449a2-5c61-4e1a-b177-57707f3cc019 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:51.951314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-755449a2-5c61-4e1a-b177-57707f3cc019 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:51.961118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-755449a2-5c61-4e1a-b177-57707f3cc019 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1311 microversion: 2.1 time: 0.108408 Apr 11 19:49:51.970872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 150/284] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:52.045005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:52.045855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:52.052865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:52.053799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:52.054898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:52.055572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:52.170234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e9985ea7-7b8e-4fd4-8e35-2cc865010dff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:52.171294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e9985ea7-7b8e-4fd4-8e35-2cc865010dff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:52.184220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9985ea7-7b8e-4fd4-8e35-2cc865010dff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:52.185030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9985ea7-7b8e-4fd4-8e35-2cc865010dff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:52.186064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9985ea7-7b8e-4fd4-8e35-2cc865010dff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:52.186814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9985ea7-7b8e-4fd4-8e35-2cc865010dff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:52.272449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:52.286346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:52.288144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:52.289536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-82c60ac0-52b0-438a-ad81-47b3afd155fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.249015 Apr 11 19:49:52.290751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 135/285] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:52.374106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e9985ea7-7b8e-4fd4-8e35-2cc865010dff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:52.382383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e9985ea7-7b8e-4fd4-8e35-2cc865010dff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.216553 Apr 11 19:49:52.383230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 151/286] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:52 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:52.602069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3fd63912-cbda-4b6e-8354-ddd113f6fcca tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:52.602850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3fd63912-cbda-4b6e-8354-ddd113f6fcca tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:52.611929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fd63912-cbda-4b6e-8354-ddd113f6fcca tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:52.612516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fd63912-cbda-4b6e-8354-ddd113f6fcca tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:52.613584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fd63912-cbda-4b6e-8354-ddd113f6fcca tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:52.613946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fd63912-cbda-4b6e-8354-ddd113f6fcca tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:52.791235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3fd63912-cbda-4b6e-8354-ddd113f6fcca tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:52.805132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3fd63912-cbda-4b6e-8354-ddd113f6fcca tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.207344 Apr 11 19:49:52.815949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 136/287] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:52 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:52.979230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-14c5900b-093c-4f12-ac6d-f167eeb92ebe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:52.980722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-14c5900b-093c-4f12-ac6d-f167eeb92ebe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:52.987787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14c5900b-093c-4f12-ac6d-f167eeb92ebe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:52.988337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14c5900b-093c-4f12-ac6d-f167eeb92ebe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:52.989341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14c5900b-093c-4f12-ac6d-f167eeb92ebe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:52.989941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14c5900b-093c-4f12-ac6d-f167eeb92ebe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:53.057634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-14c5900b-093c-4f12-ac6d-f167eeb92ebe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:53.069749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-14c5900b-093c-4f12-ac6d-f167eeb92ebe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1311 microversion: 2.1 time: 0.094517 Apr 11 19:49:53.070437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 152/288] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:53.324808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:53.325438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:53.332546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:53.332930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:53.333683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:53.334111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:53.399764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a7c23bce-dd7a-43d8-aa95-51ac3c8ddd7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:53.400782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a7c23bce-dd7a-43d8-aa95-51ac3c8ddd7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:53.407255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7c23bce-dd7a-43d8-aa95-51ac3c8ddd7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:53.407996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7c23bce-dd7a-43d8-aa95-51ac3c8ddd7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:53.409086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7c23bce-dd7a-43d8-aa95-51ac3c8ddd7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:53.409694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7c23bce-dd7a-43d8-aa95-51ac3c8ddd7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:53.556536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:53.564856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:53.566419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:53.567613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-739f779a-8494-461b-b41c-903592f33b74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.247042 Apr 11 19:49:53.578943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 137/289] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:49:53.583227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a7c23bce-dd7a-43d8-aa95-51ac3c8ddd7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:53.591480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a7c23bce-dd7a-43d8-aa95-51ac3c8ddd7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.195462 Apr 11 19:49:53.592343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 153/290] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:53 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:53.823029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b2250d88-b88f-433d-ad26-31f2ad727b6f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:53.823599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b2250d88-b88f-433d-ad26-31f2ad727b6f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:53.830638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2250d88-b88f-433d-ad26-31f2ad727b6f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:53.830638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2250d88-b88f-433d-ad26-31f2ad727b6f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:53.831519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2250d88-b88f-433d-ad26-31f2ad727b6f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:53.831928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2250d88-b88f-433d-ad26-31f2ad727b6f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:53.974686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2250d88-b88f-433d-ad26-31f2ad727b6f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:53.983080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b2250d88-b88f-433d-ad26-31f2ad727b6f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.164436 Apr 11 19:49:53.984083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 138/291] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:53 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:54.089585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1507d783-0f59-4c1f-8751-39ba43c2a02a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:54.090993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1507d783-0f59-4c1f-8751-39ba43c2a02a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:54.100704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1507d783-0f59-4c1f-8751-39ba43c2a02a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:54.101505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1507d783-0f59-4c1f-8751-39ba43c2a02a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:54.102797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1507d783-0f59-4c1f-8751-39ba43c2a02a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:54.103381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1507d783-0f59-4c1f-8751-39ba43c2a02a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:54.170201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1507d783-0f59-4c1f-8751-39ba43c2a02a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:54.177742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1507d783-0f59-4c1f-8751-39ba43c2a02a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1311 microversion: 2.1 time: 0.093120 Apr 11 19:49:54.178326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 154/292] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:54.586682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:54.587300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:54.593891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:54.594330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:54.595078 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:54.595501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:54.608130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-83af8a7e-fa96-47d9-870e-a51722470117 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:54.608729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-83af8a7e-fa96-47d9-870e-a51722470117 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:54.615943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83af8a7e-fa96-47d9-870e-a51722470117 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:54.616353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83af8a7e-fa96-47d9-870e-a51722470117 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:54.617185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83af8a7e-fa96-47d9-870e-a51722470117 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:54.617608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83af8a7e-fa96-47d9-870e-a51722470117 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:54.786547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:54.794784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:54.796292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:54.797505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb565ef8-934e-4cde-a86e-0923d9f76424 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.214939 Apr 11 19:49:54.798068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 139/293] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:54.800423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-83af8a7e-fa96-47d9-870e-a51722470117 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:54.811051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-83af8a7e-fa96-47d9-870e-a51722470117 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.206680 Apr 11 19:49:54.811645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 155/294] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:54 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:55.003282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e7aceaf3-64c3-4e0e-8356-3d5c5b516b93 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:55.004144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e7aceaf3-64c3-4e0e-8356-3d5c5b516b93 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:55.016959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7aceaf3-64c3-4e0e-8356-3d5c5b516b93 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:55.017741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7aceaf3-64c3-4e0e-8356-3d5c5b516b93 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:55.018716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7aceaf3-64c3-4e0e-8356-3d5c5b516b93 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:55.019340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7aceaf3-64c3-4e0e-8356-3d5c5b516b93 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:55.158406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7aceaf3-64c3-4e0e-8356-3d5c5b516b93 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:55.166659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e7aceaf3-64c3-4e0e-8356-3d5c5b516b93 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.170460 Apr 11 19:49:55.167240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 140/295] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:54 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:55.198756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e5fc5fa-17f6-409c-86a9-92050eaa7d6b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:55.199321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e5fc5fa-17f6-409c-86a9-92050eaa7d6b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:55.206057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5fc5fa-17f6-409c-86a9-92050eaa7d6b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:55.206502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5fc5fa-17f6-409c-86a9-92050eaa7d6b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:55.207259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5fc5fa-17f6-409c-86a9-92050eaa7d6b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:55.207685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5fc5fa-17f6-409c-86a9-92050eaa7d6b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:55.270157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e5fc5fa-17f6-409c-86a9-92050eaa7d6b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:55.277685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e5fc5fa-17f6-409c-86a9-92050eaa7d6b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1311 microversion: 2.1 time: 0.083419 Apr 11 19:49:55.278310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 156/296] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:55.816773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:55.817464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:55.824100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:55.824537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:55.825313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:55.825733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:55.827638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-883dbf09-6bca-4bd7-a07f-6c50520e6dfc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:55.828378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-883dbf09-6bca-4bd7-a07f-6c50520e6dfc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:55.836687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-883dbf09-6bca-4bd7-a07f-6c50520e6dfc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:55.837186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-883dbf09-6bca-4bd7-a07f-6c50520e6dfc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:55.837967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-883dbf09-6bca-4bd7-a07f-6c50520e6dfc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:55.838398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-883dbf09-6bca-4bd7-a07f-6c50520e6dfc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:56.015276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:56.023569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:56.025460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:56.026879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-883dbf09-6bca-4bd7-a07f-6c50520e6dfc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:56.027306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-94b2fd71-b46f-4395-ae98-d58bd628da80 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.214238 Apr 11 19:49:56.028061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 141/297] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:56.035757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-883dbf09-6bca-4bd7-a07f-6c50520e6dfc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.211894 Apr 11 19:49:56.045227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 157/298] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:55 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:56.184256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ce9986d9-8ce4-4945-b2e3-5aef42bd3ec2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:56.184873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ce9986d9-8ce4-4945-b2e3-5aef42bd3ec2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:56.192120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce9986d9-8ce4-4945-b2e3-5aef42bd3ec2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:56.192570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce9986d9-8ce4-4945-b2e3-5aef42bd3ec2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:56.193384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce9986d9-8ce4-4945-b2e3-5aef42bd3ec2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:56.193842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce9986d9-8ce4-4945-b2e3-5aef42bd3ec2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:56.295220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-51617051-9cea-4859-a8c0-a306597c5b35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:56.295812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-51617051-9cea-4859-a8c0-a306597c5b35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:56.302522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51617051-9cea-4859-a8c0-a306597c5b35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:56.302980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51617051-9cea-4859-a8c0-a306597c5b35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:56.303736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51617051-9cea-4859-a8c0-a306597c5b35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:56.304159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51617051-9cea-4859-a8c0-a306597c5b35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:56.323488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ce9986d9-8ce4-4945-b2e3-5aef42bd3ec2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:56.330990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ce9986d9-8ce4-4945-b2e3-5aef42bd3ec2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.150760 Apr 11 19:49:56.331568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 142/299] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:56 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:56.364247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-51617051-9cea-4859-a8c0-a306597c5b35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:56.371668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-51617051-9cea-4859-a8c0-a306597c5b35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1319 microversion: 2.1 time: 0.080481 Apr 11 19:49:56.372270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 158/300] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1319 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:57.046700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:57.047387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:57.053152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0ff58d72-a495-4df0-bd79-3c8e84d0b8a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:57.053851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0ff58d72-a495-4df0-bd79-3c8e84d0b8a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:57.054113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:57.054296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:57.055060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:57.055492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:57.059918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ff58d72-a495-4df0-bd79-3c8e84d0b8a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:57.060352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ff58d72-a495-4df0-bd79-3c8e84d0b8a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:57.061155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ff58d72-a495-4df0-bd79-3c8e84d0b8a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:57.061588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ff58d72-a495-4df0-bd79-3c8e84d0b8a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:57.250184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:57.254246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0ff58d72-a495-4df0-bd79-3c8e84d0b8a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:57.258741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:57.260322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:57.261544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58c454c2-c893-44db-876f-407f617e5a35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.218786 Apr 11 19:49:57.261919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0ff58d72-a495-4df0-bd79-3c8e84d0b8a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.213057 Apr 11 19:49:57.262647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 143/301] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:57.262794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 159/302] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:57 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:57.348689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f51a8569-2796-48b5-85bf-e572509eb90c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:57.349399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f51a8569-2796-48b5-85bf-e572509eb90c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:57.357981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51a8569-2796-48b5-85bf-e572509eb90c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:57.358433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51a8569-2796-48b5-85bf-e572509eb90c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:57.359199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51a8569-2796-48b5-85bf-e572509eb90c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:57.359621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51a8569-2796-48b5-85bf-e572509eb90c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:57.389284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fddc4b27-579b-429d-a2be-f058f4a7f01d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:57.389986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fddc4b27-579b-429d-a2be-f058f4a7f01d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:57.397427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fddc4b27-579b-429d-a2be-f058f4a7f01d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:57.397869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fddc4b27-579b-429d-a2be-f058f4a7f01d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:57.398633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fddc4b27-579b-429d-a2be-f058f4a7f01d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:57.399062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fddc4b27-579b-429d-a2be-f058f4a7f01d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:57.462278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fddc4b27-579b-429d-a2be-f058f4a7f01d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:57.470118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fddc4b27-579b-429d-a2be-f058f4a7f01d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1319 microversion: 2.1 time: 0.084668 Apr 11 19:49:57.470693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 160/303] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1319 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:49:57.516290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f51a8569-2796-48b5-85bf-e572509eb90c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:57.524189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f51a8569-2796-48b5-85bf-e572509eb90c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.179971 Apr 11 19:49:57.524735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 144/304] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:57 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:58.284776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:58.286285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:58.286608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8479cb0b-d56e-4a2c-95a2-63bd7320349b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:58.287554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8479cb0b-d56e-4a2c-95a2-63bd7320349b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:58.297803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:58.298247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:58.299026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:58.301674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:58.306222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8479cb0b-d56e-4a2c-95a2-63bd7320349b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:58.306665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8479cb0b-d56e-4a2c-95a2-63bd7320349b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:58.307456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8479cb0b-d56e-4a2c-95a2-63bd7320349b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:58.307869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8479cb0b-d56e-4a2c-95a2-63bd7320349b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:58.705437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8479cb0b-d56e-4a2c-95a2-63bd7320349b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:58.709862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:58.714462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8479cb0b-d56e-4a2c-95a2-63bd7320349b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.440341 Apr 11 19:49:58.715336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 161/305] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:58 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:58.720462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-689fd3d4-3b84-4cca-b112-8174c5c51454 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:58.721448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-689fd3d4-3b84-4cca-b112-8174c5c51454 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:58.722227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:58.727249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:58.728525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-518a7df7-0282-4196-a4d2-ea0de5e0ae5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.452584 Apr 11 19:49:58.728813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-689fd3d4-3b84-4cca-b112-8174c5c51454 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:58.732611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 145/306] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:49:58.732801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-689fd3d4-3b84-4cca-b112-8174c5c51454 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:58.732801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-689fd3d4-3b84-4cca-b112-8174c5c51454 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:58.732801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-689fd3d4-3b84-4cca-b112-8174c5c51454 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:58.735779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a352d3a1-f930-4626-9ce4-e7e24d74729f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:58.736405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a352d3a1-f930-4626-9ce4-e7e24d74729f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:58.748563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a352d3a1-f930-4626-9ce4-e7e24d74729f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:58.749041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a352d3a1-f930-4626-9ce4-e7e24d74729f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:58.750204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a352d3a1-f930-4626-9ce4-e7e24d74729f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:58.750620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a352d3a1-f930-4626-9ce4-e7e24d74729f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:58.846010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-689fd3d4-3b84-4cca-b112-8174c5c51454 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:58.861554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-689fd3d4-3b84-4cca-b112-8174c5c51454 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1317 microversion: 2.1 time: 0.144900 Apr 11 19:49:58.862164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 162/307] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:58.979157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a352d3a1-f930-4626-9ce4-e7e24d74729f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:49:58.991789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a352d3a1-f930-4626-9ce4-e7e24d74729f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.260282 Apr 11 19:49:59.007491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 146/308] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:58 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:49:59.732216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b95571a0-be0f-40e5-99b9-050bfa9e485c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:59.732870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b95571a0-be0f-40e5-99b9-050bfa9e485c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:59.740441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b95571a0-be0f-40e5-99b9-050bfa9e485c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:59.740887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b95571a0-be0f-40e5-99b9-050bfa9e485c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:59.752166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:49:59.752772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:49:59.759248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b95571a0-be0f-40e5-99b9-050bfa9e485c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:59.760284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b95571a0-be0f-40e5-99b9-050bfa9e485c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:59.776649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:59.777845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:49:59.779048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:49:59.779847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:00.064367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:00.080109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:00.081912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:00.083095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-63cf3ef7-6b72-4ebc-8675-4e62cdb32c99 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.339870 Apr 11 19:50:00.083649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 147/309] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:49:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:00.095267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eff1894d-2734-4b77-897d-506178e37b02 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:00.096045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eff1894d-2734-4b77-897d-506178e37b02 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:00.104283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eff1894d-2734-4b77-897d-506178e37b02 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:00.105256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eff1894d-2734-4b77-897d-506178e37b02 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:00.111063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eff1894d-2734-4b77-897d-506178e37b02 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:00.111919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eff1894d-2734-4b77-897d-506178e37b02 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:00.117216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b95571a0-be0f-40e5-99b9-050bfa9e485c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:00.125525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b95571a0-be0f-40e5-99b9-050bfa9e485c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.397006 Apr 11 19:50:00.128918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 163/310] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:49:59 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:00.139923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c842b1dd-cee7-4ca1-b0a3-9200c257b4cd tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:00.141229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c842b1dd-cee7-4ca1-b0a3-9200c257b4cd tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:00.147749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c842b1dd-cee7-4ca1-b0a3-9200c257b4cd tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:00.148446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c842b1dd-cee7-4ca1-b0a3-9200c257b4cd tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:00.149498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c842b1dd-cee7-4ca1-b0a3-9200c257b4cd tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:00.150204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c842b1dd-cee7-4ca1-b0a3-9200c257b4cd tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:00.422981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eff1894d-2734-4b77-897d-506178e37b02 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:00.431448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eff1894d-2734-4b77-897d-506178e37b02 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.346541 Apr 11 19:50:00.432407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c842b1dd-cee7-4ca1-b0a3-9200c257b4cd tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:00.432767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 148/311] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:00.442209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c842b1dd-cee7-4ca1-b0a3-9200c257b4cd tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.311699 Apr 11 19:50:00.447148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 164/312] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:00 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:00.779494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-be7e45e4-b8bd-478f-bb43-e4258b0bac7e req-eb60b305-7f3e-4f46-89b4-d48b16d40403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99731dc4-4495-4be7-88d0-764f481cab49", "name": "network-vif-plugged", "status": "completed", "tag": "60530c96-56a5-4c58-a966-719dd5fccd75"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:00.795116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-be7e45e4-b8bd-478f-bb43-e4258b0bac7e req-eb60b305-7f3e-4f46-89b4-d48b16d40403 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:00.795581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-be7e45e4-b8bd-478f-bb43-e4258b0bac7e req-eb60b305-7f3e-4f46-89b4-d48b16d40403 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:00.814139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-be7e45e4-b8bd-478f-bb43-e4258b0bac7e req-eb60b305-7f3e-4f46-89b4-d48b16d40403 service nova] Creating event network-vif-plugged:60530c96-56a5-4c58-a966-719dd5fccd75 for instance 99731dc4-4495-4be7-88d0-764f481cab49 on hv-cinder-83078 Apr 11 19:50:00.819964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-be7e45e4-b8bd-478f-bb43-e4258b0bac7e req-eb60b305-7f3e-4f46-89b4-d48b16d40403 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045215 Apr 11 19:50:00.820567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 149/313] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:01.102524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:01.103322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:01.110740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:01.111221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:01.112023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:01.112421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:01.143625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d99c519a-df19-4935-9fbf-6a53f7b050fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:01.144500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d99c519a-df19-4935-9fbf-6a53f7b050fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:01.156066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d99c519a-df19-4935-9fbf-6a53f7b050fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:01.156704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d99c519a-df19-4935-9fbf-6a53f7b050fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:01.157608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d99c519a-df19-4935-9fbf-6a53f7b050fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:01.158089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d99c519a-df19-4935-9fbf-6a53f7b050fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:01.314081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:01.326075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:01.335240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:01.336702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c25e336e-d28f-46d0-800c-a911c5b46d82 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.238547 Apr 11 19:50:01.337336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 165/314] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:01.364608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d99c519a-df19-4935-9fbf-6a53f7b050fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:01.379462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d99c519a-df19-4935-9fbf-6a53f7b050fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.240280 Apr 11 19:50:01.380054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 150/315] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:01 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:01.450274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cbd63935-61d4-48e6-9f0a-55e00b7ca5b3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:01.451072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cbd63935-61d4-48e6-9f0a-55e00b7ca5b3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:01.458404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbd63935-61d4-48e6-9f0a-55e00b7ca5b3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:01.458932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbd63935-61d4-48e6-9f0a-55e00b7ca5b3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:01.459639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbd63935-61d4-48e6-9f0a-55e00b7ca5b3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:01.460074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbd63935-61d4-48e6-9f0a-55e00b7ca5b3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:01.460212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-60f6b13c-2794-486f-abcb-13b92545d5a3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:01.460731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-60f6b13c-2794-486f-abcb-13b92545d5a3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:01.469026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f6b13c-2794-486f-abcb-13b92545d5a3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:01.470252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f6b13c-2794-486f-abcb-13b92545d5a3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:01.472181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f6b13c-2794-486f-abcb-13b92545d5a3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:01.473310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f6b13c-2794-486f-abcb-13b92545d5a3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:01.713185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cbd63935-61d4-48e6-9f0a-55e00b7ca5b3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:01.716774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-60f6b13c-2794-486f-abcb-13b92545d5a3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:01.725080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-60f6b13c-2794-486f-abcb-13b92545d5a3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.268922 Apr 11 19:50:01.726228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cbd63935-61d4-48e6-9f0a-55e00b7ca5b3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.280347 Apr 11 19:50:01.736096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 151/316] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:01 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:01.737066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 166/317] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:02.362824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:02.363912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:02.373381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:02.374153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:02.375855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:02.376411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:02.401842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa1e3d2e-eda4-4a4b-9164-55848503e63b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:02.402553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa1e3d2e-eda4-4a4b-9164-55848503e63b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:02.412013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa1e3d2e-eda4-4a4b-9164-55848503e63b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:02.412456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa1e3d2e-eda4-4a4b-9164-55848503e63b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:02.413307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa1e3d2e-eda4-4a4b-9164-55848503e63b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:02.413750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa1e3d2e-eda4-4a4b-9164-55848503e63b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:02.597203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:02.603998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aa1e3d2e-eda4-4a4b-9164-55848503e63b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:02.605854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:02.607581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:02.609016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b330645e-f90f-4399-b348-930f9f98aaed tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.251493 Apr 11 19:50:02.610071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 152/318] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:02.613183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa1e3d2e-eda4-4a4b-9164-55848503e63b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.219285 Apr 11 19:50:02.614268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 167/319] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:02 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:02.743541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2892444c-e5a0-4af7-9def-d857509759a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:02.743766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-17403cea-60ab-4ad3-87fc-3006650519de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:02.744062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2892444c-e5a0-4af7-9def-d857509759a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:02.744529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-17403cea-60ab-4ad3-87fc-3006650519de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:02.751800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2892444c-e5a0-4af7-9def-d857509759a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:02.752247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2892444c-e5a0-4af7-9def-d857509759a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:02.752835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17403cea-60ab-4ad3-87fc-3006650519de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:02.753057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2892444c-e5a0-4af7-9def-d857509759a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:02.754011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2892444c-e5a0-4af7-9def-d857509759a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:02.754896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17403cea-60ab-4ad3-87fc-3006650519de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:02.756419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17403cea-60ab-4ad3-87fc-3006650519de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:02.757019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17403cea-60ab-4ad3-87fc-3006650519de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:02.993449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2892444c-e5a0-4af7-9def-d857509759a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:03.003044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2892444c-e5a0-4af7-9def-d857509759a0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.263459 Apr 11 19:50:03.003447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17403cea-60ab-4ad3-87fc-3006650519de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:03.003878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 153/320] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:02 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:03.011258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-17403cea-60ab-4ad3-87fc-3006650519de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.271216 Apr 11 19:50:03.016793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 168/321] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:03.366733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-72fbfae2-f728-4c6e-8d41-2b194c21e4f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:03.367871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-72fbfae2-f728-4c6e-8d41-2b194c21e4f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:03.380616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72fbfae2-f728-4c6e-8d41-2b194c21e4f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:03.381096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72fbfae2-f728-4c6e-8d41-2b194c21e4f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:03.381849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72fbfae2-f728-4c6e-8d41-2b194c21e4f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:03.382301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72fbfae2-f728-4c6e-8d41-2b194c21e4f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:03.579081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-72fbfae2-f728-4c6e-8d41-2b194c21e4f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'services' on Instance uuid a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:50:03.631517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac875596-bd1c-46f4-a7c5-5167f7f781df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:03.632225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac875596-bd1c-46f4-a7c5-5167f7f781df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:03.658979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac875596-bd1c-46f4-a7c5-5167f7f781df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:03.659366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac875596-bd1c-46f4-a7c5-5167f7f781df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:03.660167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac875596-bd1c-46f4-a7c5-5167f7f781df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:03.665277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac875596-bd1c-46f4-a7c5-5167f7f781df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:03.798271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-72fbfae2-f728-4c6e-8d41-2b194c21e4f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4/os-volume_attachments/13f2ac5e-a51d-4a7a-86aa-2951603084d7" status: 202 len: 0 microversion: 2.1 time: 0.435826 Apr 11 19:50:03.813541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 154/322] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 19:50:03 2022] DELETE /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4/os-volume_attachments/13f2ac5e-a51d-4a7a-86aa-2951603084d7 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:50:03.838190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:03.842185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:03.867107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:03.867630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:03.868557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:03.869408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:03.956838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ac875596-bd1c-46f4-a7c5-5167f7f781df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:03.968495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac875596-bd1c-46f4-a7c5-5167f7f781df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.341169 Apr 11 19:50:03.979288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 169/323] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:03 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:04.020225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-422b6343-4f93-457c-ac43-5d4f4545da87 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:04.021290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-422b6343-4f93-457c-ac43-5d4f4545da87 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:04.038594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-422b6343-4f93-457c-ac43-5d4f4545da87 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:04.038594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-422b6343-4f93-457c-ac43-5d4f4545da87 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:04.039375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-422b6343-4f93-457c-ac43-5d4f4545da87 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:04.039877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-422b6343-4f93-457c-ac43-5d4f4545da87 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:04.315020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:04.323521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:04.324593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-422b6343-4f93-457c-ac43-5d4f4545da87 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:04.325029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:04.326208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a3fa806a-2a1e-4d99-a0c3-f0c23f9c51d7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.510940 Apr 11 19:50:04.326762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 155/324] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:04.336965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-422b6343-4f93-457c-ac43-5d4f4545da87 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.320931 Apr 11 19:50:04.338859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 170/325] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:04 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:04.342760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9dac9ebc-edab-45bb-921d-d2d19d33402a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:04.343368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9dac9ebc-edab-45bb-921d-d2d19d33402a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:04.366594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dac9ebc-edab-45bb-921d-d2d19d33402a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:04.367176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dac9ebc-edab-45bb-921d-d2d19d33402a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:04.369661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dac9ebc-edab-45bb-921d-d2d19d33402a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:04.370680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dac9ebc-edab-45bb-921d-d2d19d33402a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:04.621357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9dac9ebc-edab-45bb-921d-d2d19d33402a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:04.635777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9dac9ebc-edab-45bb-921d-d2d19d33402a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.307933 Apr 11 19:50:04.654505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 156/326] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:04.989450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a70d0e74-d73a-4d4c-81cc-d4ae3b30b6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:04.990331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a70d0e74-d73a-4d4c-81cc-d4ae3b30b6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:04.997696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a70d0e74-d73a-4d4c-81cc-d4ae3b30b6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:04.998157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a70d0e74-d73a-4d4c-81cc-d4ae3b30b6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:04.999031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a70d0e74-d73a-4d4c-81cc-d4ae3b30b6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:05.000032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a70d0e74-d73a-4d4c-81cc-d4ae3b30b6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:05.259946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a70d0e74-d73a-4d4c-81cc-d4ae3b30b6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:05.273812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a70d0e74-d73a-4d4c-81cc-d4ae3b30b6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.289871 Apr 11 19:50:05.283614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 171/327] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:04 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:05.343976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:05.344944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:05.356249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1adcc2b-6792-4b4f-b51b-0c981372a193 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:05.357300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1adcc2b-6792-4b4f-b51b-0c981372a193 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:05.368441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1adcc2b-6792-4b4f-b51b-0c981372a193 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:05.369285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1adcc2b-6792-4b4f-b51b-0c981372a193 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:05.369555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:05.370098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:05.371138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1adcc2b-6792-4b4f-b51b-0c981372a193 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:05.371259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:05.371652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:05.372089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1adcc2b-6792-4b4f-b51b-0c981372a193 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:05.632296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1adcc2b-6792-4b4f-b51b-0c981372a193 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:05.632957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:05.652285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1adcc2b-6792-4b4f-b51b-0c981372a193 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.300699 Apr 11 19:50:05.652884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 172/328] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:05 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:05.653219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:05.657137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:05.658614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-115c49b3-af09-4f22-8776-60ca7be42a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.318667 Apr 11 19:50:05.673899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 157/329] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:05.677969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d9179fe1-7f5e-4abd-9b18-385fb30e3a89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:05.679778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d9179fe1-7f5e-4abd-9b18-385fb30e3a89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:05.690352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9179fe1-7f5e-4abd-9b18-385fb30e3a89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:05.691383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9179fe1-7f5e-4abd-9b18-385fb30e3a89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:05.693031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9179fe1-7f5e-4abd-9b18-385fb30e3a89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:05.694575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9179fe1-7f5e-4abd-9b18-385fb30e3a89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:05.887358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d9179fe1-7f5e-4abd-9b18-385fb30e3a89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:05.897179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d9179fe1-7f5e-4abd-9b18-385fb30e3a89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.241881 Apr 11 19:50:05.898854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 173/330] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:06.294144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51f00f86-1f8b-44ee-b437-b1620a4e9a5c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:06.297041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51f00f86-1f8b-44ee-b437-b1620a4e9a5c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:06.306344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51f00f86-1f8b-44ee-b437-b1620a4e9a5c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:06.307133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51f00f86-1f8b-44ee-b437-b1620a4e9a5c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:06.308123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51f00f86-1f8b-44ee-b437-b1620a4e9a5c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:06.308764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51f00f86-1f8b-44ee-b437-b1620a4e9a5c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:06.476854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51f00f86-1f8b-44ee-b437-b1620a4e9a5c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:06.485043 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51f00f86-1f8b-44ee-b437-b1620a4e9a5c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.197802 Apr 11 19:50:06.486286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 158/331] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:06 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:06.670437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d554e27-6f4c-4e0b-959f-8a8e10b9084f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:06.671062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d554e27-6f4c-4e0b-959f-8a8e10b9084f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:06.678326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d554e27-6f4c-4e0b-959f-8a8e10b9084f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:06.678779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d554e27-6f4c-4e0b-959f-8a8e10b9084f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:06.679589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d554e27-6f4c-4e0b-959f-8a8e10b9084f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:06.680015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d554e27-6f4c-4e0b-959f-8a8e10b9084f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:06.685654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:06.686331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:06.692334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:06.692775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:06.693654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:06.694017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:06.908055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d554e27-6f4c-4e0b-959f-8a8e10b9084f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:06.915708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:06.923992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d554e27-6f4c-4e0b-959f-8a8e10b9084f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.254648 Apr 11 19:50:06.926761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:06.928731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:06.930341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-37eec16b-06bf-4094-9dd3-ef9102c656bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.248490 Apr 11 19:50:06.931282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 159/333] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:06.931647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 174/333] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:06 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:06.945410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-336e8d19-b3d9-4bdb-abc0-05422cc8efad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:06.946463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-336e8d19-b3d9-4bdb-abc0-05422cc8efad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:06.953619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-336e8d19-b3d9-4bdb-abc0-05422cc8efad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:06.954405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-336e8d19-b3d9-4bdb-abc0-05422cc8efad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:06.955439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-336e8d19-b3d9-4bdb-abc0-05422cc8efad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:06.956059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-336e8d19-b3d9-4bdb-abc0-05422cc8efad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:07.144145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-336e8d19-b3d9-4bdb-abc0-05422cc8efad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:07.157354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-336e8d19-b3d9-4bdb-abc0-05422cc8efad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.224359 Apr 11 19:50:07.163422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 160/334] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:07.503848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ce91b99-3b56-4e17-8a8f-30a3c810ed02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:07.504721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ce91b99-3b56-4e17-8a8f-30a3c810ed02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:07.511098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ce91b99-3b56-4e17-8a8f-30a3c810ed02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:07.511537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ce91b99-3b56-4e17-8a8f-30a3c810ed02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:07.512347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ce91b99-3b56-4e17-8a8f-30a3c810ed02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:07.512855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ce91b99-3b56-4e17-8a8f-30a3c810ed02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:07.660709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ce91b99-3b56-4e17-8a8f-30a3c810ed02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:07.668923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ce91b99-3b56-4e17-8a8f-30a3c810ed02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.169929 Apr 11 19:50:07.669511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 175/335] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:07 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:07.949555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-89aefbb3-eb72-4fa6-8648-f4e2ce8559a9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:07.950702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:07.950702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:07.951212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-89aefbb3-eb72-4fa6-8648-f4e2ce8559a9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:07.957949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89aefbb3-eb72-4fa6-8648-f4e2ce8559a9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:07.958520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89aefbb3-eb72-4fa6-8648-f4e2ce8559a9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:07.959362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:07.959534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89aefbb3-eb72-4fa6-8648-f4e2ce8559a9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:07.959789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89aefbb3-eb72-4fa6-8648-f4e2ce8559a9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:07.959950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:07.960559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:07.961026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:08.161426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-89aefbb3-eb72-4fa6-8648-f4e2ce8559a9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:08.164464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:08.170039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-89aefbb3-eb72-4fa6-8648-f4e2ce8559a9 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.229773 Apr 11 19:50:08.170832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 161/336] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:07 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:08.173584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:08.175138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:08.176306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3bb7e17-9322-462a-b611-da57bad39020 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.231017 Apr 11 19:50:08.177142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 176/337] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:08.179580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-747a0a7a-8482-4801-9b20-52da34bb70ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:08.180262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-747a0a7a-8482-4801-9b20-52da34bb70ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:08.186786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-747a0a7a-8482-4801-9b20-52da34bb70ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:08.187380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-747a0a7a-8482-4801-9b20-52da34bb70ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:08.188384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-747a0a7a-8482-4801-9b20-52da34bb70ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:08.190874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-747a0a7a-8482-4801-9b20-52da34bb70ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:08.359978 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-747a0a7a-8482-4801-9b20-52da34bb70ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:08.371741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-747a0a7a-8482-4801-9b20-52da34bb70ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.197539 Apr 11 19:50:08.379626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 162/338] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:08.686808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66a5f5db-2502-480a-862f-854672af4f02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:08.687587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-66a5f5db-2502-480a-862f-854672af4f02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:08.694308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66a5f5db-2502-480a-862f-854672af4f02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:08.694853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66a5f5db-2502-480a-862f-854672af4f02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:08.695602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66a5f5db-2502-480a-862f-854672af4f02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:08.696034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66a5f5db-2502-480a-862f-854672af4f02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:08.866804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-66a5f5db-2502-480a-862f-854672af4f02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:08.875017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-66a5f5db-2502-480a-862f-854672af4f02 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.191859 Apr 11 19:50:08.875495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 177/339] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:08 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:09.194939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb83fe74-b681-4b8d-b0c7-88aff2321252 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:09.196197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb83fe74-b681-4b8d-b0c7-88aff2321252 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:09.196738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:09.197616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:09.205393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb83fe74-b681-4b8d-b0c7-88aff2321252 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.206248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb83fe74-b681-4b8d-b0c7-88aff2321252 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.207220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb83fe74-b681-4b8d-b0c7-88aff2321252 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.207811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb83fe74-b681-4b8d-b0c7-88aff2321252 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.207969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.208430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.209255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.209811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.458275 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eb83fe74-b681-4b8d-b0c7-88aff2321252 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:09.488672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb83fe74-b681-4b8d-b0c7-88aff2321252 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1501 microversion: 2.1 time: 0.295302 Apr 11 19:50:09.489730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 163/340] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:09 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1501 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:09.494841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-909e280e-7bb5-43ae-bf4f-aa286a7224cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:09.496851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-909e280e-7bb5-43ae-bf4f-aa286a7224cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:09.508227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-909e280e-7bb5-43ae-bf4f-aa286a7224cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.508671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-909e280e-7bb5-43ae-bf4f-aa286a7224cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.515189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-909e280e-7bb5-43ae-bf4f-aa286a7224cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.515638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-909e280e-7bb5-43ae-bf4f-aa286a7224cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.555718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:09.571684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:09.580476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:09.581745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-664cd62e-090e-4906-a75c-9e83bd6b11c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1723 microversion: 2.20 time: 0.390720 Apr 11 19:50:09.582325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 178/341] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:09.595251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-ae1e6def-ba55-4e5c-98ff-d0028e5d4197 req-d26f5558-0c49-4ef6-8c50-fb9ff515a7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f85f237-46f1-47d2-badc-2e3cffe85c90", "tag": "6932f8ee-b8ec-4779-99f0-59715534dce0"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:09.665494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ae1e6def-ba55-4e5c-98ff-d0028e5d4197 req-d26f5558-0c49-4ef6-8c50-fb9ff515a7ef service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.665938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ae1e6def-ba55-4e5c-98ff-d0028e5d4197 req-d26f5558-0c49-4ef6-8c50-fb9ff515a7ef service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.696035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-ae1e6def-ba55-4e5c-98ff-d0028e5d4197 req-d26f5558-0c49-4ef6-8c50-fb9ff515a7ef service nova] Creating event network-changed:6932f8ee-b8ec-4779-99f0-59715534dce0 for instance 4f85f237-46f1-47d2-badc-2e3cffe85c90 on hv-cinder-83078 Apr 11 19:50:09.708653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-ae1e6def-ba55-4e5c-98ff-d0028e5d4197 req-d26f5558-0c49-4ef6-8c50-fb9ff515a7ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124896 Apr 11 19:50:09.709745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 179/342] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:09.717892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3ad585e-cb07-4af6-9697-73c32c55802c"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:09.719791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:09.731127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.731753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.733132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.733790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.761490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] HTTP exception thrown: Cannot 'attach_volume' instance 5e337b2e-3267-4f57-952b-3d398b9ef338 while it is in vm_state rescued Apr 11 19:50:09.762643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Returning 409 to user: Cannot 'attach_volume' instance 5e337b2e-3267-4f57-952b-3d398b9ef338 while it is in vm_state rescued {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:50:09.763669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d73ccc2a-ebac-4221-8c82-a4efc9535459 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052516 Apr 11 19:50:09.768413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 180/343] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 19:50:09 2022] POST /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 19:50:09.778437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-07e0e15b-411e-479a-bb0d-5254093e33bf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:09.779212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-07e0e15b-411e-479a-bb0d-5254093e33bf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:09.787321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07e0e15b-411e-479a-bb0d-5254093e33bf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.788287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07e0e15b-411e-479a-bb0d-5254093e33bf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.789328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07e0e15b-411e-479a-bb0d-5254093e33bf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.790059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07e0e15b-411e-479a-bb0d-5254093e33bf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.836366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-909e280e-7bb5-43ae-bf4f-aa286a7224cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:09.844638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-909e280e-7bb5-43ae-bf4f-aa286a7224cb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.353547 Apr 11 19:50:09.845332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 164/344] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:09.886502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-07e0e15b-411e-479a-bb0d-5254093e33bf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338/action" status: 202 len: 0 microversion: 2.1 time: 0.115326 Apr 11 19:50:09.891382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 181/345] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 19:50:09 2022] POST /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:50:09.893728 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-389d99f7-33e7-46fe-bc23-4da34ed5880c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:09.894351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-389d99f7-33e7-46fe-bc23-4da34ed5880c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:09.899587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2ec7ae75-09ce-4fb1-bfb8-967d4c7deaec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:09.900397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2ec7ae75-09ce-4fb1-bfb8-967d4c7deaec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:09.900566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-389d99f7-33e7-46fe-bc23-4da34ed5880c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.900946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-389d99f7-33e7-46fe-bc23-4da34ed5880c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.901848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-389d99f7-33e7-46fe-bc23-4da34ed5880c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.902285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-389d99f7-33e7-46fe-bc23-4da34ed5880c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.915447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ec7ae75-09ce-4fb1-bfb8-967d4c7deaec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.915911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ec7ae75-09ce-4fb1-bfb8-967d4c7deaec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:09.917068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ec7ae75-09ce-4fb1-bfb8-967d4c7deaec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:09.917664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ec7ae75-09ce-4fb1-bfb8-967d4c7deaec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:10.167627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-389d99f7-33e7-46fe-bc23-4da34ed5880c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:10.177707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-389d99f7-33e7-46fe-bc23-4da34ed5880c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.288188 Apr 11 19:50:10.178408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 165/346] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:09 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:10.217852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2ec7ae75-09ce-4fb1-bfb8-967d4c7deaec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:10.227660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2ec7ae75-09ce-4fb1-bfb8-967d4c7deaec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1509 microversion: 2.1 time: 0.332842 Apr 11 19:50:10.228337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 182/347] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:09 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1509 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:10.608879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:10.609421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:10.617424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:10.618086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:10.636968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:10.638097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:10.785831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:10.797117 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:10.799018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:10.800034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5a02db92-3658-43db-9536-f9d0cd309209 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1744 microversion: 2.20 time: 0.196474 Apr 11 19:50:10.800593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 166/348] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1744 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:10.862263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef1f74a8-b8f8-4bfe-a02e-0c341c54f511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:10.862905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef1f74a8-b8f8-4bfe-a02e-0c341c54f511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:10.869081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef1f74a8-b8f8-4bfe-a02e-0c341c54f511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:10.869521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef1f74a8-b8f8-4bfe-a02e-0c341c54f511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:10.870285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef1f74a8-b8f8-4bfe-a02e-0c341c54f511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:10.870715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef1f74a8-b8f8-4bfe-a02e-0c341c54f511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.023152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef1f74a8-b8f8-4bfe-a02e-0c341c54f511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:11.035712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef1f74a8-b8f8-4bfe-a02e-0c341c54f511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.177188 Apr 11 19:50:11.036353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 183/349] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:11.196271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-faedf696-6e48-44fa-acfc-58a39db84ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:11.197087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-faedf696-6e48-44fa-acfc-58a39db84ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:11.203678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-faedf696-6e48-44fa-acfc-58a39db84ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.204099 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-faedf696-6e48-44fa-acfc-58a39db84ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.204925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-faedf696-6e48-44fa-acfc-58a39db84ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.205476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-faedf696-6e48-44fa-acfc-58a39db84ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.248390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc4a0e4d-25bd-4c37-ac7d-bc21d899cca4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:11.250285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc4a0e4d-25bd-4c37-ac7d-bc21d899cca4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:11.260645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc4a0e4d-25bd-4c37-ac7d-bc21d899cca4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.261223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc4a0e4d-25bd-4c37-ac7d-bc21d899cca4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.262047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc4a0e4d-25bd-4c37-ac7d-bc21d899cca4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.262483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc4a0e4d-25bd-4c37-ac7d-bc21d899cca4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.405025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-faedf696-6e48-44fa-acfc-58a39db84ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:11.414688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-faedf696-6e48-44fa-acfc-58a39db84ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.222832 Apr 11 19:50:11.427200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 167/350] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:11 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:11.455952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc4a0e4d-25bd-4c37-ac7d-bc21d899cca4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:11.468817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc4a0e4d-25bd-4c37-ac7d-bc21d899cca4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1509 microversion: 2.1 time: 0.224665 Apr 11 19:50:11.469663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 184/351] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:11 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:11.701617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-538ab908-9052-462c-90fa-dfec3ee717d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:11.702286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-538ab908-9052-462c-90fa-dfec3ee717d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:11.710233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-538ab908-9052-462c-90fa-dfec3ee717d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.710680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-538ab908-9052-462c-90fa-dfec3ee717d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.711472 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-538ab908-9052-462c-90fa-dfec3ee717d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.711892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-538ab908-9052-462c-90fa-dfec3ee717d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.745597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-538ab908-9052-462c-90fa-dfec3ee717d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 19:50:11.822115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:11.823341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:11.831320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.832563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.834078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.834678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.837352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-538ab908-9052-462c-90fa-dfec3ee717d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 204 len: 0 microversion: 2.1 time: 0.139061 Apr 11 19:50:11.838012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 168/352] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 19:50:11 2022] DELETE /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:50:11.847404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70557576-19b0-4767-ae33-58d651495fa9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:11.848214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70557576-19b0-4767-ae33-58d651495fa9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:11.855338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70557576-19b0-4767-ae33-58d651495fa9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.855893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70557576-19b0-4767-ae33-58d651495fa9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:11.856840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70557576-19b0-4767-ae33-58d651495fa9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:11.858079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70557576-19b0-4767-ae33-58d651495fa9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:12.105423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:12.115894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:12.117504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:12.118674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70557576-19b0-4767-ae33-58d651495fa9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:12.119254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a95a74f1-294f-4aa0-8eea-f142c0084b22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1744 microversion: 2.20 time: 0.303061 Apr 11 19:50:12.120268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 185/353] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1744 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:12.126364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c49e2c6-0cb1-45e9-9cc7-8a4f5d3e7f6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:12.126962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4c49e2c6-0cb1-45e9-9cc7-8a4f5d3e7f6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:12.127108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70557576-19b0-4767-ae33-58d651495fa9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1513 microversion: 2.1 time: 0.283820 Apr 11 19:50:12.127562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 169/354] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:11 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:12.145799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c49e2c6-0cb1-45e9-9cc7-8a4f5d3e7f6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:12.146350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c49e2c6-0cb1-45e9-9cc7-8a4f5d3e7f6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:12.147149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c49e2c6-0cb1-45e9-9cc7-8a4f5d3e7f6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:12.153976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c49e2c6-0cb1-45e9-9cc7-8a4f5d3e7f6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:12.366623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4c49e2c6-0cb1-45e9-9cc7-8a4f5d3e7f6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:12.379493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c49e2c6-0cb1-45e9-9cc7-8a4f5d3e7f6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.256687 Apr 11 19:50:12.395190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 186/355] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:12.441890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c21cd6f8-cfaf-46d3-9484-82d7bdcd082b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:12.442882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c21cd6f8-cfaf-46d3-9484-82d7bdcd082b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:12.457393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c21cd6f8-cfaf-46d3-9484-82d7bdcd082b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:12.457926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c21cd6f8-cfaf-46d3-9484-82d7bdcd082b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:12.458915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c21cd6f8-cfaf-46d3-9484-82d7bdcd082b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:12.460989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c21cd6f8-cfaf-46d3-9484-82d7bdcd082b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:12.487641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2eb9136f-ecb4-4009-8c41-d4cdb9a7beea tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:12.488587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2eb9136f-ecb4-4009-8c41-d4cdb9a7beea tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:12.495829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb9136f-ecb4-4009-8c41-d4cdb9a7beea tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:12.507755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb9136f-ecb4-4009-8c41-d4cdb9a7beea tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:12.508664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb9136f-ecb4-4009-8c41-d4cdb9a7beea tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:12.510145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb9136f-ecb4-4009-8c41-d4cdb9a7beea tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:12.684131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c21cd6f8-cfaf-46d3-9484-82d7bdcd082b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:12.695285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c21cd6f8-cfaf-46d3-9484-82d7bdcd082b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.259954 Apr 11 19:50:12.697030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 170/356] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:12 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:12.767924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2eb9136f-ecb4-4009-8c41-d4cdb9a7beea tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:12.779530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2eb9136f-ecb4-4009-8c41-d4cdb9a7beea tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1509 microversion: 2.1 time: 0.295828 Apr 11 19:50:12.781336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 187/357] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:12 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:13.149669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:13.151101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:13.151376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-70fef00b-ab30-4bdd-ae3a-f36e0742e32f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:13.152252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-70fef00b-ab30-4bdd-ae3a-f36e0742e32f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:13.159330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.160765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70fef00b-ab30-4bdd-ae3a-f36e0742e32f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.161449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70fef00b-ab30-4bdd-ae3a-f36e0742e32f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.161659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.162446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.162873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70fef00b-ab30-4bdd-ae3a-f36e0742e32f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.162995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.163571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70fef00b-ab30-4bdd-ae3a-f36e0742e32f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.445864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-70fef00b-ab30-4bdd-ae3a-f36e0742e32f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:13.448971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:13.454813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-70fef00b-ab30-4bdd-ae3a-f36e0742e32f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1513 microversion: 2.1 time: 0.309199 Apr 11 19:50:13.464364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:13.464364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:13.464364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-94188cd0-b1a3-47a1-bb9e-f52c1e74d700 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1744 microversion: 2.20 time: 0.315480 Apr 11 19:50:13.464773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 171/358] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1744 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:13.465417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 188/359] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:13 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:13.468653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e80a1814-5777-4627-948a-935ac63f6009 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:13.469300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e80a1814-5777-4627-948a-935ac63f6009 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:13.475220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e80a1814-5777-4627-948a-935ac63f6009 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.475655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e80a1814-5777-4627-948a-935ac63f6009 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.476421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e80a1814-5777-4627-948a-935ac63f6009 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.476840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e80a1814-5777-4627-948a-935ac63f6009 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.642735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e80a1814-5777-4627-948a-935ac63f6009 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:13.656779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e80a1814-5777-4627-948a-935ac63f6009 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.193983 Apr 11 19:50:13.657462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 172/360] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:13.716476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e0b48d5-9148-47e5-aa4c-7109d3f929c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:13.717163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e0b48d5-9148-47e5-aa4c-7109d3f929c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:13.726637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e0b48d5-9148-47e5-aa4c-7109d3f929c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.726637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e0b48d5-9148-47e5-aa4c-7109d3f929c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.727311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e0b48d5-9148-47e5-aa4c-7109d3f929c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.727761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e0b48d5-9148-47e5-aa4c-7109d3f929c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.801783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-880f3b9e-0394-4500-ac69-76431daf6395 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:13.802785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-880f3b9e-0394-4500-ac69-76431daf6395 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:13.822264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-880f3b9e-0394-4500-ac69-76431daf6395 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.822715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-880f3b9e-0394-4500-ac69-76431daf6395 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.823575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-880f3b9e-0394-4500-ac69-76431daf6395 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:13.823947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-880f3b9e-0394-4500-ac69-76431daf6395 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:13.949761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e0b48d5-9148-47e5-aa4c-7109d3f929c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:13.961078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e0b48d5-9148-47e5-aa4c-7109d3f929c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1366 microversion: 2.1 time: 0.249169 Apr 11 19:50:13.962013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 189/361] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:13 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:14.034743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-880f3b9e-0394-4500-ac69-76431daf6395 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:14.047284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-880f3b9e-0394-4500-ac69-76431daf6395 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1509 microversion: 2.1 time: 0.253090 Apr 11 19:50:14.047876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 173/362] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:13 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:14.390289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-2690e7e2-78de-48fe-966e-fce267930247 req-b7fb1a96-1b32-4e62-984b-b53d660d462b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6aea71-8b17-46b8-ab07-b42b41b573a5", "name": "network-vif-plugged", "status": "completed", "tag": "043741af-b872-498e-a793-2860d820736a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:14.416366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-2690e7e2-78de-48fe-966e-fce267930247 req-b7fb1a96-1b32-4e62-984b-b53d660d462b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:14.419089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-2690e7e2-78de-48fe-966e-fce267930247 req-b7fb1a96-1b32-4e62-984b-b53d660d462b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:14.438165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-2690e7e2-78de-48fe-966e-fce267930247 req-b7fb1a96-1b32-4e62-984b-b53d660d462b service nova] Creating event network-vif-plugged:043741af-b872-498e-a793-2860d820736a for instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 on hv-cinder-83078 Apr 11 19:50:14.443449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-2690e7e2-78de-48fe-966e-fce267930247 req-b7fb1a96-1b32-4e62-984b-b53d660d462b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063283 Apr 11 19:50:14.444082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 190/363] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:14.474643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5511e719-7a3c-4d6c-907f-f27b4529c69b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:14.476327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5511e719-7a3c-4d6c-907f-f27b4529c69b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:14.480540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:14.481310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:14.485492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5511e719-7a3c-4d6c-907f-f27b4529c69b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:14.486238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5511e719-7a3c-4d6c-907f-f27b4529c69b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:14.487211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5511e719-7a3c-4d6c-907f-f27b4529c69b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:14.487882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5511e719-7a3c-4d6c-907f-f27b4529c69b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:14.494762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:14.495209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:14.495999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:14.496422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:15.084543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5511e719-7a3c-4d6c-907f-f27b4529c69b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:15.092674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5511e719-7a3c-4d6c-907f-f27b4529c69b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1513 microversion: 2.1 time: 0.623990 Apr 11 19:50:15.096107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 174/364] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:14 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1513 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:15.111932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d759ff4-4f28-4cb4-8090-56e06e1a7f7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:15.112972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6d759ff4-4f28-4cb4-8090-56e06e1a7f7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:15.122225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:15.134425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d759ff4-4f28-4cb4-8090-56e06e1a7f7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:15.152256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:15.153310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d759ff4-4f28-4cb4-8090-56e06e1a7f7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:15.157460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d759ff4-4f28-4cb4-8090-56e06e1a7f7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:15.159974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d759ff4-4f28-4cb4-8090-56e06e1a7f7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:15.163730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:15.167543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-15e001ce-0636-4bf7-953e-7d6db38d627a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1744 microversion: 2.20 time: 0.691273 Apr 11 19:50:15.168850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 191/365] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1744 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:15.190740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0bb44be-e863-4cd0-b6c4-6fd68c583926 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:15.206354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0bb44be-e863-4cd0-b6c4-6fd68c583926 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:15.227069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0bb44be-e863-4cd0-b6c4-6fd68c583926 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:15.232650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0bb44be-e863-4cd0-b6c4-6fd68c583926 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:15.233859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0bb44be-e863-4cd0-b6c4-6fd68c583926 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:15.234478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0bb44be-e863-4cd0-b6c4-6fd68c583926 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:15.735786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0bb44be-e863-4cd0-b6c4-6fd68c583926 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:15.755309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6d759ff4-4f28-4cb4-8090-56e06e1a7f7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:15.755940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0bb44be-e863-4cd0-b6c4-6fd68c583926 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1557 microversion: 2.1 time: 0.584640 Apr 11 19:50:15.757171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 192/366] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:15 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1557 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:15.762142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-07728517-f90d-4d61-9ffb-34e41c83a46a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:15.763085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-07728517-f90d-4d61-9ffb-34e41c83a46a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:15.774200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07728517-f90d-4d61-9ffb-34e41c83a46a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:15.775070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07728517-f90d-4d61-9ffb-34e41c83a46a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:15.776073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07728517-f90d-4d61-9ffb-34e41c83a46a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:15.776713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07728517-f90d-4d61-9ffb-34e41c83a46a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:15.781128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6d759ff4-4f28-4cb4-8090-56e06e1a7f7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.681578 Apr 11 19:50:15.791425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 175/367] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:15.835754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d55b7673-08b0-4df9-8f14-6b76aab52c4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:15.836268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d55b7673-08b0-4df9-8f14-6b76aab52c4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:15.858430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d55b7673-08b0-4df9-8f14-6b76aab52c4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:15.858919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d55b7673-08b0-4df9-8f14-6b76aab52c4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:15.859772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d55b7673-08b0-4df9-8f14-6b76aab52c4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:15.860295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d55b7673-08b0-4df9-8f14-6b76aab52c4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:16.138728 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d55b7673-08b0-4df9-8f14-6b76aab52c4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.352973 Apr 11 19:50:16.145385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 176/368] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Apr 11 19:50:15 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49/os-interface => generated 285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:16.150215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee2c5c29-b91b-4984-a056-e88c15893df9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:16.155980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee2c5c29-b91b-4984-a056-e88c15893df9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:16.179277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee2c5c29-b91b-4984-a056-e88c15893df9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:16.179904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee2c5c29-b91b-4984-a056-e88c15893df9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:16.182058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee2c5c29-b91b-4984-a056-e88c15893df9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:16.183187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee2c5c29-b91b-4984-a056-e88c15893df9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:16.451556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-07728517-f90d-4d61-9ffb-34e41c83a46a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:16.468856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-07728517-f90d-4d61-9ffb-34e41c83a46a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1509 microversion: 2.1 time: 0.702300 Apr 11 19:50:16.469906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 193/369] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:15 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1509 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:16.475805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:16.481271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:16.505953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:16.506912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:16.507895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:16.508512 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:17.051444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee2c5c29-b91b-4984-a056-e88c15893df9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:17.060307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee2c5c29-b91b-4984-a056-e88c15893df9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1513 microversion: 2.1 time: 0.918878 Apr 11 19:50:17.064512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 177/370] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:16 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1513 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:17.069821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-069679e1-4d6f-4d74-8626-369002aef67c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:17.082361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-069679e1-4d6f-4d74-8626-369002aef67c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:17.116478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-069679e1-4d6f-4d74-8626-369002aef67c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:17.117534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-069679e1-4d6f-4d74-8626-369002aef67c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:17.118682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-069679e1-4d6f-4d74-8626-369002aef67c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:17.119386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-069679e1-4d6f-4d74-8626-369002aef67c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:17.273811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:17.292366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:17.303007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:17.304809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4405fc4b-bd01-4889-b4f5-138e644c47e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.833751 Apr 11 19:50:17.309092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 194/371] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:17.338272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-2ddac882-a498-451d-8502-dbb874faf94a req-a995e8bb-4186-42e5-a2a6-b03e40eecb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58fd1a5-0f59-4337-85ac-8d9f2969aeb4", "name": "network-vif-deleted", "tag": "8831ee5a-2f6b-4fe4-8f04-3e143842ecf0"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:17.352525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-2ddac882-a498-451d-8502-dbb874faf94a req-a995e8bb-4186-42e5-a2a6-b03e40eecb9f service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:17.353469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-2ddac882-a498-451d-8502-dbb874faf94a req-a995e8bb-4186-42e5-a2a6-b03e40eecb9f service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:17.378605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-2ddac882-a498-451d-8502-dbb874faf94a req-a995e8bb-4186-42e5-a2a6-b03e40eecb9f service nova] Creating event network-vif-deleted:8831ee5a-2f6b-4fe4-8f04-3e143842ecf0 for instance a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 on hv-cinder-83078 Apr 11 19:50:17.389208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-2ddac882-a498-451d-8502-dbb874faf94a req-a995e8bb-4186-42e5-a2a6-b03e40eecb9f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071580 Apr 11 19:50:17.394510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 195/372] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:17.487137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f404b477-434e-48a6-a58d-83c998b84b85 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:17.488252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f404b477-434e-48a6-a58d-83c998b84b85 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:17.500116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f404b477-434e-48a6-a58d-83c998b84b85 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:17.500567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f404b477-434e-48a6-a58d-83c998b84b85 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:17.501386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f404b477-434e-48a6-a58d-83c998b84b85 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:17.501827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f404b477-434e-48a6-a58d-83c998b84b85 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:18.384817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-069679e1-4d6f-4d74-8626-369002aef67c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:18.392624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-069679e1-4d6f-4d74-8626-369002aef67c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 1.326800 Apr 11 19:50:18.393235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 178/373] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:18.414875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:18.415976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:18.433669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:18.434466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:18.435470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:18.436085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:18.520279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:18.520839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:18.521360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'fault' on Instance uuid a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:50:18.548552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f404b477-434e-48a6-a58d-83c998b84b85 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:18.556690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f404b477-434e-48a6-a58d-83c998b84b85 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1509 microversion: 2.1 time: 1.073980 Apr 11 19:50:18.567504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 196/374] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:17 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1509 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:18.581072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:18.582150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:18.589811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:18.590692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:18.591885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:18.592575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:18.664562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:18.676257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee22d87c-5e25-49d5-b168-a89a33182c6a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 200 len: 1309 microversion: 2.1 time: 0.281973 Apr 11 19:50:18.677161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 179/375] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:18 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 1309 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:19.050043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:19.058872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:19.060483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:19.061772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-84a15642-a6b9-4655-9cca-63eb2a1160f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.492729 Apr 11 19:50:19.072957 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 197/376] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:19.411026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e8daca2c-5976-4739-bff2-d1cbd98f3be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:19.412469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e8daca2c-5976-4739-bff2-d1cbd98f3be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:19.419848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8daca2c-5976-4739-bff2-d1cbd98f3be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:19.420683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8daca2c-5976-4739-bff2-d1cbd98f3be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:19.421742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8daca2c-5976-4739-bff2-d1cbd98f3be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:19.422392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8daca2c-5976-4739-bff2-d1cbd98f3be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:19.574635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df57c21e-43e6-41f2-bfef-2def223b217f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:19.575916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df57c21e-43e6-41f2-bfef-2def223b217f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:19.593254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df57c21e-43e6-41f2-bfef-2def223b217f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:19.594007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df57c21e-43e6-41f2-bfef-2def223b217f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:19.594858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df57c21e-43e6-41f2-bfef-2def223b217f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:19.595299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df57c21e-43e6-41f2-bfef-2def223b217f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:20.306972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e8daca2c-5976-4739-bff2-d1cbd98f3be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:20.320758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e8daca2c-5976-4739-bff2-d1cbd98f3be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.913979 Apr 11 19:50:20.321683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 180/377] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:20.351988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:20.352423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: a58fd1a5-0f59-4337-85ac-8d9f2969aeb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:20.356229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df57c21e-43e6-41f2-bfef-2def223b217f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:20.373322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:20.373773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:20.374558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:20.375013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df57c21e-43e6-41f2-bfef-2def223b217f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1509 microversion: 2.1 time: 0.801969 Apr 11 19:50:20.375333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:20.382520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 198/378] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:19 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1509 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:20.415216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:20.418990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:20.444992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:20.445447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:20.446287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:20.446463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] HTTP exception thrown: Instance a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 could not be found. Apr 11 19:50:20.446997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Returning 404 to user: Instance a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:50:20.448023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-203de8f1-bddb-4c1b-94ab-2b11fcf86ccf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4" status: 404 len: 111 microversion: 2.1 time: 0.125313 Apr 11 19:50:20.449298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 181/379] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:20 2022] GET /compute/v2.1/servers/a58fd1a5-0f59-4337-85ac-8d9f2969aeb4 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 19:50:20.454798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:20.463440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-17078d7f-35df-40d2-80fe-dfa23780579d req-fde07a76-9927-467c-a500-2fab6c8d4824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99731dc4-4495-4be7-88d0-764f481cab49", "tag": "60530c96-56a5-4c58-a966-719dd5fccd75"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:20.495612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-17078d7f-35df-40d2-80fe-dfa23780579d req-fde07a76-9927-467c-a500-2fab6c8d4824 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:20.500947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-17078d7f-35df-40d2-80fe-dfa23780579d req-fde07a76-9927-467c-a500-2fab6c8d4824 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:20.532011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-17078d7f-35df-40d2-80fe-dfa23780579d req-fde07a76-9927-467c-a500-2fab6c8d4824 service nova] Creating event network-changed:60530c96-56a5-4c58-a966-719dd5fccd75 for instance 99731dc4-4495-4be7-88d0-764f481cab49 on hv-cinder-83078 Apr 11 19:50:20.572115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-17078d7f-35df-40d2-80fe-dfa23780579d req-fde07a76-9927-467c-a500-2fab6c8d4824 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112559 Apr 11 19:50:20.572841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 182/380] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:20.968471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:20.984376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:20.996877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:21.002776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82ee9b2e-3c96-4d6e-889b-9cdfd38612b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.616453 Apr 11 19:50:21.012498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 199/381] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:21.348814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5c627bda-7575-49d8-a5ed-9a14520d2151 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:21.351442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5c627bda-7575-49d8-a5ed-9a14520d2151 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:21.362538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c627bda-7575-49d8-a5ed-9a14520d2151 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:21.363270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c627bda-7575-49d8-a5ed-9a14520d2151 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:21.364213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c627bda-7575-49d8-a5ed-9a14520d2151 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:21.364795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c627bda-7575-49d8-a5ed-9a14520d2151 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:21.400341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f203f4ad-f9f3-43e6-b731-90dcd71e1615 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:21.401168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f203f4ad-f9f3-43e6-b731-90dcd71e1615 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:21.411267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f203f4ad-f9f3-43e6-b731-90dcd71e1615 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:21.413827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f203f4ad-f9f3-43e6-b731-90dcd71e1615 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:21.414849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f203f4ad-f9f3-43e6-b731-90dcd71e1615 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:21.417360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f203f4ad-f9f3-43e6-b731-90dcd71e1615 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:21.697529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5c627bda-7575-49d8-a5ed-9a14520d2151 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:21.706866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5c627bda-7575-49d8-a5ed-9a14520d2151 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.371075 Apr 11 19:50:21.710016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 183/382] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:21.754829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f203f4ad-f9f3-43e6-b731-90dcd71e1615 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:21.762899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f203f4ad-f9f3-43e6-b731-90dcd71e1615 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1515 microversion: 2.1 time: 0.366868 Apr 11 19:50:21.773784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 200/383] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:21 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:22.021908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:22.022702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:22.031682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:22.033919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:22.035332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:22.035990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:22.380679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:22.390063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:22.398159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:22.402589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d946369c-8d70-414f-ab6e-3105a1299c01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.385317 Apr 11 19:50:22.405208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 184/384] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:22.727423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2adf7e55-e038-4461-b900-92b01780f701 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:22.728694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2adf7e55-e038-4461-b900-92b01780f701 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:22.738990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2adf7e55-e038-4461-b900-92b01780f701 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:22.744078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2adf7e55-e038-4461-b900-92b01780f701 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:22.745174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2adf7e55-e038-4461-b900-92b01780f701 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:22.746058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2adf7e55-e038-4461-b900-92b01780f701 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:23.001024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2adf7e55-e038-4461-b900-92b01780f701 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:23.017369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2adf7e55-e038-4461-b900-92b01780f701 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.290367 Apr 11 19:50:23.018630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 201/385] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:23.425564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:23.426754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:23.436561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:23.437053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:23.437901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:23.443173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:24.007171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:24.020391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:24.022266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:24.026202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-34fe4d57-927f-4eb5-b781-d40e30c3c29c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.606259 Apr 11 19:50:24.029143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 185/386] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:24.048371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-882b98d2-ac65-4d36-90da-73be0c078ded tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:24.049068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-882b98d2-ac65-4d36-90da-73be0c078ded tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:24.064810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-882b98d2-ac65-4d36-90da-73be0c078ded tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:24.065212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-882b98d2-ac65-4d36-90da-73be0c078ded tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:24.073280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-882b98d2-ac65-4d36-90da-73be0c078ded tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:24.073938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-882b98d2-ac65-4d36-90da-73be0c078ded tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:24.579697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-882b98d2-ac65-4d36-90da-73be0c078ded tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:24.593158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-882b98d2-ac65-4d36-90da-73be0c078ded tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.548668 Apr 11 19:50:24.594016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 202/387] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:25.050646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:25.051985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:25.060788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:25.061271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:25.062064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:25.062494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:25.520761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9454625a-4aaa-4c96-a4a6-63261618a2d5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'create', calling method: .version_select at 0x7f40877f5430>, body: {"keypair": {"name": "tempest-keypair-1729070753"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:25.563083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-9454625a-4aaa-4c96-a4a6-63261618a2d5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for project 97f4cd9fe29043878982a24319784c47. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:50:25.575032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-9454625a-4aaa-4c96-a4a6-63261618a2d5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for user cc87368fa6c24e50b4214a57d6783530 and project 97f4cd9fe29043878982a24319784c47. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:50:25.607287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:25.616882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:25.618482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:25.623204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b7595f4a-502c-40e0-8c5b-e3a7f41e2080 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.576381 Apr 11 19:50:25.624346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 186/388] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:25.632532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b7c7ded3-7717-4b54-b658-2e90045f8363 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:25.634568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b7c7ded3-7717-4b54-b658-2e90045f8363 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:25.652185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7c7ded3-7717-4b54-b658-2e90045f8363 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:25.653181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7c7ded3-7717-4b54-b658-2e90045f8363 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:25.654421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7c7ded3-7717-4b54-b658-2e90045f8363 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:25.655161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7c7ded3-7717-4b54-b658-2e90045f8363 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:26.215311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-9454625a-4aaa-4c96-a4a6-63261618a2d5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for project 97f4cd9fe29043878982a24319784c47. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:50:26.225804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-9454625a-4aaa-4c96-a4a6-63261618a2d5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for user cc87368fa6c24e50b4214a57d6783530 and project 97f4cd9fe29043878982a24319784c47. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:50:26.247335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9454625a-4aaa-4c96-a4a6-63261618a2d5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.731841 Apr 11 19:50:26.248239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 203/389] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 19:50:25 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:26.665615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:26.668566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:26.694663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:26.695590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:26.710005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:26.711369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:26.926480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b7c7ded3-7717-4b54-b658-2e90045f8363 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:26.934570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b7c7ded3-7717-4b54-b658-2e90045f8363 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 1.307590 Apr 11 19:50:26.945295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 187/390] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:27.032369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-ed5e1045-b747-4381-82a1-af60803e5024 req-dee3828e-9ae2-494b-bf2e-b53181e7204b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f85f237-46f1-47d2-badc-2e3cffe85c90", "name": "network-vif-plugged", "status": "completed", "tag": "6932f8ee-b8ec-4779-99f0-59715534dce0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:27.048971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ed5e1045-b747-4381-82a1-af60803e5024 req-dee3828e-9ae2-494b-bf2e-b53181e7204b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:27.052409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ed5e1045-b747-4381-82a1-af60803e5024 req-dee3828e-9ae2-494b-bf2e-b53181e7204b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:27.092262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-ed5e1045-b747-4381-82a1-af60803e5024 req-dee3828e-9ae2-494b-bf2e-b53181e7204b service nova] Creating event network-vif-plugged:6932f8ee-b8ec-4779-99f0-59715534dce0 for instance 4f85f237-46f1-47d2-badc-2e3cffe85c90 on hv-cinder-83078 Apr 11 19:50:27.125623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-ed5e1045-b747-4381-82a1-af60803e5024 req-dee3828e-9ae2-494b-bf2e-b53181e7204b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096447 Apr 11 19:50:27.131924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 188/391] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:27.425870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:27.438871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:27.443155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:27.446557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f8e04856-492b-4a65-b91e-ef4e014e34c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.801941 Apr 11 19:50:27.460128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 204/392] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:27.952537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff8be54e-f90e-4a89-970d-08f0ea248844 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:27.953904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff8be54e-f90e-4a89-970d-08f0ea248844 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:27.960861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8be54e-f90e-4a89-970d-08f0ea248844 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:27.961928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8be54e-f90e-4a89-970d-08f0ea248844 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:27.962969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8be54e-f90e-4a89-970d-08f0ea248844 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:27.963599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8be54e-f90e-4a89-970d-08f0ea248844 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:28.222579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff8be54e-f90e-4a89-970d-08f0ea248844 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:28.234451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff8be54e-f90e-4a89-970d-08f0ea248844 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.286656 Apr 11 19:50:28.246607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 189/393] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:28.469730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:28.471126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:28.513456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:28.516950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:28.528401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:28.529744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:28.866004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:28.878696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:28.881728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:28.887394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-557d1cf0-888f-4b70-be92-e301e0ac35c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.422668 Apr 11 19:50:28.901759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 205/394] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:29.266973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8503b047-7a6c-4c07-a31d-9c7beeb20113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:29.268070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8503b047-7a6c-4c07-a31d-9c7beeb20113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:29.312804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8503b047-7a6c-4c07-a31d-9c7beeb20113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:29.315666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8503b047-7a6c-4c07-a31d-9c7beeb20113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:29.317190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8503b047-7a6c-4c07-a31d-9c7beeb20113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:29.325197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8503b047-7a6c-4c07-a31d-9c7beeb20113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:29.616050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-382513664", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99b55c31-7554-467c-91cc-9b60db5d7cec"}], "security_groups": [{"name": "tempest-securitygroup--2135538343"}], "key_name": "tempest-keypair-1729070753", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:29.622337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8503b047-7a6c-4c07-a31d-9c7beeb20113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:29.637840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8503b047-7a6c-4c07-a31d-9c7beeb20113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.387799 Apr 11 19:50:29.641033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 190/395] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:29.805007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] validate_networks() for [('99b55c31-7554-467c-91cc-9b60db5d7cec', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:50:29.905933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:29.907328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:29.924138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:29.927171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:29.932487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:29.935833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:30.587662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:30.596142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:30.600797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:30.602052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a29644b-633b-4037-9b92-a9ffdea64000 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.700033 Apr 11 19:50:30.602694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 191/396] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:30.618805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1330963418", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "networks": [{"uuid": "403e412b-2ece-4ae4-8456-d4543cf343c1"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:30.692400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] validate_networks() for [('403e412b-2ece-4ae4-8456-d4543cf343c1', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:50:31.666921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:50:31.667481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:50:31.667808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:50:31.668392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:50:31.669747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:50:31.694465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:31.694914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:31.695703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:31.696123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:31.730495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for project 97f4cd9fe29043878982a24319784c47. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:50:31.736001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Getting quotas for user cc87368fa6c24e50b4214a57d6783530 and project 97f4cd9fe29043878982a24319784c47. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:50:31.790903 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:50:31.796328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:50:31.905249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-99863ed6-59f6-47af-af9d-514289daa8ec tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.304623 Apr 11 19:50:31.921882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 206/397] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:50:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 2322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:50:31.927864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-197113c8-0ff1-4566-863a-02b1ac5d341f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:31.929339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-197113c8-0ff1-4566-863a-02b1ac5d341f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:31.938351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-197113c8-0ff1-4566-863a-02b1ac5d341f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:31.939187 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-197113c8-0ff1-4566-863a-02b1ac5d341f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:31.941566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-197113c8-0ff1-4566-863a-02b1ac5d341f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:31.942257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-197113c8-0ff1-4566-863a-02b1ac5d341f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:32.066269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:50:32.071818 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:50:32.073088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:50:32.074273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:50:32.079383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:50:32.092675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:32.093146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:32.093945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:32.094377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:32.116898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Getting quotas for project 5a4efeb8e17b4f9daa20a62fad70daa1. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:50:32.122480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Getting quotas for user a27238068e724556bf6f5b3d6ee5e721 and project 5a4efeb8e17b4f9daa20a62fad70daa1. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:50:32.135288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:50:32.138324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:50:32.262561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-be877e71-fca4-4920-8816-cd6e848303a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646475 Apr 11 19:50:32.263698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 192/398] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:50:32.269305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:32.271421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:32.279235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:32.280524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:32.281916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:32.292945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:32.537902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-197113c8-0ff1-4566-863a-02b1ac5d341f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:32.546103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-197113c8-0ff1-4566-863a-02b1ac5d341f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.622520 Apr 11 19:50:32.546696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 207/399] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:32.572330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7aa1d263-3391-4e76-b2a3-1246f8a1f8c2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:32.572978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7aa1d263-3391-4e76-b2a3-1246f8a1f8c2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:32.639644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:32.652725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:32.666070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:32.677953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5d812d9a-9705-483d-8697-642177c78e1b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.402602 Apr 11 19:50:32.689607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 193/400] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:32.697629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-06fdd63b-0b89-41a1-96e8-05c0aeaaba7e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:32.698251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-06fdd63b-0b89-41a1-96e8-05c0aeaaba7e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:32.786420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7aa1d263-3391-4e76-b2a3-1246f8a1f8c2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:32.797225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7aa1d263-3391-4e76-b2a3-1246f8a1f8c2 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1245 microversion: 2.1 time: 0.243982 Apr 11 19:50:32.799580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 208/401] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:32 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1245 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:32.884285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-06fdd63b-0b89-41a1-96e8-05c0aeaaba7e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:32.894074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-06fdd63b-0b89-41a1-96e8-05c0aeaaba7e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1219 microversion: 2.1 time: 0.199187 Apr 11 19:50:32.896431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 194/402] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:32 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:33.302373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e72d865-53d5-44dd-a95a-9bcebc3ee4bf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Action: 'create', calling method: .version_select at 0x7f40877f53a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1088380937"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:33.332800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-9e72d865-53d5-44dd-a95a-9bcebc3ee4bf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Getting quotas for project 0666647cc4f0410a90947d91ddbccf87. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:50:33.341798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-9e72d865-53d5-44dd-a95a-9bcebc3ee4bf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Getting quotas for user bef6c7d7ab9a47d4bb332b73e60ce67c and project 0666647cc4f0410a90947d91ddbccf87. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:50:33.519409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-9e72d865-53d5-44dd-a95a-9bcebc3ee4bf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Getting quotas for project 0666647cc4f0410a90947d91ddbccf87. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:50:33.524137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-9e72d865-53d5-44dd-a95a-9bcebc3ee4bf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Getting quotas for user bef6c7d7ab9a47d4bb332b73e60ce67c and project 0666647cc4f0410a90947d91ddbccf87. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:50:33.538362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e72d865-53d5-44dd-a95a-9bcebc3ee4bf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.599340 Apr 11 19:50:33.539303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 209/403] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 19:50:32 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:33.563159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-39a91f8f-cff9-4d2a-b54f-137e7ee69b9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:33.563767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-39a91f8f-cff9-4d2a-b54f-137e7ee69b9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:33.571134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39a91f8f-cff9-4d2a-b54f-137e7ee69b9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:33.571869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39a91f8f-cff9-4d2a-b54f-137e7ee69b9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:33.572936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39a91f8f-cff9-4d2a-b54f-137e7ee69b9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:33.573362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39a91f8f-cff9-4d2a-b54f-137e7ee69b9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:33.698029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:33.698645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:33.705906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:33.706357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:33.707127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:33.707556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:33.986631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-39a91f8f-cff9-4d2a-b54f-137e7ee69b9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:34.003652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-39a91f8f-cff9-4d2a-b54f-137e7ee69b9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1359 microversion: 2.1 time: 0.442616 Apr 11 19:50:34.015189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 195/404] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1359 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:34.021014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-14a5e084-dfca-4967-b9c2-96376e14affe tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:34.021619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-14a5e084-dfca-4967-b9c2-96376e14affe tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:34.029265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14a5e084-dfca-4967-b9c2-96376e14affe tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:34.029916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14a5e084-dfca-4967-b9c2-96376e14affe tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:34.031799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14a5e084-dfca-4967-b9c2-96376e14affe tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:34.032537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14a5e084-dfca-4967-b9c2-96376e14affe tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:34.064715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:34.077903 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:34.079566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:34.080770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e21c9b12-bbbd-4118-8649-0e1767f1e69f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.387214 Apr 11 19:50:34.087959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 210/405] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:34.100754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ee753ed-aa6b-41e9-9615-d65429e6018e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:34.101844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ee753ed-aa6b-41e9-9615-d65429e6018e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:34.112546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ee753ed-aa6b-41e9-9615-d65429e6018e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:34.114183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ee753ed-aa6b-41e9-9615-d65429e6018e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:34.115597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ee753ed-aa6b-41e9-9615-d65429e6018e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:34.116196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ee753ed-aa6b-41e9-9615-d65429e6018e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:34.129084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-14a5e084-dfca-4967-b9c2-96376e14affe tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:34.137843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-14a5e084-dfca-4967-b9c2-96376e14affe tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1297 microversion: 2.1 time: 0.127980 Apr 11 19:50:34.138487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 196/406] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:34 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:34.186652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ee753ed-aa6b-41e9-9615-d65429e6018e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:34.196172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ee753ed-aa6b-41e9-9615-d65429e6018e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1271 microversion: 2.1 time: 0.106554 Apr 11 19:50:34.205416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 211/407] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:34 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:35.023160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ea4cc56b-dc43-4d8d-8509-2448bf82b310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:35.023774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ea4cc56b-dc43-4d8d-8509-2448bf82b310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:35.033013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea4cc56b-dc43-4d8d-8509-2448bf82b310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.033694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea4cc56b-dc43-4d8d-8509-2448bf82b310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.034762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea4cc56b-dc43-4d8d-8509-2448bf82b310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.037259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea4cc56b-dc43-4d8d-8509-2448bf82b310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.099648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:35.101197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:35.109460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.110000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.111289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.111927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.247000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea4cc56b-dc43-4d8d-8509-2448bf82b310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:35.254935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ea4cc56b-dc43-4d8d-8509-2448bf82b310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1550 microversion: 2.1 time: 0.235890 Apr 11 19:50:35.256220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 197/408] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:35.261022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-28a74a0c-adcb-4ba0-8e94-268324deaf8e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:35.262316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-28a74a0c-adcb-4ba0-8e94-268324deaf8e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:35.269660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28a74a0c-adcb-4ba0-8e94-268324deaf8e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.270107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28a74a0c-adcb-4ba0-8e94-268324deaf8e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.271369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28a74a0c-adcb-4ba0-8e94-268324deaf8e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.271369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28a74a0c-adcb-4ba0-8e94-268324deaf8e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.328054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:35.338835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:35.345246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-28a74a0c-adcb-4ba0-8e94-268324deaf8e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:35.349081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:35.350960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-086332f8-97d0-4855-99a9-2a4befa821e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1739 microversion: 2.20 time: 0.255372 Apr 11 19:50:35.352886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 212/409] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:35.367024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2af3ed3-8f13-4d5e-883d-7a2a5ba03e77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:35.367653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2af3ed3-8f13-4d5e-883d-7a2a5ba03e77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:35.369134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-28a74a0c-adcb-4ba0-8e94-268324deaf8e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1297 microversion: 2.1 time: 0.108388 Apr 11 19:50:35.372049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 198/410] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:35 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1297 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:35.378096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ed7ee9aa-f7fe-4c86-8521-ab33597c4408 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:35.380045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ed7ee9aa-f7fe-4c86-8521-ab33597c4408 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:35.386192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2af3ed3-8f13-4d5e-883d-7a2a5ba03e77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.386895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2af3ed3-8f13-4d5e-883d-7a2a5ba03e77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.387899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2af3ed3-8f13-4d5e-883d-7a2a5ba03e77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.388494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2af3ed3-8f13-4d5e-883d-7a2a5ba03e77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.392749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed7ee9aa-f7fe-4c86-8521-ab33597c4408 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.393339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed7ee9aa-f7fe-4c86-8521-ab33597c4408 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.394897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed7ee9aa-f7fe-4c86-8521-ab33597c4408 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.395348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed7ee9aa-f7fe-4c86-8521-ab33597c4408 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.530236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2af3ed3-8f13-4d5e-883d-7a2a5ba03e77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:35.537722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2af3ed3-8f13-4d5e-883d-7a2a5ba03e77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1271 microversion: 2.1 time: 0.183212 Apr 11 19:50:35.538313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 213/411] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:35 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:35.659281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ed7ee9aa-f7fe-4c86-8521-ab33597c4408 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:35.676429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ed7ee9aa-f7fe-4c86-8521-ab33597c4408 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1550 microversion: 2.1 time: 0.303055 Apr 11 19:50:35.687624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 199/412] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1550 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:35.693108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:35.703009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:35.706630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Searching by: {'deleted': False, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a'} {{(pid=123638) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 11 19:50:35.716833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.717593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.718601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:35.719228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:35.835477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.multi_cell_list [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 19:50:35.978471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f9b2d929-c672-41cd-bfc6-39bcf363f966 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.289181 Apr 11 19:50:35.979352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 214/413] 10.222.0.62 () {58 vars in 1124 bytes} [Mon Apr 11 19:50:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:35.991395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-79a8262b-9f75-430b-8c7d-87b17b09c617 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:35.992103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-79a8262b-9f75-430b-8c7d-87b17b09c617 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:36.011344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79a8262b-9f75-430b-8c7d-87b17b09c617 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:36.011960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79a8262b-9f75-430b-8c7d-87b17b09c617 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:36.017399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79a8262b-9f75-430b-8c7d-87b17b09c617 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:36.017924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79a8262b-9f75-430b-8c7d-87b17b09c617 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:36.267647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-79a8262b-9f75-430b-8c7d-87b17b09c617 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:36.279884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-79a8262b-9f75-430b-8c7d-87b17b09c617 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1550 microversion: 2.1 time: 0.293075 Apr 11 19:50:36.283412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 200/414] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1550 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:36.371007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:36.371454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:36.392942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:36.393542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:36.396647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-229e2571-59ff-48d8-a85b-6c637bba49b0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:36.398260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-229e2571-59ff-48d8-a85b-6c637bba49b0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:36.400725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:36.401232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:36.412347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-229e2571-59ff-48d8-a85b-6c637bba49b0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:36.413305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-229e2571-59ff-48d8-a85b-6c637bba49b0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:36.418140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-229e2571-59ff-48d8-a85b-6c637bba49b0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:36.419736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-229e2571-59ff-48d8-a85b-6c637bba49b0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:36.687099 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-229e2571-59ff-48d8-a85b-6c637bba49b0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:36.710044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-229e2571-59ff-48d8-a85b-6c637bba49b0 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1303 microversion: 2.1 time: 0.322625 Apr 11 19:50:36.720824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 201/415] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:36 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1303 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:36.729072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e1c1d963-51a6-44b3-9db4-27803353fa0a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:36.732045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e1c1d963-51a6-44b3-9db4-27803353fa0a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:36.746545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c1d963-51a6-44b3-9db4-27803353fa0a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:36.747676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c1d963-51a6-44b3-9db4-27803353fa0a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:36.753567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c1d963-51a6-44b3-9db4-27803353fa0a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:36.756455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c1d963-51a6-44b3-9db4-27803353fa0a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:36.819457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:36.832135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:36.834257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:36.836771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20656f45-b6be-4d17-86b1-8e5fb39fe8f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1721 microversion: 2.20 time: 0.469942 Apr 11 19:50:36.838288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 215/416] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1721 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:36.890953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e1c1d963-51a6-44b3-9db4-27803353fa0a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:36.899914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e1c1d963-51a6-44b3-9db4-27803353fa0a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1277 microversion: 2.1 time: 0.185846 Apr 11 19:50:36.901407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 202/417] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:36 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:37.728291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a79540e-4ec2-4829-b84b-16ccdc65cf3d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:37.728965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a79540e-4ec2-4829-b84b-16ccdc65cf3d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:37.735767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a79540e-4ec2-4829-b84b-16ccdc65cf3d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:37.736286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a79540e-4ec2-4829-b84b-16ccdc65cf3d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:37.737174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a79540e-4ec2-4829-b84b-16ccdc65cf3d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:37.737662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a79540e-4ec2-4829-b84b-16ccdc65cf3d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:37.804884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a79540e-4ec2-4829-b84b-16ccdc65cf3d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:37.817170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a79540e-4ec2-4829-b84b-16ccdc65cf3d tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1303 microversion: 2.1 time: 0.093028 Apr 11 19:50:37.817768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 216/418] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:37 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:37.855832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:37.856674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:37.865240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:37.866056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:37.866929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:37.867358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:37.919615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a8b3224c-72d5-46be-b45a-806a06fbaa0f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:37.920215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a8b3224c-72d5-46be-b45a-806a06fbaa0f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:37.926512 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8b3224c-72d5-46be-b45a-806a06fbaa0f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:37.926951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8b3224c-72d5-46be-b45a-806a06fbaa0f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:37.927712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8b3224c-72d5-46be-b45a-806a06fbaa0f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:37.928174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8b3224c-72d5-46be-b45a-806a06fbaa0f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:38.011177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a8b3224c-72d5-46be-b45a-806a06fbaa0f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:38.025362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a8b3224c-72d5-46be-b45a-806a06fbaa0f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1277 microversion: 2.1 time: 0.109391 Apr 11 19:50:38.026274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 217/419] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:37 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:38.054341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:38.065241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:38.066770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:38.067996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7354783b-52b6-4917-988c-163084f4937e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1721 microversion: 2.20 time: 0.216263 Apr 11 19:50:38.078921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 203/420] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:38.302318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2d0cf16b-b12a-491d-bbcf-ad2da76341a2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0aed9fa-cade-4d37-b5d1-7717b51dd09b"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:38.303736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2d0cf16b-b12a-491d-bbcf-ad2da76341a2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:38.310238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d0cf16b-b12a-491d-bbcf-ad2da76341a2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:38.310681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d0cf16b-b12a-491d-bbcf-ad2da76341a2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:38.311453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d0cf16b-b12a-491d-bbcf-ad2da76341a2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:38.311895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d0cf16b-b12a-491d-bbcf-ad2da76341a2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:38.833924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cee697ad-8a02-44cd-9e8e-b760069aac70 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:38.834532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cee697ad-8a02-44cd-9e8e-b760069aac70 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:38.841124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cee697ad-8a02-44cd-9e8e-b760069aac70 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:38.841572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cee697ad-8a02-44cd-9e8e-b760069aac70 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:38.842411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cee697ad-8a02-44cd-9e8e-b760069aac70 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:38.842792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cee697ad-8a02-44cd-9e8e-b760069aac70 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:38.975946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cee697ad-8a02-44cd-9e8e-b760069aac70 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:38.985320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cee697ad-8a02-44cd-9e8e-b760069aac70 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.154989 Apr 11 19:50:38.985990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 204/421] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:38 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:39.042778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-41eb6c74-406f-4b6e-bb0e-67464c4e225c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:39.043386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-41eb6c74-406f-4b6e-bb0e-67464c4e225c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:39.050271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41eb6c74-406f-4b6e-bb0e-67464c4e225c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:39.050722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41eb6c74-406f-4b6e-bb0e-67464c4e225c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:39.051517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41eb6c74-406f-4b6e-bb0e-67464c4e225c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:39.051920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41eb6c74-406f-4b6e-bb0e-67464c4e225c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:39.190603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-41eb6c74-406f-4b6e-bb0e-67464c4e225c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:39.200253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-41eb6c74-406f-4b6e-bb0e-67464c4e225c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.161338 Apr 11 19:50:39.200834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 205/422] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:39 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:39.205815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:39.206073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:39.212279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:39.212713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:39.213505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:39.213926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:39.356539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:39.368520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:39.370866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:39.372599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-10ea07ba-04f6-434f-b0c6-f6f111ac4bfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1721 microversion: 2.20 time: 0.170502 Apr 11 19:50:39.373414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 206/423] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:40.005258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95d1e47f-98f9-4c62-8d49-3ce0b8bd9179 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:40.005934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95d1e47f-98f9-4c62-8d49-3ce0b8bd9179 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:40.012454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95d1e47f-98f9-4c62-8d49-3ce0b8bd9179 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:40.012893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95d1e47f-98f9-4c62-8d49-3ce0b8bd9179 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:40.013670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95d1e47f-98f9-4c62-8d49-3ce0b8bd9179 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:40.014091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95d1e47f-98f9-4c62-8d49-3ce0b8bd9179 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:40.152504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95d1e47f-98f9-4c62-8d49-3ce0b8bd9179 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:40.161394 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95d1e47f-98f9-4c62-8d49-3ce0b8bd9179 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.159642 Apr 11 19:50:40.165056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 207/424] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:40 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:40.217796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dabae92d-7e83-4ac4-af77-36d65db88d8c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:40.218408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dabae92d-7e83-4ac4-af77-36d65db88d8c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:40.224851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabae92d-7e83-4ac4-af77-36d65db88d8c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:40.225334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabae92d-7e83-4ac4-af77-36d65db88d8c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:40.226098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabae92d-7e83-4ac4-af77-36d65db88d8c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:40.226535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabae92d-7e83-4ac4-af77-36d65db88d8c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:40.362880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dabae92d-7e83-4ac4-af77-36d65db88d8c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:40.370933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dabae92d-7e83-4ac4-af77-36d65db88d8c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.157261 Apr 11 19:50:40.371542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 208/425] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:40 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:40.391770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:40.392378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:40.399031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:40.399553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:40.400325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:40.400761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:40.541666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:40.549750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:40.551821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:40.552788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b9e56ca5-25be-4f07-8f3f-c1a2083596c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1721 microversion: 2.20 time: 0.164943 Apr 11 19:50:40.553564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 209/426] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:41.162079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-31ca0711-d887-4d01-8af6-f5568f94de81 req-6bd26390-b113-4e41-9c97-15803f4d924d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6aea71-8b17-46b8-ab07-b42b41b573a5", "name": "network-vif-unplugged", "status": "completed", "tag": "043741af-b872-498e-a793-2860d820736a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:41.171188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-31ca0711-d887-4d01-8af6-f5568f94de81 req-6bd26390-b113-4e41-9c97-15803f4d924d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:41.171921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-31ca0711-d887-4d01-8af6-f5568f94de81 req-6bd26390-b113-4e41-9c97-15803f4d924d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:41.198160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-31ca0711-d887-4d01-8af6-f5568f94de81 req-6bd26390-b113-4e41-9c97-15803f4d924d service nova] Creating event network-vif-unplugged:043741af-b872-498e-a793-2860d820736a for instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 on hv-cinder-83078 Apr 11 19:50:41.205080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-31ca0711-d887-4d01-8af6-f5568f94de81 req-6bd26390-b113-4e41-9c97-15803f4d924d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046558 Apr 11 19:50:41.205965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 210/427] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:50:41.211571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b312e130-a433-4049-8067-a47e741a5d3e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:41.212490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b312e130-a433-4049-8067-a47e741a5d3e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:41.219207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b312e130-a433-4049-8067-a47e741a5d3e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:41.219783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b312e130-a433-4049-8067-a47e741a5d3e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:41.220454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b312e130-a433-4049-8067-a47e741a5d3e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:41.221130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b312e130-a433-4049-8067-a47e741a5d3e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:41.357991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b312e130-a433-4049-8067-a47e741a5d3e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:41.366201 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b312e130-a433-4049-8067-a47e741a5d3e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.158767 Apr 11 19:50:41.374256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 211/428] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:41 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:41.387911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b7b6cc4d-9f81-4a06-9ecc-1e682d02d64f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:41.388567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b7b6cc4d-9f81-4a06-9ecc-1e682d02d64f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:41.395381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7b6cc4d-9f81-4a06-9ecc-1e682d02d64f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:41.395823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7b6cc4d-9f81-4a06-9ecc-1e682d02d64f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:41.396584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7b6cc4d-9f81-4a06-9ecc-1e682d02d64f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:41.397062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7b6cc4d-9f81-4a06-9ecc-1e682d02d64f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:41.530695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b7b6cc4d-9f81-4a06-9ecc-1e682d02d64f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:41.538352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b7b6cc4d-9f81-4a06-9ecc-1e682d02d64f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.154410 Apr 11 19:50:41.538917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 212/429] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:41 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:41.571961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:41.572743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:41.578968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:41.579409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:41.580182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:41.580637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:41.727216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:41.749510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:41.751483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:41.752790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-466672a8-a926-4449-afb7-8e2b34d28e68 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1721 microversion: 2.20 time: 0.184818 Apr 11 19:50:41.753710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 213/430] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:42.385126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53cb8973-4746-423d-8391-80c46176ef9e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:42.385759 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53cb8973-4746-423d-8391-80c46176ef9e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:42.392528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53cb8973-4746-423d-8391-80c46176ef9e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:42.393177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53cb8973-4746-423d-8391-80c46176ef9e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:42.393944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53cb8973-4746-423d-8391-80c46176ef9e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:42.394381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53cb8973-4746-423d-8391-80c46176ef9e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:42.557438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-53cb8973-4746-423d-8391-80c46176ef9e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:42.567065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53cb8973-4746-423d-8391-80c46176ef9e tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.186450 Apr 11 19:50:42.567852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 214/431] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:42 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:50:42.573238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-0c48997e-9df9-475d-a230-4de83b7109b0 req-581a2a22-e73f-46a1-bbd1-340ca3beff43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ab5394-5558-4afd-b34d-c75fc0dfd907", "tag": "56459226-3187-4ee4-9ecc-2c022bdbc206"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:42.582413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-0c48997e-9df9-475d-a230-4de83b7109b0 req-581a2a22-e73f-46a1-bbd1-340ca3beff43 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:42.582848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-0c48997e-9df9-475d-a230-4de83b7109b0 req-581a2a22-e73f-46a1-bbd1-340ca3beff43 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:42.594680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-0c48997e-9df9-475d-a230-4de83b7109b0 req-581a2a22-e73f-46a1-bbd1-340ca3beff43 service nova] Creating event network-changed:56459226-3187-4ee4-9ecc-2c022bdbc206 for instance c9ab5394-5558-4afd-b34d-c75fc0dfd907 on hv-cinder-83078 Apr 11 19:50:42.599741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-0c48997e-9df9-475d-a230-4de83b7109b0 req-581a2a22-e73f-46a1-bbd1-340ca3beff43 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030514 Apr 11 19:50:42.600344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 215/432] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:42.606758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9edfc04-a613-4a02-8ed1-83b999ed1691 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:42.607456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9edfc04-a613-4a02-8ed1-83b999ed1691 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:42.613981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9edfc04-a613-4a02-8ed1-83b999ed1691 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:42.614440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9edfc04-a613-4a02-8ed1-83b999ed1691 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:42.615198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9edfc04-a613-4a02-8ed1-83b999ed1691 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:42.615623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9edfc04-a613-4a02-8ed1-83b999ed1691 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:42.762651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c9edfc04-a613-4a02-8ed1-83b999ed1691 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:42.770834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9edfc04-a613-4a02-8ed1-83b999ed1691 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.168673 Apr 11 19:50:42.771753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 216/433] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:42 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:42.792206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:42.792845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:42.800503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:42.800963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:42.801938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:42.802360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:42.996996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:43.001478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:43.002944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:43.004119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c56f053c-6d2f-4fa6-af3c-21f89355c9b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1721 microversion: 2.20 time: 0.228731 Apr 11 19:50:43.005055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 217/434] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:43.041515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2d0cf16b-b12a-491d-bbcf-ad2da76341a2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.743204 Apr 11 19:50:43.042741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 218/435] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 19:50:38 2022] POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 194 bytes in 4745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:50:43.583660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6c559563-e2e4-4f6c-a1a5-62a239d7a4e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:43.584264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6c559563-e2e4-4f6c-a1a5-62a239d7a4e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:43.590644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c559563-e2e4-4f6c-a1a5-62a239d7a4e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:43.591092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c559563-e2e4-4f6c-a1a5-62a239d7a4e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:43.591845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c559563-e2e4-4f6c-a1a5-62a239d7a4e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:43.592306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c559563-e2e4-4f6c-a1a5-62a239d7a4e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:43.732812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6c559563-e2e4-4f6c-a1a5-62a239d7a4e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:43.740708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6c559563-e2e4-4f6c-a1a5-62a239d7a4e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.160828 Apr 11 19:50:43.741285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 218/436] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:43 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:43.793464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-30973341-4963-4cb4-bf0b-7931745943de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:43.794737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-30973341-4963-4cb4-bf0b-7931745943de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:43.805618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30973341-4963-4cb4-bf0b-7931745943de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:43.806380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30973341-4963-4cb4-bf0b-7931745943de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:43.807696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30973341-4963-4cb4-bf0b-7931745943de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:43.808419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30973341-4963-4cb4-bf0b-7931745943de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:43.974910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-30973341-4963-4cb4-bf0b-7931745943de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:43.986141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-30973341-4963-4cb4-bf0b-7931745943de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.200368 Apr 11 19:50:43.987280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 219/437] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:43 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:44.023930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:44.024560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:44.031913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.032672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.033624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.034048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.184152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:44.192493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:44.194028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:44.195186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e028faef-a024-4882-9630-76b55d255aad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1724 microversion: 2.20 time: 0.175385 Apr 11 19:50:44.195734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 219/438] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:44.213918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-259a5626-de09-42e5-b689-be423174beaa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "744d9242-d7d2-47b5-b9e8-cbfb89b54d6c"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:44.215704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-259a5626-de09-42e5-b689-be423174beaa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:44.222531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-259a5626-de09-42e5-b689-be423174beaa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.222977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-259a5626-de09-42e5-b689-be423174beaa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.223747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-259a5626-de09-42e5-b689-be423174beaa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.224283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-259a5626-de09-42e5-b689-be423174beaa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.557726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-259a5626-de09-42e5-b689-be423174beaa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "POST /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.348009 Apr 11 19:50:44.558351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 220/439] 10.222.0.62 () {62 vars in 1363 bytes} [Mon Apr 11 19:50:44 2022] POST /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:50:44.614402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-207aaa9f-fed9-4358-abc0-5e1fd688476f req-8e904b6d-dcfe-4c21-b174-423e7d456ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62434824-2496-481a-908e-420cbb083eb4", "tag": "409a162a-d663-4d40-a44e-b1539f5fae5d"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:44.623291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-207aaa9f-fed9-4358-abc0-5e1fd688476f req-8e904b6d-dcfe-4c21-b174-423e7d456ff4 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.623729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-207aaa9f-fed9-4358-abc0-5e1fd688476f req-8e904b6d-dcfe-4c21-b174-423e7d456ff4 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.637432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-207aaa9f-fed9-4358-abc0-5e1fd688476f req-8e904b6d-dcfe-4c21-b174-423e7d456ff4 service nova] Creating event network-changed:409a162a-d663-4d40-a44e-b1539f5fae5d for instance 62434824-2496-481a-908e-420cbb083eb4 on hv-cinder-83078 Apr 11 19:50:44.643711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-207aaa9f-fed9-4358-abc0-5e1fd688476f req-8e904b6d-dcfe-4c21-b174-423e7d456ff4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033075 Apr 11 19:50:44.644338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 220/440] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:44.679846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43bbd6de-671a-45d9-9a51-4f78e56d0d57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:44.680468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43bbd6de-671a-45d9-9a51-4f78e56d0d57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:44.688515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43bbd6de-671a-45d9-9a51-4f78e56d0d57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.689009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43bbd6de-671a-45d9-9a51-4f78e56d0d57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.689785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43bbd6de-671a-45d9-9a51-4f78e56d0d57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.690216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43bbd6de-671a-45d9-9a51-4f78e56d0d57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.759542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-22c6d522-9756-4229-8e6a-2d2fb9fd558b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:44.760547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-22c6d522-9756-4229-8e6a-2d2fb9fd558b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:44.767536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22c6d522-9756-4229-8e6a-2d2fb9fd558b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.767976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22c6d522-9756-4229-8e6a-2d2fb9fd558b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.768812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22c6d522-9756-4229-8e6a-2d2fb9fd558b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.769272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22c6d522-9756-4229-8e6a-2d2fb9fd558b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.790258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43bbd6de-671a-45d9-9a51-4f78e56d0d57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "POST /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/action" status: 202 len: 0 microversion: 2.20 time: 0.114501 Apr 11 19:50:44.790885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 221/441] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Apr 11 19:50:44 2022] POST /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:50:44.799650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:44.800254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:44.806560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.807066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.807779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:44.808209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:44.974074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-22c6d522-9756-4229-8e6a-2d2fb9fd558b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:44.984803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-22c6d522-9756-4229-8e6a-2d2fb9fd558b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.230044 Apr 11 19:50:44.985438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 221/442] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:44 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:44.998879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:45.003891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab5f7b1e-f75a-4f45-85f1-27b88d63c77d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:45.004663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab5f7b1e-f75a-4f45-85f1-27b88d63c77d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:45.008050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:45.009687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:45.010683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab5f7b1e-f75a-4f45-85f1-27b88d63c77d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:45.010857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cc98c609-8fd1-4c3a-afd6-71db296e1253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1750 microversion: 2.20 time: 0.215815 Apr 11 19:50:45.011138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab5f7b1e-f75a-4f45-85f1-27b88d63c77d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:45.011769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 222/443] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1750 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:45.011896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab5f7b1e-f75a-4f45-85f1-27b88d63c77d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:45.012309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab5f7b1e-f75a-4f45-85f1-27b88d63c77d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:45.162099 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab5f7b1e-f75a-4f45-85f1-27b88d63c77d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:45.173444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab5f7b1e-f75a-4f45-85f1-27b88d63c77d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.173589 Apr 11 19:50:45.174041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 222/444] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:44 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:46.002362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2a2b460-7ea1-40b8-8a32-6ef1e88c93e3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:46.002973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2a2b460-7ea1-40b8-8a32-6ef1e88c93e3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:46.009707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2a2b460-7ea1-40b8-8a32-6ef1e88c93e3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:46.010161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2a2b460-7ea1-40b8-8a32-6ef1e88c93e3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:46.010935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2a2b460-7ea1-40b8-8a32-6ef1e88c93e3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:46.011369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2a2b460-7ea1-40b8-8a32-6ef1e88c93e3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:46.030169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:46.030772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:46.037601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:46.038001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:46.038781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:46.039202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:46.200232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2a2b460-7ea1-40b8-8a32-6ef1e88c93e3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:46.208834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2a2b460-7ea1-40b8-8a32-6ef1e88c93e3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.210661 Apr 11 19:50:46.209466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 223/445] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:45 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:46.213995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ed0a83e-0f74-4f5d-8f38-17817cc4b896 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:46.214728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ed0a83e-0f74-4f5d-8f38-17817cc4b896 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:46.219265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:46.220444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ed0a83e-0f74-4f5d-8f38-17817cc4b896 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:46.221068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ed0a83e-0f74-4f5d-8f38-17817cc4b896 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:46.221838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ed0a83e-0f74-4f5d-8f38-17817cc4b896 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:46.222269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ed0a83e-0f74-4f5d-8f38-17817cc4b896 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:46.228066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:46.229619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:46.230783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91024906-b16d-4e37-a5f9-e178352fe4eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1750 microversion: 2.20 time: 0.204645 Apr 11 19:50:46.231337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 223/446] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1750 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:46.364147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1ed0a83e-0f74-4f5d-8f38-17817cc4b896 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:46.372009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ed0a83e-0f74-4f5d-8f38-17817cc4b896 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.161574 Apr 11 19:50:46.372591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 224/447] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:46 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:47.225777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95ba16d8-03aa-4885-bedb-5356ab3b67ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:47.226389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95ba16d8-03aa-4885-bedb-5356ab3b67ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:47.232936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95ba16d8-03aa-4885-bedb-5356ab3b67ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:47.233404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95ba16d8-03aa-4885-bedb-5356ab3b67ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:47.234175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95ba16d8-03aa-4885-bedb-5356ab3b67ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:47.234604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95ba16d8-03aa-4885-bedb-5356ab3b67ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:47.250815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:47.252241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:47.258998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:47.259738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:47.260518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:47.260952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:47.471650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95ba16d8-03aa-4885-bedb-5356ab3b67ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:47.483831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95ba16d8-03aa-4885-bedb-5356ab3b67ed tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.261831 Apr 11 19:50:47.484714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 224/448] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:47 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:47.490499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f04fd1d2-5a40-4fa5-87e0-c340d3846357 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:47.491305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f04fd1d2-5a40-4fa5-87e0-c340d3846357 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:47.497859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f04fd1d2-5a40-4fa5-87e0-c340d3846357 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:47.498697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f04fd1d2-5a40-4fa5-87e0-c340d3846357 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:47.500629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f04fd1d2-5a40-4fa5-87e0-c340d3846357 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:47.501250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f04fd1d2-5a40-4fa5-87e0-c340d3846357 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:47.505530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:47.532154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:47.533843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:47.535221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6f749a3a-3b7b-44c9-859f-872f34e0f99d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1752 microversion: 2.20 time: 0.289592 Apr 11 19:50:47.546712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 225/449] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1752 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:47.663734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f04fd1d2-5a40-4fa5-87e0-c340d3846357 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:47.671985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f04fd1d2-5a40-4fa5-87e0-c340d3846357 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.185677 Apr 11 19:50:47.672781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 225/450] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:47 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:48.503448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-15998259-97d3-443c-afc5-653fd08abcaf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:48.504120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-15998259-97d3-443c-afc5-653fd08abcaf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:48.516679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15998259-97d3-443c-afc5-653fd08abcaf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:48.517478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15998259-97d3-443c-afc5-653fd08abcaf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:48.518811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15998259-97d3-443c-afc5-653fd08abcaf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:48.519552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15998259-97d3-443c-afc5-653fd08abcaf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:48.554249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:48.554953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:48.561474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:48.561916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:48.562693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:48.563119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:48.711806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-15998259-97d3-443c-afc5-653fd08abcaf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:48.719929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-15998259-97d3-443c-afc5-653fd08abcaf tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.222829 Apr 11 19:50:48.720589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 226/451] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:48 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:48.731697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f3d886da-6c15-41f9-8d88-2d83df63aa08 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:48.732368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f3d886da-6c15-41f9-8d88-2d83df63aa08 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:48.737790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:48.738544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3d886da-6c15-41f9-8d88-2d83df63aa08 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:48.738995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3d886da-6c15-41f9-8d88-2d83df63aa08 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:48.739809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3d886da-6c15-41f9-8d88-2d83df63aa08 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:48.740217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3d886da-6c15-41f9-8d88-2d83df63aa08 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:48.747711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:48.749265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:48.750798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-47326f4e-ba95-4cb7-ae8c-c97de9ce5a74 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1752 microversion: 2.20 time: 0.200545 Apr 11 19:50:48.751368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 226/452] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:50:48.878488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f3d886da-6c15-41f9-8d88-2d83df63aa08 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:48.886771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f3d886da-6c15-41f9-8d88-2d83df63aa08 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.158919 Apr 11 19:50:48.887349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 227/453] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:48 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:49.738129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ea00945-e4b4-4c55-ae24-8deed0107853 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:49.738679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ea00945-e4b4-4c55-ae24-8deed0107853 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:49.747681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea00945-e4b4-4c55-ae24-8deed0107853 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:49.748127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea00945-e4b4-4c55-ae24-8deed0107853 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:49.748897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea00945-e4b4-4c55-ae24-8deed0107853 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:49.749361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea00945-e4b4-4c55-ae24-8deed0107853 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:49.771803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:49.772523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:49.778918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:49.779364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:49.780161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:49.780588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:50.181345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0ea00945-e4b4-4c55-ae24-8deed0107853 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:50.184965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:50.189954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ea00945-e4b4-4c55-ae24-8deed0107853 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.455754 Apr 11 19:50:50.190554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 227/454] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:49 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:50.195344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-440dae0c-0aa1-4365-acf6-5023dbf3e51a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:50.195945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-440dae0c-0aa1-4365-acf6-5023dbf3e51a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:50.202101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-440dae0c-0aa1-4365-acf6-5023dbf3e51a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:50.202530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-440dae0c-0aa1-4365-acf6-5023dbf3e51a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:50.203290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-440dae0c-0aa1-4365-acf6-5023dbf3e51a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:50.203719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-440dae0c-0aa1-4365-acf6-5023dbf3e51a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:50.211901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:50.213591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:50.214919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2759140f-b4ea-4264-b76c-281a1bce8a8f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1752 microversion: 2.20 time: 0.447043 Apr 11 19:50:50.225654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 228/455] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1752 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:50.225654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-6b5e6c59-5c9e-44a9-af3e-ba3f009fdff0 req-3ef20405-ce19-45af-af63-8814de5497b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ab5394-5558-4afd-b34d-c75fc0dfd907", "name": "network-vif-plugged", "status": "completed", "tag": "56459226-3187-4ee4-9ecc-2c022bdbc206"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:50.228712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-6b5e6c59-5c9e-44a9-af3e-ba3f009fdff0 req-3ef20405-ce19-45af-af63-8814de5497b6 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:50.229188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-6b5e6c59-5c9e-44a9-af3e-ba3f009fdff0 req-3ef20405-ce19-45af-af63-8814de5497b6 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:50.240376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-6b5e6c59-5c9e-44a9-af3e-ba3f009fdff0 req-3ef20405-ce19-45af-af63-8814de5497b6 service nova] Creating event network-vif-plugged:56459226-3187-4ee4-9ecc-2c022bdbc206 for instance c9ab5394-5558-4afd-b34d-c75fc0dfd907 on hv-cinder-83078 Apr 11 19:50:50.245841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-6b5e6c59-5c9e-44a9-af3e-ba3f009fdff0 req-3ef20405-ce19-45af-af63-8814de5497b6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028700 Apr 11 19:50:50.246578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 229/456] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:50.340436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-440dae0c-0aa1-4365-acf6-5023dbf3e51a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:50.348847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-440dae0c-0aa1-4365-acf6-5023dbf3e51a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.157149 Apr 11 19:50:50.349664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 228/457] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:50 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:50.698135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf511e7a-83a2-4670-809b-56ce2383bc53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:50.698832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cf511e7a-83a2-4670-809b-56ce2383bc53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:50.705666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf511e7a-83a2-4670-809b-56ce2383bc53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:50.706114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf511e7a-83a2-4670-809b-56ce2383bc53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:50.707108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf511e7a-83a2-4670-809b-56ce2383bc53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:50.707340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf511e7a-83a2-4670-809b-56ce2383bc53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:50.859914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cf511e7a-83a2-4670-809b-56ce2383bc53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:50.867939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cf511e7a-83a2-4670-809b-56ce2383bc53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1596 microversion: 2.1 time: 0.174062 Apr 11 19:50:50.868473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 230/458] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1596 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:51.206643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aef8a6d4-c21d-4231-bc19-64f51d73c568 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:51.207540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aef8a6d4-c21d-4231-bc19-64f51d73c568 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:51.213948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aef8a6d4-c21d-4231-bc19-64f51d73c568 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:51.214401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aef8a6d4-c21d-4231-bc19-64f51d73c568 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:51.215174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aef8a6d4-c21d-4231-bc19-64f51d73c568 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:51.217172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aef8a6d4-c21d-4231-bc19-64f51d73c568 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:51.233629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:51.234244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:51.240686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:51.241122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:51.242086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:51.242711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:51.505376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aef8a6d4-c21d-4231-bc19-64f51d73c568 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:51.513539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aef8a6d4-c21d-4231-bc19-64f51d73c568 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.310761 Apr 11 19:50:51.514098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 229/459] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:51 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:51.518993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-532dd143-fa7c-4e3e-924b-7969c07c142d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:51.519877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-532dd143-fa7c-4e3e-924b-7969c07c142d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:51.526019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532dd143-fa7c-4e3e-924b-7969c07c142d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:51.526736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532dd143-fa7c-4e3e-924b-7969c07c142d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:51.527560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532dd143-fa7c-4e3e-924b-7969c07c142d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:51.527998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532dd143-fa7c-4e3e-924b-7969c07c142d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:51.540119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:51.556832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:51.559587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:51.561583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-34bbcaf5-f54f-4f6c-a657-ca38aa297fcf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.331778 Apr 11 19:50:51.562540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 231/460] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:51.703211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-532dd143-fa7c-4e3e-924b-7969c07c142d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:51.711178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-532dd143-fa7c-4e3e-924b-7969c07c142d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1319 microversion: 2.1 time: 0.195747 Apr 11 19:50:51.711742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 230/461] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:51 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:52.274374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-16abb7c0-d199-4594-ba85-eed18f54d6ef req-00d20a1f-298c-4ab3-9bc1-0e83a63e5938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62434824-2496-481a-908e-420cbb083eb4", "name": "network-vif-plugged", "status": "completed", "tag": "409a162a-d663-4d40-a44e-b1539f5fae5d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:52.282809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-16abb7c0-d199-4594-ba85-eed18f54d6ef req-00d20a1f-298c-4ab3-9bc1-0e83a63e5938 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:52.283249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-16abb7c0-d199-4594-ba85-eed18f54d6ef req-00d20a1f-298c-4ab3-9bc1-0e83a63e5938 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:52.296707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-16abb7c0-d199-4594-ba85-eed18f54d6ef req-00d20a1f-298c-4ab3-9bc1-0e83a63e5938 service nova] Creating event network-vif-plugged:409a162a-d663-4d40-a44e-b1539f5fae5d for instance 62434824-2496-481a-908e-420cbb083eb4 on hv-cinder-83078 Apr 11 19:50:52.302018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-16abb7c0-d199-4594-ba85-eed18f54d6ef req-00d20a1f-298c-4ab3-9bc1-0e83a63e5938 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031304 Apr 11 19:50:52.302637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 232/462] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:52.533895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d830e51a-f1d0-4343-a12c-c66ae7d8856f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:52.534507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d830e51a-f1d0-4343-a12c-c66ae7d8856f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:52.542207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d830e51a-f1d0-4343-a12c-c66ae7d8856f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:52.542664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d830e51a-f1d0-4343-a12c-c66ae7d8856f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:52.543442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d830e51a-f1d0-4343-a12c-c66ae7d8856f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:52.543878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d830e51a-f1d0-4343-a12c-c66ae7d8856f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:52.580577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:52.581407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:52.588301 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:52.589213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:52.590892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:52.590892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:52.854529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d830e51a-f1d0-4343-a12c-c66ae7d8856f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:52.864702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d830e51a-f1d0-4343-a12c-c66ae7d8856f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.334578 Apr 11 19:50:52.865480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 231/463] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:52 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:52.870375 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25d02ea3-ebdf-411a-8add-1e6fe2995749 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:52.871339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25d02ea3-ebdf-411a-8add-1e6fe2995749 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:52.878577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25d02ea3-ebdf-411a-8add-1e6fe2995749 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:52.879352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25d02ea3-ebdf-411a-8add-1e6fe2995749 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:52.880843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25d02ea3-ebdf-411a-8add-1e6fe2995749 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:52.881296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25d02ea3-ebdf-411a-8add-1e6fe2995749 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:52.924079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:52.934334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:52.936418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:52.938033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0cefb5a3-19ac-4280-9d82-1edfc4451725 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.361905 Apr 11 19:50:52.938856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 233/464] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:53.282078 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25d02ea3-ebdf-411a-8add-1e6fe2995749 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:53.289910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25d02ea3-ebdf-411a-8add-1e6fe2995749 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1507 microversion: 2.1 time: 0.423103 Apr 11 19:50:53.291064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 232/465] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:52 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1507 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:53.310401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e6f88bb8-f9be-49e2-b2d1-1a070861943d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d53c3021-0490-4e72-9f54-b9779066977f", "device": "/dev/sdb"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:53.312759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e6f88bb8-f9be-49e2-b2d1-1a070861943d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:53.319359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f88bb8-f9be-49e2-b2d1-1a070861943d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:53.319813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f88bb8-f9be-49e2-b2d1-1a070861943d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:53.320600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f88bb8-f9be-49e2-b2d1-1a070861943d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:53.321264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f88bb8-f9be-49e2-b2d1-1a070861943d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:53.492785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-ba98f390-548d-4656-b531-80a40e6b2d68 req-3af54e15-3837-45aa-ac50-df4f6e8f8e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f85f237-46f1-47d2-badc-2e3cffe85c90", "tag": "6932f8ee-b8ec-4779-99f0-59715534dce0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:53.508825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ba98f390-548d-4656-b531-80a40e6b2d68 req-3af54e15-3837-45aa-ac50-df4f6e8f8e2b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:53.509810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ba98f390-548d-4656-b531-80a40e6b2d68 req-3af54e15-3837-45aa-ac50-df4f6e8f8e2b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:53.525395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-ba98f390-548d-4656-b531-80a40e6b2d68 req-3af54e15-3837-45aa-ac50-df4f6e8f8e2b service nova] Creating event network-changed:6932f8ee-b8ec-4779-99f0-59715534dce0 for instance 4f85f237-46f1-47d2-badc-2e3cffe85c90 on hv-cinder-83078 Apr 11 19:50:53.532661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-ba98f390-548d-4656-b531-80a40e6b2d68 req-3af54e15-3837-45aa-ac50-df4f6e8f8e2b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045360 Apr 11 19:50:53.534090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 233/466] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:53.884885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8817af45-8ec9-4caa-b218-5bb52bb0e93a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:53.886509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8817af45-8ec9-4caa-b218-5bb52bb0e93a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:53.893298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8817af45-8ec9-4caa-b218-5bb52bb0e93a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:53.893968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8817af45-8ec9-4caa-b218-5bb52bb0e93a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:53.895110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8817af45-8ec9-4caa-b218-5bb52bb0e93a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:53.895779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8817af45-8ec9-4caa-b218-5bb52bb0e93a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:54.146437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e6f88bb8-f9be-49e2-b2d1-1a070861943d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "POST /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840411 Apr 11 19:50:54.150106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 234/467] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 19:50:53 2022] POST /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:54.179696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-967160621", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1088380937", "security_groups": [{"name": "tempest-secgroup-smoke-152647840"}], "block_device_mapping_v2": [{"uuid": "31271bd6-d562-4f77-b2b4-44541048aa5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fdfe6bd8-d9b7-4af1-b14f-56b45ed38fc2"}]}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:54.180605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8817af45-8ec9-4caa-b218-5bb52bb0e93a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:54.202298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8817af45-8ec9-4caa-b218-5bb52bb0e93a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1371 microversion: 2.1 time: 0.323517 Apr 11 19:50:54.203157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 234/468] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:53 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:54.220143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:54.224527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:54.236761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:54.239909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:54.240983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:54.242870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:54.443035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] validate_networks() for [('fdfe6bd8-d9b7-4af1-b14f-56b45ed38fc2', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 19:50:54.451896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:54.461210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:54.463188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:54.464523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-675cfadf-0e27-4e61-afd3-c919ecbfa4fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.251365 Apr 11 19:50:54.476491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 235/469] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:54.833698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f14ef788-cb0e-40e3-8341-f33540de1f3e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1622476716"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:54.834332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f14ef788-cb0e-40e3-8341-f33540de1f3e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:54.854950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f14ef788-cb0e-40e3-8341-f33540de1f3e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:54.855891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f14ef788-cb0e-40e3-8341-f33540de1f3e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:54.857179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f14ef788-cb0e-40e3-8341-f33540de1f3e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:54.857939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f14ef788-cb0e-40e3-8341-f33540de1f3e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:54.987809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 19:50:54.988528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 19:50:54.989356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 19:50:54.989963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 19:50:54.990607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 19:50:55.005249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:55.006342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:55.008073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:55.008892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:55.037594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Getting quotas for project 0666647cc4f0410a90947d91ddbccf87. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 19:50:55.042167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Getting quotas for user bef6c7d7ab9a47d4bb332b73e60ce67c and project 0666647cc4f0410a90947d91ddbccf87. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 19:50:55.118752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 19:50:55.126370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31271bd6-d562-4f77-b2b4-44541048aa5e',volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 19:50:55.138455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.network.security_group_api [None req-f14ef788-cb0e-40e3-8341-f33540de1f3e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Adding security group 8fa812fa-176b-4d53-9cb6-10a0bf30b377 to port 6932f8ee-b8ec-4779-99f0-59715534dce0 Apr 11 19:50:55.355783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5422ee3a-272a-4e6c-b57b-5d2997b28432 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.200189 Apr 11 19:50:55.357493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 235/470] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 19:50:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 19:50:55.369954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9b516238-e83c-42d0-a960-7ee16b93dbc3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:55.371148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9b516238-e83c-42d0-a960-7ee16b93dbc3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:55.381566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b516238-e83c-42d0-a960-7ee16b93dbc3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:55.382992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b516238-e83c-42d0-a960-7ee16b93dbc3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:55.384243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b516238-e83c-42d0-a960-7ee16b93dbc3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:55.384937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b516238-e83c-42d0-a960-7ee16b93dbc3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:55.705998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b516238-e83c-42d0-a960-7ee16b93dbc3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:55.729345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9b516238-e83c-42d0-a960-7ee16b93dbc3 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1565 microversion: 2.1 time: 0.369194 Apr 11 19:50:55.730127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 236/471] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:55 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1565 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:55.735132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bac1b583-9dde-4788-bef1-f87ffc7f45fa tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:55.755838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bac1b583-9dde-4788-bef1-f87ffc7f45fa tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:55.894392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bac1b583-9dde-4788-bef1-f87ffc7f45fa tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:55.902262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bac1b583-9dde-4788-bef1-f87ffc7f45fa tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1094 microversion: 2.1 time: 0.170849 Apr 11 19:50:55.903446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 237/472] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:55 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1094 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:55.911947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:55.912973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:55.924214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f14ef788-cb0e-40e3-8341-f33540de1f3e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/action" status: 202 len: 0 microversion: 2.1 time: 1.099338 Apr 11 19:50:55.924736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 236/473] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 19:50:54 2022] POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/action => generated 0 bytes in 1101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:50:55.941842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84106531-e1ac-4e67-a1cb-1ee309bcb6d4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:55.942342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84106531-e1ac-4e67-a1cb-1ee309bcb6d4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:55.945484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:55.959261 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:55.963278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84106531-e1ac-4e67-a1cb-1ee309bcb6d4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:55.963718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84106531-e1ac-4e67-a1cb-1ee309bcb6d4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:55.965020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:55.965616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:55.980004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84106531-e1ac-4e67-a1cb-1ee309bcb6d4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:55.980509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84106531-e1ac-4e67-a1cb-1ee309bcb6d4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:56.291864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84106531-e1ac-4e67-a1cb-1ee309bcb6d4 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.365820 Apr 11 19:50:56.292839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 237/474] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Apr 11 19:50:55 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4/os-interface => generated 285 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:56.317849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-67101f68-1e89-4c3c-a78b-f4bc7f81dee4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:56.322162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-67101f68-1e89-4c3c-a78b-f4bc7f81dee4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:56.335116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67101f68-1e89-4c3c-a78b-f4bc7f81dee4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:56.337782 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67101f68-1e89-4c3c-a78b-f4bc7f81dee4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:56.338763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67101f68-1e89-4c3c-a78b-f4bc7f81dee4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:56.339351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67101f68-1e89-4c3c-a78b-f4bc7f81dee4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:56.358305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:56.394976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:56.396624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:56.398255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6173d8ff-76ec-47ab-b752-8e548e083f10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.493601 Apr 11 19:50:56.399016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 238/475] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:56.408063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-d678be74-0db4-4f57-a9a8-821521dc3d47 req-eca5815c-a019-42f9-bc2d-7d320d0ffb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f85f237-46f1-47d2-badc-2e3cffe85c90", "tag": "6932f8ee-b8ec-4779-99f0-59715534dce0"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:56.429550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d678be74-0db4-4f57-a9a8-821521dc3d47 req-eca5815c-a019-42f9-bc2d-7d320d0ffb12 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:56.433175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d678be74-0db4-4f57-a9a8-821521dc3d47 req-eca5815c-a019-42f9-bc2d-7d320d0ffb12 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:56.471296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-d678be74-0db4-4f57-a9a8-821521dc3d47 req-eca5815c-a019-42f9-bc2d-7d320d0ffb12 service nova] Creating event network-changed:6932f8ee-b8ec-4779-99f0-59715534dce0 for instance 4f85f237-46f1-47d2-badc-2e3cffe85c90 on hv-cinder-83078 Apr 11 19:50:56.491583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-d678be74-0db4-4f57-a9a8-821521dc3d47 req-eca5815c-a019-42f9-bc2d-7d320d0ffb12 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090977 Apr 11 19:50:56.495106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 239/476] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:50:56.605212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-67101f68-1e89-4c3c-a78b-f4bc7f81dee4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:56.615421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-67101f68-1e89-4c3c-a78b-f4bc7f81dee4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1761 microversion: 2.1 time: 0.320965 Apr 11 19:50:56.616333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 238/477] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1761 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:56.923770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b6c92735-0ad9-432e-bbfe-76c3503506f9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:56.925129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b6c92735-0ad9-432e-bbfe-76c3503506f9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:56.932825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6c92735-0ad9-432e-bbfe-76c3503506f9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:56.933711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6c92735-0ad9-432e-bbfe-76c3503506f9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:56.934685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6c92735-0ad9-432e-bbfe-76c3503506f9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:56.935278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6c92735-0ad9-432e-bbfe-76c3503506f9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:57.034150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b6c92735-0ad9-432e-bbfe-76c3503506f9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:57.042047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b6c92735-0ad9-432e-bbfe-76c3503506f9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.122889 Apr 11 19:50:57.053195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 240/478] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:56 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:57.419793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:57.420373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:57.427772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:57.428471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:57.429450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:57.430025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:57.587483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:57.596479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:57.598298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:57.599501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-edbb7b3d-a771-4c11-a465-5eea9d5393ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.184583 Apr 11 19:50:57.600077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 239/479] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:57.710826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-7734336b-da35-459e-afac-182b58a7c3c8 req-bc4d5881-0047-436e-8844-fcad1033baaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62434824-2496-481a-908e-420cbb083eb4", "tag": "409a162a-d663-4d40-a44e-b1539f5fae5d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:50:57.719888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-7734336b-da35-459e-afac-182b58a7c3c8 req-bc4d5881-0047-436e-8844-fcad1033baaa service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:57.720602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-7734336b-da35-459e-afac-182b58a7c3c8 req-bc4d5881-0047-436e-8844-fcad1033baaa service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:57.733349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-7734336b-da35-459e-afac-182b58a7c3c8 req-bc4d5881-0047-436e-8844-fcad1033baaa service nova] Creating event network-changed:409a162a-d663-4d40-a44e-b1539f5fae5d for instance 62434824-2496-481a-908e-420cbb083eb4 on hv-cinder-83078 Apr 11 19:50:57.739256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-7734336b-da35-459e-afac-182b58a7c3c8 req-bc4d5881-0047-436e-8844-fcad1033baaa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032710 Apr 11 19:50:57.741531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 241/480] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:50:58.060606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2399109-cec8-410f-a9b4-eccfff240b8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:58.061343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2399109-cec8-410f-a9b4-eccfff240b8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:58.067848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2399109-cec8-410f-a9b4-eccfff240b8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:58.069165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2399109-cec8-410f-a9b4-eccfff240b8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:58.070178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2399109-cec8-410f-a9b4-eccfff240b8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:58.070839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2399109-cec8-410f-a9b4-eccfff240b8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:58.148279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c2399109-cec8-410f-a9b4-eccfff240b8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:58.158883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2399109-cec8-410f-a9b4-eccfff240b8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.102136 Apr 11 19:50:58.168489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 240/481] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:58 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:58.623716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:58.625857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:58.641556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:58.642279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:58.643211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:58.643811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:58.819934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:58.831700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:58.833792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:58.835194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b69528e4-6a89-4448-a700-c8e44a0a67c2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.217632 Apr 11 19:50:58.836590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 242/482] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:50:59.178805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e98dba2-3be8-405d-8937-331344d5bc40 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:59.179723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e98dba2-3be8-405d-8937-331344d5bc40 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:59.192381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e98dba2-3be8-405d-8937-331344d5bc40 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:59.192863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e98dba2-3be8-405d-8937-331344d5bc40 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:59.193668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e98dba2-3be8-405d-8937-331344d5bc40 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:59.194104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e98dba2-3be8-405d-8937-331344d5bc40 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:59.257372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6e98dba2-3be8-405d-8937-331344d5bc40 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:50:59.265168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e98dba2-3be8-405d-8937-331344d5bc40 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.090178 Apr 11 19:50:59.265753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 241/483] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:50:59 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:50:59.854159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:50:59.854931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:50:59.861856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:59.862251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:50:59.863015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:50:59.863439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:00.010402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:00.019519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:00.021031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:00.022388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9cf6184b-f76d-4f57-9f3e-01bc77829e86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.172219 Apr 11 19:51:00.022969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 243/484] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:50:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:00.282461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-80320f1a-fc8f-46fc-bb3c-5612cc2103e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:00.283097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-80320f1a-fc8f-46fc-bb3c-5612cc2103e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:00.290102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80320f1a-fc8f-46fc-bb3c-5612cc2103e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:00.290538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80320f1a-fc8f-46fc-bb3c-5612cc2103e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:00.291308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80320f1a-fc8f-46fc-bb3c-5612cc2103e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:00.291735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80320f1a-fc8f-46fc-bb3c-5612cc2103e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:00.358333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-80320f1a-fc8f-46fc-bb3c-5612cc2103e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:00.372331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-80320f1a-fc8f-46fc-bb3c-5612cc2103e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.093778 Apr 11 19:51:00.372941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 242/485] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:00 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:01.040100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:01.040753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:01.047541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:01.047995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:01.048778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:01.049230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:01.184304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:01.196528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:01.198918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:01.200460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-daa90c6e-4bd9-400c-9473-c29f1df52975 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.164371 Apr 11 19:51:01.207903 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 244/486] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:01.393314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1845ff9c-858a-428d-a74b-4d9664f91e1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:01.393917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1845ff9c-858a-428d-a74b-4d9664f91e1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:01.401165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1845ff9c-858a-428d-a74b-4d9664f91e1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:01.401595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1845ff9c-858a-428d-a74b-4d9664f91e1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:01.402748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1845ff9c-858a-428d-a74b-4d9664f91e1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:01.403180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1845ff9c-858a-428d-a74b-4d9664f91e1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:01.473166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1845ff9c-858a-428d-a74b-4d9664f91e1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:01.481801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1845ff9c-858a-428d-a74b-4d9664f91e1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.094388 Apr 11 19:51:01.482365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 243/487] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:01 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:02.218906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:02.219783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:02.227265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:02.227813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:02.228654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:02.229185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:02.387506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:02.408408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:02.409960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:02.411148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d9b6f6e-6b2b-47b0-88b9-a3c433139ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.196823 Apr 11 19:51:02.411720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 245/488] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:02.500133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8483583-8b50-4473-a05a-cd1e2cad725d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:02.500716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8483583-8b50-4473-a05a-cd1e2cad725d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:02.508237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8483583-8b50-4473-a05a-cd1e2cad725d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:02.508691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8483583-8b50-4473-a05a-cd1e2cad725d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:02.509538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8483583-8b50-4473-a05a-cd1e2cad725d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:02.509974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8483583-8b50-4473-a05a-cd1e2cad725d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:02.573300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8483583-8b50-4473-a05a-cd1e2cad725d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:02.581223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8483583-8b50-4473-a05a-cd1e2cad725d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.085377 Apr 11 19:51:02.581812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 244/489] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:02 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:03.431340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:03.437817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:03.447191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:03.447553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:03.448333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:03.448748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:03.598314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-628bb69d-7e4a-4c3a-ad3d-3ccaa39bed2d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:03.599723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-628bb69d-7e4a-4c3a-ad3d-3ccaa39bed2d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:03.601152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:03.607738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-628bb69d-7e4a-4c3a-ad3d-3ccaa39bed2d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:03.610701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-628bb69d-7e4a-4c3a-ad3d-3ccaa39bed2d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:03.610701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-628bb69d-7e4a-4c3a-ad3d-3ccaa39bed2d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:03.610701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-628bb69d-7e4a-4c3a-ad3d-3ccaa39bed2d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:03.610985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:03.611453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:03.612628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0cb4c1e3-83c7-469b-8b15-677472e35606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.186724 Apr 11 19:51:03.613234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 246/490] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:03.677741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-628bb69d-7e4a-4c3a-ad3d-3ccaa39bed2d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:03.687224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-628bb69d-7e4a-4c3a-ad3d-3ccaa39bed2d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.092695 Apr 11 19:51:03.687929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 245/491] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:03 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:04.634154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:04.634851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:04.641575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:04.641990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:04.642730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:04.643128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:04.706204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84d03c0b-be0c-4dd1-b59d-1dba42d1d24c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:04.707084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84d03c0b-be0c-4dd1-b59d-1dba42d1d24c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:04.714055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84d03c0b-be0c-4dd1-b59d-1dba42d1d24c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:04.714569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84d03c0b-be0c-4dd1-b59d-1dba42d1d24c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:04.715698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84d03c0b-be0c-4dd1-b59d-1dba42d1d24c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:04.716333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84d03c0b-be0c-4dd1-b59d-1dba42d1d24c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:04.787401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84d03c0b-be0c-4dd1-b59d-1dba42d1d24c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:04.795422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84d03c0b-be0c-4dd1-b59d-1dba42d1d24c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.093532 Apr 11 19:51:04.796024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 246/492] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:04 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:04.829765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:04.838540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:04.840067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:04.841514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d882b13-de65-4b71-9e35-0616eb73f662 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.211980 Apr 11 19:51:04.842099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 247/493] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:05.812959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-10e333fd-8f98-44f4-a518-d40b5ff471f8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:05.813625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-10e333fd-8f98-44f4-a518-d40b5ff471f8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:05.819841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10e333fd-8f98-44f4-a518-d40b5ff471f8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:05.820281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10e333fd-8f98-44f4-a518-d40b5ff471f8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:05.821081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10e333fd-8f98-44f4-a518-d40b5ff471f8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:05.821509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10e333fd-8f98-44f4-a518-d40b5ff471f8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:05.860537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:05.862487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:05.871695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:05.872429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:05.873697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:05.873697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:05.903751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-10e333fd-8f98-44f4-a518-d40b5ff471f8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:05.911575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-10e333fd-8f98-44f4-a518-d40b5ff471f8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.103537 Apr 11 19:51:05.912156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 247/494] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:05 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:06.023591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:06.033628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:06.035119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:06.036345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-31fae66e-e0e3-4182-bf0c-ee0954081f2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.180622 Apr 11 19:51:06.037174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 248/495] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:51:06.929982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6792a814-be6f-4b1a-bf3c-1e42620e74e0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:06.930612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6792a814-be6f-4b1a-bf3c-1e42620e74e0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:06.937265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6792a814-be6f-4b1a-bf3c-1e42620e74e0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:06.938038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6792a814-be6f-4b1a-bf3c-1e42620e74e0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:06.938806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6792a814-be6f-4b1a-bf3c-1e42620e74e0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:06.939227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6792a814-be6f-4b1a-bf3c-1e42620e74e0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:07.001262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6792a814-be6f-4b1a-bf3c-1e42620e74e0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:07.010295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6792a814-be6f-4b1a-bf3c-1e42620e74e0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.083941 Apr 11 19:51:07.011015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 248/496] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:06 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:07.054746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:07.055365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:07.062589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:07.063035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:07.063852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:07.064263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:07.198676 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:07.207722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:07.209269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:07.210442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf2f215f-a245-45c8-99fe-47072ae4a7ce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.159770 Apr 11 19:51:07.210999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 249/497] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:08.027508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0c169d66-e75b-49bd-a6ce-a1b0951283a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:08.028121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0c169d66-e75b-49bd-a6ce-a1b0951283a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:08.035160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c169d66-e75b-49bd-a6ce-a1b0951283a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:08.035607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c169d66-e75b-49bd-a6ce-a1b0951283a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:08.036370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c169d66-e75b-49bd-a6ce-a1b0951283a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:08.036794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c169d66-e75b-49bd-a6ce-a1b0951283a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:08.100118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0c169d66-e75b-49bd-a6ce-a1b0951283a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:08.110293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0c169d66-e75b-49bd-a6ce-a1b0951283a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1192 microversion: 2.1 time: 0.086647 Apr 11 19:51:08.110857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 249/498] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:08 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:08.229511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:08.230119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:08.236810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:08.237284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:08.238043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:08.238446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:08.392274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:08.401584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:08.403052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:08.404271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ea4dc60-aef7-4788-8c3c-f3e77c71b034 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.178710 Apr 11 19:51:08.405178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 250/499] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:51:09.131114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-034d0006-fd7d-4530-95e1-b904747f755f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:09.132164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-034d0006-fd7d-4530-95e1-b904747f755f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:09.141962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034d0006-fd7d-4530-95e1-b904747f755f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:09.143102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034d0006-fd7d-4530-95e1-b904747f755f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:09.143537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034d0006-fd7d-4530-95e1-b904747f755f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:09.144022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034d0006-fd7d-4530-95e1-b904747f755f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:09.213718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-034d0006-fd7d-4530-95e1-b904747f755f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:09.226709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-034d0006-fd7d-4530-95e1-b904747f755f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1210 microversion: 2.1 time: 0.098219 Apr 11 19:51:09.233125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 250/500] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:09 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:09.426748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:09.427709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:09.434646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:09.435477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:09.436437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:09.438246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:09.606118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:09.615341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:09.616873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:09.618466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65fb2976-2492-45b1-b026-b22368350c64 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.195777 Apr 11 19:51:09.629931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 251/501] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:10.240150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff8c2f7c-b57b-4808-91b7-f8714b02f7fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:10.240771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff8c2f7c-b57b-4808-91b7-f8714b02f7fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:10.247971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8c2f7c-b57b-4808-91b7-f8714b02f7fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:10.248428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8c2f7c-b57b-4808-91b7-f8714b02f7fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:10.249250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8c2f7c-b57b-4808-91b7-f8714b02f7fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:10.249683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8c2f7c-b57b-4808-91b7-f8714b02f7fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:10.392761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff8c2f7c-b57b-4808-91b7-f8714b02f7fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:10.400880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff8c2f7c-b57b-4808-91b7-f8714b02f7fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.164478 Apr 11 19:51:10.401450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 251/502] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:10 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:10.638132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:10.638949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:10.645974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:10.646423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:10.647210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:10.647650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:10.782339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:10.791742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:10.793585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:10.795749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42aa8a7d-98e9-4c70-9129-8b368f460a8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.160662 Apr 11 19:51:10.795749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 252/503] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:11.420164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7abd65ee-c039-4a99-9ada-8e318b9ee219 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:11.420772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7abd65ee-c039-4a99-9ada-8e318b9ee219 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:11.428165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7abd65ee-c039-4a99-9ada-8e318b9ee219 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:11.429828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7abd65ee-c039-4a99-9ada-8e318b9ee219 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:11.430704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7abd65ee-c039-4a99-9ada-8e318b9ee219 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:11.431075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7abd65ee-c039-4a99-9ada-8e318b9ee219 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:11.458985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-bafab42a-d2ad-4349-8138-4c9386236e96 req-5d2d3292-e1e9-4296-a582-299f4ed220cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2485fb-c412-422f-84b0-26e9200f5940", "tag": "38b4cc6e-f072-46cf-a68a-a3af8cc3637a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:11.468238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-bafab42a-d2ad-4349-8138-4c9386236e96 req-5d2d3292-e1e9-4296-a582-299f4ed220cb service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:11.468821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-bafab42a-d2ad-4349-8138-4c9386236e96 req-5d2d3292-e1e9-4296-a582-299f4ed220cb service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:11.495644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-bafab42a-d2ad-4349-8138-4c9386236e96 req-5d2d3292-e1e9-4296-a582-299f4ed220cb service nova] Creating event network-changed:38b4cc6e-f072-46cf-a68a-a3af8cc3637a for instance 2b2485fb-c412-422f-84b0-26e9200f5940 on hv-cinder-83078 Apr 11 19:51:11.502162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-bafab42a-d2ad-4349-8138-4c9386236e96 req-5d2d3292-e1e9-4296-a582-299f4ed220cb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047331 Apr 11 19:51:11.506007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 253/504] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:11.590133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7abd65ee-c039-4a99-9ada-8e318b9ee219 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:11.598584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7abd65ee-c039-4a99-9ada-8e318b9ee219 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.182550 Apr 11 19:51:11.599180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 252/505] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:11 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:11.815295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:11.815866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:11.822683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:11.823121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:11.823885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:11.824307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:11.962494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:11.971746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:11.973269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:11.974439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed4f7f78-66b0-457a-a81a-9bc4213e0ff0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.164045 Apr 11 19:51:11.974975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 254/506] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:12.615034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-462a0b65-1ccb-4c51-b21d-0f2c07901e69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:12.615644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-462a0b65-1ccb-4c51-b21d-0f2c07901e69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:12.625606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-462a0b65-1ccb-4c51-b21d-0f2c07901e69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:12.626371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-462a0b65-1ccb-4c51-b21d-0f2c07901e69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:12.627482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-462a0b65-1ccb-4c51-b21d-0f2c07901e69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:12.628222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-462a0b65-1ccb-4c51-b21d-0f2c07901e69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:12.774795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-462a0b65-1ccb-4c51-b21d-0f2c07901e69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:12.787968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-462a0b65-1ccb-4c51-b21d-0f2c07901e69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.176610 Apr 11 19:51:12.788567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 253/507] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:12 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:12.994855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:12.995438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:13.002429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.002875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.003645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.004071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.142969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:13.155166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:13.156693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:13.157960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6b496c09-06df-492c-b79f-dee4db4848bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.167246 Apr 11 19:51:13.158535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 255/508] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:13.204401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4be89b58-2345-4893-a675-076ff8a882a9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:13.204933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4be89b58-2345-4893-a675-076ff8a882a9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:13.211150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4be89b58-2345-4893-a675-076ff8a882a9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.211596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4be89b58-2345-4893-a675-076ff8a882a9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.212367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4be89b58-2345-4893-a675-076ff8a882a9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.212796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4be89b58-2345-4893-a675-076ff8a882a9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.235587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4be89b58-2345-4893-a675-076ff8a882a9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49/ips" status: 200 len: 151 microversion: 2.1 time: 0.035049 Apr 11 19:51:13.236439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 254/509] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 19:51:13 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:51:13.247056 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cf1a015-a355-46ae-a828-097410192a8a"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:13.248104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:13.254605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.255045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.255817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.256248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.337243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Invalid volume: volume 2cf1a015-a355-46ae-a828-097410192a8a is already attached to instances: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 Apr 11 19:51:13.337844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 400 to user: Invalid volume: volume 2cf1a015-a355-46ae-a828-097410192a8a is already attached to instances: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:51:13.338689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a58896a-bcbe-408f-a7a7-77849bbcb57b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095878 Apr 11 19:51:13.339275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 256/510] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 19:51:13 2022] POST /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 19:51:13.348628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-55283698-a5e9-499e-a41f-55c5548b4acc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:13.349209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-55283698-a5e9-499e-a41f-55c5548b4acc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:13.355278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55283698-a5e9-499e-a41f-55c5548b4acc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.355719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55283698-a5e9-499e-a41f-55c5548b4acc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.356479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55283698-a5e9-499e-a41f-55c5548b4acc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.356951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55283698-a5e9-499e-a41f-55c5548b4acc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.382743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-55283698-a5e9-499e-a41f-55c5548b4acc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 19:51:13.481068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-55283698-a5e9-499e-a41f-55c5548b4acc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 204 len: 0 microversion: 2.1 time: 0.136542 Apr 11 19:51:13.481679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 255/511] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 19:51:13 2022] DELETE /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:51:13.490006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0ceb2b0e-59f3-40c7-952d-51ab69b876d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:13.490609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0ceb2b0e-59f3-40c7-952d-51ab69b876d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:13.496833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ceb2b0e-59f3-40c7-952d-51ab69b876d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.497380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ceb2b0e-59f3-40c7-952d-51ab69b876d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.498072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ceb2b0e-59f3-40c7-952d-51ab69b876d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.498499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ceb2b0e-59f3-40c7-952d-51ab69b876d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.639461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0ceb2b0e-59f3-40c7-952d-51ab69b876d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:13.648253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0ceb2b0e-59f3-40c7-952d-51ab69b876d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.162039 Apr 11 19:51:13.649564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 257/512] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:13 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:13.806813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-19b31342-bfdb-455f-8b92-12663d5e7d1d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:13.807364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-19b31342-bfdb-455f-8b92-12663d5e7d1d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:13.814295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19b31342-bfdb-455f-8b92-12663d5e7d1d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.814746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19b31342-bfdb-455f-8b92-12663d5e7d1d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.815550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19b31342-bfdb-455f-8b92-12663d5e7d1d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:13.815979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19b31342-bfdb-455f-8b92-12663d5e7d1d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:13.951693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-19b31342-bfdb-455f-8b92-12663d5e7d1d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:13.962519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-19b31342-bfdb-455f-8b92-12663d5e7d1d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.160131 Apr 11 19:51:13.963160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 256/513] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:13 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:14.176186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:14.176834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:14.184072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:14.184523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:14.185327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:14.185756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:14.319404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:14.328332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:14.331527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:14.331527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4aa553a5-bbf6-4340-917d-488f2dd58c69 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.158939 Apr 11 19:51:14.331527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 258/514] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:14.668306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2308628f-32d7-443f-988e-e123193d737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:14.668851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2308628f-32d7-443f-988e-e123193d737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:14.675755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2308628f-32d7-443f-988e-e123193d737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:14.676202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2308628f-32d7-443f-988e-e123193d737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:14.676988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2308628f-32d7-443f-988e-e123193d737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:14.677449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2308628f-32d7-443f-988e-e123193d737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:14.814616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2308628f-32d7-443f-988e-e123193d737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:14.822229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2308628f-32d7-443f-988e-e123193d737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.157922 Apr 11 19:51:14.822807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 257/515] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:14 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:14.979733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-46d77537-bf43-44cc-b7d9-76647828f3a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:14.980344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-46d77537-bf43-44cc-b7d9-76647828f3a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:14.989501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46d77537-bf43-44cc-b7d9-76647828f3a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:14.990178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46d77537-bf43-44cc-b7d9-76647828f3a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:14.991413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46d77537-bf43-44cc-b7d9-76647828f3a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:14.992140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46d77537-bf43-44cc-b7d9-76647828f3a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:15.137306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-46d77537-bf43-44cc-b7d9-76647828f3a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:15.145431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-46d77537-bf43-44cc-b7d9-76647828f3a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.169536 Apr 11 19:51:15.146007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 259/516] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:14 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:15.349826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:15.350329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:15.357022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:15.357473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:15.358238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:15.358660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:15.496643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:15.505836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:15.507289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:15.508493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c68799e2-c515-4f0c-9e3d-536a8da85f00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.162737 Apr 11 19:51:15.509030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 258/517] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:15.844848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4a7c4aba-f271-4977-a7d5-9764adf8680e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:15.845637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4a7c4aba-f271-4977-a7d5-9764adf8680e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:15.854224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a7c4aba-f271-4977-a7d5-9764adf8680e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:15.854663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a7c4aba-f271-4977-a7d5-9764adf8680e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:15.855404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a7c4aba-f271-4977-a7d5-9764adf8680e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:15.855836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a7c4aba-f271-4977-a7d5-9764adf8680e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:15.994833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4a7c4aba-f271-4977-a7d5-9764adf8680e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:16.003325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4a7c4aba-f271-4977-a7d5-9764adf8680e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.162273 Apr 11 19:51:16.003905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 260/518] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:15 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:16.163240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9db32633-99aa-4597-bcb2-4fa952ad6ca4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:16.163796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9db32633-99aa-4597-bcb2-4fa952ad6ca4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:16.171104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9db32633-99aa-4597-bcb2-4fa952ad6ca4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:16.171575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9db32633-99aa-4597-bcb2-4fa952ad6ca4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:16.172841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9db32633-99aa-4597-bcb2-4fa952ad6ca4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:16.173329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9db32633-99aa-4597-bcb2-4fa952ad6ca4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:16.311228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9db32633-99aa-4597-bcb2-4fa952ad6ca4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:16.319121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9db32633-99aa-4597-bcb2-4fa952ad6ca4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.160296 Apr 11 19:51:16.319692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 259/519] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:16 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:16.527060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:16.527668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:16.537385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:16.537838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:16.538605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:16.539033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:16.674667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:16.685648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:16.687162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:16.688338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2ee20cda-bb17-42b3-9b77-504ae22c77c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.165316 Apr 11 19:51:16.688922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 261/520] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:51:17.020875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0af35062-1080-447f-8c09-6ad3c9ec1c4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:17.021546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0af35062-1080-447f-8c09-6ad3c9ec1c4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:17.028343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af35062-1080-447f-8c09-6ad3c9ec1c4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:17.028786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af35062-1080-447f-8c09-6ad3c9ec1c4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:17.029589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af35062-1080-447f-8c09-6ad3c9ec1c4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:17.030014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af35062-1080-447f-8c09-6ad3c9ec1c4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:17.166632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0af35062-1080-447f-8c09-6ad3c9ec1c4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:17.174914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0af35062-1080-447f-8c09-6ad3c9ec1c4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.157881 Apr 11 19:51:17.175463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 260/521] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:17 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:17.336020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1269f72-2d73-4f27-8b3e-5130a8165879 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:17.336633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1269f72-2d73-4f27-8b3e-5130a8165879 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:17.343659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1269f72-2d73-4f27-8b3e-5130a8165879 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:17.344112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1269f72-2d73-4f27-8b3e-5130a8165879 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:17.344870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1269f72-2d73-4f27-8b3e-5130a8165879 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:17.345464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1269f72-2d73-4f27-8b3e-5130a8165879 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:17.483369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1269f72-2d73-4f27-8b3e-5130a8165879 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:17.494177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1269f72-2d73-4f27-8b3e-5130a8165879 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.161964 Apr 11 19:51:17.494998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 262/522] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:17 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:17.707776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:17.708314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:17.721200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:17.721643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:17.722411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:17.722835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:17.864595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:17.875105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:17.876930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:17.878114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cf526ea-81ec-4b14-87b2-11e0fc78232a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.174493 Apr 11 19:51:17.878672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 261/523] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:18.191979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9a0f5e6e-e4d7-41a7-a9d5-2b82eb47d979 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:18.192594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9a0f5e6e-e4d7-41a7-a9d5-2b82eb47d979 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:18.199209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a0f5e6e-e4d7-41a7-a9d5-2b82eb47d979 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:18.199651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a0f5e6e-e4d7-41a7-a9d5-2b82eb47d979 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:18.200419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a0f5e6e-e4d7-41a7-a9d5-2b82eb47d979 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:18.200953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a0f5e6e-e4d7-41a7-a9d5-2b82eb47d979 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:18.334901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9a0f5e6e-e4d7-41a7-a9d5-2b82eb47d979 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:18.343429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9a0f5e6e-e4d7-41a7-a9d5-2b82eb47d979 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.155298 Apr 11 19:51:18.344430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 263/524] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:18 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:18.512410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b429f256-ae5f-4e86-9ef3-80d584660160 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:18.513011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b429f256-ae5f-4e86-9ef3-80d584660160 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:18.519873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b429f256-ae5f-4e86-9ef3-80d584660160 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:18.520322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b429f256-ae5f-4e86-9ef3-80d584660160 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:18.521114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b429f256-ae5f-4e86-9ef3-80d584660160 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:18.521572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b429f256-ae5f-4e86-9ef3-80d584660160 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:18.653683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b429f256-ae5f-4e86-9ef3-80d584660160 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:18.661296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b429f256-ae5f-4e86-9ef3-80d584660160 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.152794 Apr 11 19:51:18.661853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 262/525] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:18 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:18.900103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:18.900710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:18.907603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:18.908084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:18.908866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:18.909327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:19.044302 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:19.055683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:19.057415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:19.059528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6133919a-0e10-418d-a158-41875ef06d46 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.163114 Apr 11 19:51:19.060653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 264/526] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:19.360552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-32062ab5-5887-42be-970a-2b1ed3b0f83b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:19.361177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-32062ab5-5887-42be-970a-2b1ed3b0f83b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:19.367856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32062ab5-5887-42be-970a-2b1ed3b0f83b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:19.368294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32062ab5-5887-42be-970a-2b1ed3b0f83b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:19.369099 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32062ab5-5887-42be-970a-2b1ed3b0f83b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:19.369526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32062ab5-5887-42be-970a-2b1ed3b0f83b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:19.503668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-32062ab5-5887-42be-970a-2b1ed3b0f83b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:19.512184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-32062ab5-5887-42be-970a-2b1ed3b0f83b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.155496 Apr 11 19:51:19.512736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 263/527] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:19 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:19.680469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b329a51e-2bfd-4ef6-bbb7-280526b8489a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:19.681191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b329a51e-2bfd-4ef6-bbb7-280526b8489a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:19.689394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b329a51e-2bfd-4ef6-bbb7-280526b8489a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:19.689835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b329a51e-2bfd-4ef6-bbb7-280526b8489a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:19.690592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b329a51e-2bfd-4ef6-bbb7-280526b8489a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:19.691014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b329a51e-2bfd-4ef6-bbb7-280526b8489a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:19.835655 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b329a51e-2bfd-4ef6-bbb7-280526b8489a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:19.843353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b329a51e-2bfd-4ef6-bbb7-280526b8489a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.168489 Apr 11 19:51:19.843928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 265/528] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:19 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:20.079777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:20.080473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:20.090323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:20.091032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:20.092287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:20.092968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:20.250627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:20.254993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:20.256480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:20.257681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aa8d71b7-1c51-4f00-8dd3-ca5724432a17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.182240 Apr 11 19:51:20.258273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 264/529] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:20.530716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ffebc79-66d5-47cf-957e-514dd45dbb1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:20.531320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ffebc79-66d5-47cf-957e-514dd45dbb1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:20.540324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ffebc79-66d5-47cf-957e-514dd45dbb1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:20.541130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ffebc79-66d5-47cf-957e-514dd45dbb1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:20.542016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ffebc79-66d5-47cf-957e-514dd45dbb1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:20.542449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ffebc79-66d5-47cf-957e-514dd45dbb1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:20.683381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ffebc79-66d5-47cf-957e-514dd45dbb1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:20.694102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ffebc79-66d5-47cf-957e-514dd45dbb1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.167234 Apr 11 19:51:20.694692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 266/530] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:20 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:20.860137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d64ea463-b457-407b-9a49-d3a3158f9c49 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:20.860720 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d64ea463-b457-407b-9a49-d3a3158f9c49 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:20.867103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d64ea463-b457-407b-9a49-d3a3158f9c49 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:20.867548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d64ea463-b457-407b-9a49-d3a3158f9c49 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:20.868307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d64ea463-b457-407b-9a49-d3a3158f9c49 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:20.868727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d64ea463-b457-407b-9a49-d3a3158f9c49 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:21.009840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d64ea463-b457-407b-9a49-d3a3158f9c49 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:21.018631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d64ea463-b457-407b-9a49-d3a3158f9c49 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.162545 Apr 11 19:51:21.019213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 265/531] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:20 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:21.275874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:21.276385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:21.283120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:21.283560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:21.284315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:21.284737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:21.415459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:21.424451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:21.425975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:21.427151 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-78dcf92f-7c73-4f87-bfbc-6011af1fe01c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.155391 Apr 11 19:51:21.427720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 267/532] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:21.711357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-654bbe97-6938-4ffc-9a0e-be1efa9bb5b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:21.711964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-654bbe97-6938-4ffc-9a0e-be1efa9bb5b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:21.718821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-654bbe97-6938-4ffc-9a0e-be1efa9bb5b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:21.719270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-654bbe97-6938-4ffc-9a0e-be1efa9bb5b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:21.720040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-654bbe97-6938-4ffc-9a0e-be1efa9bb5b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:21.720469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-654bbe97-6938-4ffc-9a0e-be1efa9bb5b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:21.867440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-654bbe97-6938-4ffc-9a0e-be1efa9bb5b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:21.877550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-654bbe97-6938-4ffc-9a0e-be1efa9bb5b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.169996 Apr 11 19:51:21.878267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 266/533] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:21 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:22.035951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79b50d09-b668-435f-8c3e-817eb032e898 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:22.036522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-79b50d09-b668-435f-8c3e-817eb032e898 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:22.044520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79b50d09-b668-435f-8c3e-817eb032e898 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:22.045300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79b50d09-b668-435f-8c3e-817eb032e898 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:22.046558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79b50d09-b668-435f-8c3e-817eb032e898 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:22.047247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79b50d09-b668-435f-8c3e-817eb032e898 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:22.181202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79b50d09-b668-435f-8c3e-817eb032e898 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:22.190814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79b50d09-b668-435f-8c3e-817eb032e898 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.158595 Apr 11 19:51:22.191715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 268/534] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:22 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:22.449617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:22.450416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:22.457061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:22.457503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:22.458266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:22.458676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:22.592700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:22.601829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:22.603311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:22.604486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-219d58f8-a05f-4a6a-b224-000ec9378614 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.161246 Apr 11 19:51:22.605081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 267/535] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:22.902751 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ffe90838-603a-4683-bd03-709222949af5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:22.903556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ffe90838-603a-4683-bd03-709222949af5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:22.910035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe90838-603a-4683-bd03-709222949af5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:22.910485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe90838-603a-4683-bd03-709222949af5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:22.911247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe90838-603a-4683-bd03-709222949af5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:22.911678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe90838-603a-4683-bd03-709222949af5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:23.055159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffe90838-603a-4683-bd03-709222949af5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:23.063554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ffe90838-603a-4683-bd03-709222949af5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.169671 Apr 11 19:51:23.064150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 269/536] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:22 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:23.212958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ee493d9-cdc2-4665-b59d-29b3978195ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:23.213571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ee493d9-cdc2-4665-b59d-29b3978195ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:23.221317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ee493d9-cdc2-4665-b59d-29b3978195ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:23.222077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ee493d9-cdc2-4665-b59d-29b3978195ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:23.223167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ee493d9-cdc2-4665-b59d-29b3978195ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:23.223604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ee493d9-cdc2-4665-b59d-29b3978195ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:23.377509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5ee493d9-cdc2-4665-b59d-29b3978195ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:23.386493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ee493d9-cdc2-4665-b59d-29b3978195ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.177410 Apr 11 19:51:23.387077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 268/537] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:23 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:23.626259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:23.627323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:23.641483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:23.641940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:23.642731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:23.643157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:23.790150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:23.799034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:23.800519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:23.801997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0c094a60-a440-443f-9aba-937ae01770d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.183156 Apr 11 19:51:23.802656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 270/538] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:24.082107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68c058ba-a2d7-41ab-958a-5c302c073375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:24.082710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68c058ba-a2d7-41ab-958a-5c302c073375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:24.089374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68c058ba-a2d7-41ab-958a-5c302c073375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:24.089816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68c058ba-a2d7-41ab-958a-5c302c073375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:24.090585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68c058ba-a2d7-41ab-958a-5c302c073375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:24.091071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68c058ba-a2d7-41ab-958a-5c302c073375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:24.223604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-68c058ba-a2d7-41ab-958a-5c302c073375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:24.231831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68c058ba-a2d7-41ab-958a-5c302c073375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.153719 Apr 11 19:51:24.232462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 269/539] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:24 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:24.404033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6bbf40ad-5f10-435f-b074-4a22304b2272 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:24.404635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6bbf40ad-5f10-435f-b074-4a22304b2272 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:24.411266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bbf40ad-5f10-435f-b074-4a22304b2272 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:24.411723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bbf40ad-5f10-435f-b074-4a22304b2272 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:24.412489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bbf40ad-5f10-435f-b074-4a22304b2272 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:24.412925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bbf40ad-5f10-435f-b074-4a22304b2272 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:24.768687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6bbf40ad-5f10-435f-b074-4a22304b2272 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:24.776791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6bbf40ad-5f10-435f-b074-4a22304b2272 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.376817 Apr 11 19:51:24.777412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 271/540] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:24 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:24.827533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:24.828300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:24.834895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:24.835333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:24.836362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:24.836877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:24.969228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:24.979407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:24.980884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:24.982123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73e64619-1fbe-4bb2-81b1-62456f507888 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.159787 Apr 11 19:51:24.982702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 270/541] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:25.253317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b608c673-fda5-4ff2-a881-8468fec3e3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:25.253821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b608c673-fda5-4ff2-a881-8468fec3e3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:25.260449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b608c673-fda5-4ff2-a881-8468fec3e3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:25.260917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b608c673-fda5-4ff2-a881-8468fec3e3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:25.261702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b608c673-fda5-4ff2-a881-8468fec3e3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:25.262133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b608c673-fda5-4ff2-a881-8468fec3e3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:25.403204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b608c673-fda5-4ff2-a881-8468fec3e3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:25.411653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b608c673-fda5-4ff2-a881-8468fec3e3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.162814 Apr 11 19:51:25.412298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 272/542] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:25 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:25.793969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fdc8bfa3-786f-417b-bdc6-da9af3eb28cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:25.794591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fdc8bfa3-786f-417b-bdc6-da9af3eb28cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:25.802151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdc8bfa3-786f-417b-bdc6-da9af3eb28cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:25.802603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdc8bfa3-786f-417b-bdc6-da9af3eb28cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:25.803385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdc8bfa3-786f-417b-bdc6-da9af3eb28cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:25.803821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdc8bfa3-786f-417b-bdc6-da9af3eb28cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:25.943794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fdc8bfa3-786f-417b-bdc6-da9af3eb28cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:25.953342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fdc8bfa3-786f-417b-bdc6-da9af3eb28cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.163168 Apr 11 19:51:25.953948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 271/543] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:25 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:26.000285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:26.000893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:26.007570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:26.008018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:26.008787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:26.009271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:26.153648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:26.162327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:26.163818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:26.164994 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc0af7d8-1013-4812-a6c8-1b79abc290f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.169085 Apr 11 19:51:26.165616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 273/544] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:26.429339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-55b45a5a-36af-48f7-a372-e5375e26cd83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:26.429939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-55b45a5a-36af-48f7-a372-e5375e26cd83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:26.436613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55b45a5a-36af-48f7-a372-e5375e26cd83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:26.437159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55b45a5a-36af-48f7-a372-e5375e26cd83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:26.437920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55b45a5a-36af-48f7-a372-e5375e26cd83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:26.438350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55b45a5a-36af-48f7-a372-e5375e26cd83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:26.576431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-55b45a5a-36af-48f7-a372-e5375e26cd83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:26.585785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-55b45a5a-36af-48f7-a372-e5375e26cd83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.160273 Apr 11 19:51:26.586371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 272/545] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:26 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:26.973816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c543829-14d7-4777-ad0c-3be86bdc94cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:26.974448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c543829-14d7-4777-ad0c-3be86bdc94cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:26.981565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c543829-14d7-4777-ad0c-3be86bdc94cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:26.982419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c543829-14d7-4777-ad0c-3be86bdc94cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:26.983148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c543829-14d7-4777-ad0c-3be86bdc94cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:26.983492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c543829-14d7-4777-ad0c-3be86bdc94cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:27.119330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3c543829-14d7-4777-ad0c-3be86bdc94cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:27.127539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c543829-14d7-4777-ad0c-3be86bdc94cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.157575 Apr 11 19:51:27.128126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 274/546] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:26 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:27.186368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:27.186966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:27.193624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:27.194073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:27.194844 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:27.195279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:27.338015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:27.347122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:27.348620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:27.349828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-78ea8769-653b-46ac-8965-84b43073d9ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.168370 Apr 11 19:51:27.350733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 273/547] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:27.604079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba434e7b-f491-4408-858f-8b611eb83491 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:27.604580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba434e7b-f491-4408-858f-8b611eb83491 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:27.611312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba434e7b-f491-4408-858f-8b611eb83491 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:27.611751 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba434e7b-f491-4408-858f-8b611eb83491 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:27.612518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba434e7b-f491-4408-858f-8b611eb83491 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:27.612973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba434e7b-f491-4408-858f-8b611eb83491 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:27.753095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba434e7b-f491-4408-858f-8b611eb83491 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:27.760885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba434e7b-f491-4408-858f-8b611eb83491 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.160792 Apr 11 19:51:27.761497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 275/548] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:27 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:28.143941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b808c525-d136-409a-8db3-d73eb96073de tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:28.144559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b808c525-d136-409a-8db3-d73eb96073de tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:28.150851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b808c525-d136-409a-8db3-d73eb96073de tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:28.151303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b808c525-d136-409a-8db3-d73eb96073de tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:28.152080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b808c525-d136-409a-8db3-d73eb96073de tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:28.152511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b808c525-d136-409a-8db3-d73eb96073de tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:28.294522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b808c525-d136-409a-8db3-d73eb96073de tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:28.302934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b808c525-d136-409a-8db3-d73eb96073de tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.162917 Apr 11 19:51:28.303711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 274/549] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:28 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:28.367978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:28.368525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:28.376236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:28.376675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:28.377457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:28.377983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:28.515393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:28.524220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:28.525752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:28.526910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4aa95910-e264-42e9-9c98-daa04fc361e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.163002 Apr 11 19:51:28.527503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 276/550] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:28.779347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-524b7597-9a61-41df-81a1-93cddde19a46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:28.779921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-524b7597-9a61-41df-81a1-93cddde19a46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:28.786497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-524b7597-9a61-41df-81a1-93cddde19a46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:28.786941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-524b7597-9a61-41df-81a1-93cddde19a46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:28.787703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-524b7597-9a61-41df-81a1-93cddde19a46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:28.788123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-524b7597-9a61-41df-81a1-93cddde19a46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:28.922503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-524b7597-9a61-41df-81a1-93cddde19a46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:28.930843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-524b7597-9a61-41df-81a1-93cddde19a46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.155458 Apr 11 19:51:28.931441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 275/551] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:28 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:29.322773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bbed7bc9-8eee-45a4-ac66-c102762a46d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:29.323371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bbed7bc9-8eee-45a4-ac66-c102762a46d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:29.329936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbed7bc9-8eee-45a4-ac66-c102762a46d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.330405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbed7bc9-8eee-45a4-ac66-c102762a46d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.331172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbed7bc9-8eee-45a4-ac66-c102762a46d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.331598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbed7bc9-8eee-45a4-ac66-c102762a46d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.470128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bbed7bc9-8eee-45a4-ac66-c102762a46d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:29.477952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bbed7bc9-8eee-45a4-ac66-c102762a46d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.159058 Apr 11 19:51:29.478566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 277/552] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:29 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:29.545792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:29.546438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:29.553270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.553683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.554456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.554875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.613064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6cdd1485-2444-4bab-9c01-33680e1505fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:29.614114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6cdd1485-2444-4bab-9c01-33680e1505fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:29.620541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cdd1485-2444-4bab-9c01-33680e1505fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.621021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cdd1485-2444-4bab-9c01-33680e1505fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.621867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cdd1485-2444-4bab-9c01-33680e1505fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.622242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cdd1485-2444-4bab-9c01-33680e1505fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.689221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:29.698594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:29.700179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:29.701383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5cb0cddc-8caa-4425-8709-ba9087084ccf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.159729 Apr 11 19:51:29.701743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6cdd1485-2444-4bab-9c01-33680e1505fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/action" status: 202 len: 0 microversion: 2.1 time: 0.092495 Apr 11 19:51:29.701965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 276/553] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:29.705283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 278/554] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 19:51:29 2022] POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:51:29.710380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-89012e43-e5f5-42e0-9e9b-5b67bd264dd5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:29.710993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-89012e43-e5f5-42e0-9e9b-5b67bd264dd5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:29.721228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89012e43-e5f5-42e0-9e9b-5b67bd264dd5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.721679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89012e43-e5f5-42e0-9e9b-5b67bd264dd5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.722468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89012e43-e5f5-42e0-9e9b-5b67bd264dd5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.722903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89012e43-e5f5-42e0-9e9b-5b67bd264dd5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.884886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-89012e43-e5f5-42e0-9e9b-5b67bd264dd5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:29.894089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-89012e43-e5f5-42e0-9e9b-5b67bd264dd5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.187416 Apr 11 19:51:29.894675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 277/555] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:29.950359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e466a725-5f20-4a76-a56e-8342feec026d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:29.950979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e466a725-5f20-4a76-a56e-8342feec026d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:29.961645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e466a725-5f20-4a76-a56e-8342feec026d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.962149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e466a725-5f20-4a76-a56e-8342feec026d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:29.963179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e466a725-5f20-4a76-a56e-8342feec026d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:29.963738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e466a725-5f20-4a76-a56e-8342feec026d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:30.107737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e466a725-5f20-4a76-a56e-8342feec026d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:30.115773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e466a725-5f20-4a76-a56e-8342feec026d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.170681 Apr 11 19:51:30.116361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 279/556] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:29 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:30.495974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fa3cfc34-272f-4530-8300-355b220109cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:30.496597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fa3cfc34-272f-4530-8300-355b220109cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:30.503560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa3cfc34-272f-4530-8300-355b220109cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:30.503988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa3cfc34-272f-4530-8300-355b220109cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:30.504973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa3cfc34-272f-4530-8300-355b220109cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:30.505590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa3cfc34-272f-4530-8300-355b220109cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:30.647546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fa3cfc34-272f-4530-8300-355b220109cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:30.656267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fa3cfc34-272f-4530-8300-355b220109cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.164047 Apr 11 19:51:30.657073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 278/557] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:30 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:30.720217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:30.720824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:30.729096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:30.729526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:30.730329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:30.730745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:30.866914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:30.876444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:30.878158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:30.879466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5a244ae-bccc-4211-aa6d-5ebdee34c443 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.163359 Apr 11 19:51:30.880026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 280/558] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:30.913663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8da6a44e-8372-4d90-9317-90b56b82908b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:30.914181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8da6a44e-8372-4d90-9317-90b56b82908b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:30.920460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8da6a44e-8372-4d90-9317-90b56b82908b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:30.920896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8da6a44e-8372-4d90-9317-90b56b82908b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:30.921722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8da6a44e-8372-4d90-9317-90b56b82908b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:30.922146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8da6a44e-8372-4d90-9317-90b56b82908b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:31.067880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8da6a44e-8372-4d90-9317-90b56b82908b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:31.076248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8da6a44e-8372-4d90-9317-90b56b82908b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.166530 Apr 11 19:51:31.076828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 279/559] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:31.134530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-542296c4-9014-41c6-a7eb-20d4aa0f567e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:31.135136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-542296c4-9014-41c6-a7eb-20d4aa0f567e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:31.141630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542296c4-9014-41c6-a7eb-20d4aa0f567e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:31.142070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542296c4-9014-41c6-a7eb-20d4aa0f567e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:31.142823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542296c4-9014-41c6-a7eb-20d4aa0f567e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:31.143247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542296c4-9014-41c6-a7eb-20d4aa0f567e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:31.283491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-542296c4-9014-41c6-a7eb-20d4aa0f567e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:31.294839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-542296c4-9014-41c6-a7eb-20d4aa0f567e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.164127 Apr 11 19:51:31.295424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 281/560] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:31 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:31.673620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5bd5e7cd-8588-420e-9448-e25e60498405 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:31.674225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5bd5e7cd-8588-420e-9448-e25e60498405 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:31.681142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bd5e7cd-8588-420e-9448-e25e60498405 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:31.681592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bd5e7cd-8588-420e-9448-e25e60498405 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:31.682367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bd5e7cd-8588-420e-9448-e25e60498405 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:31.682797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bd5e7cd-8588-420e-9448-e25e60498405 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:31.824423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5bd5e7cd-8588-420e-9448-e25e60498405 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:31.832487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5bd5e7cd-8588-420e-9448-e25e60498405 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.162737 Apr 11 19:51:31.833111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 280/561] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:31 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:31.899604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:31.900207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:31.906996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:31.907446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:31.908221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:31.908650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:32.045944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:32.054682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:32.056330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:32.057524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f4d52bbf-312c-48d2-a3bb-9637d32fd146 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.161982 Apr 11 19:51:32.058097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 282/562] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:51:32.095629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f611523b-ca76-4100-99d4-9fc654609233 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:32.096241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f611523b-ca76-4100-99d4-9fc654609233 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:32.103323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f611523b-ca76-4100-99d4-9fc654609233 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:32.103781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f611523b-ca76-4100-99d4-9fc654609233 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:32.105934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f611523b-ca76-4100-99d4-9fc654609233 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:32.106591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f611523b-ca76-4100-99d4-9fc654609233 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:32.259004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f611523b-ca76-4100-99d4-9fc654609233 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:32.268296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f611523b-ca76-4100-99d4-9fc654609233 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.177900 Apr 11 19:51:32.268838 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 281/563] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:32.312865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df9d4c34-22de-4270-ae53-0c4fbd57d64a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:32.313538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df9d4c34-22de-4270-ae53-0c4fbd57d64a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:32.319987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df9d4c34-22de-4270-ae53-0c4fbd57d64a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:32.320438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df9d4c34-22de-4270-ae53-0c4fbd57d64a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:32.321248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df9d4c34-22de-4270-ae53-0c4fbd57d64a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:32.321676 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df9d4c34-22de-4270-ae53-0c4fbd57d64a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:32.451482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df9d4c34-22de-4270-ae53-0c4fbd57d64a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:32.459974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df9d4c34-22de-4270-ae53-0c4fbd57d64a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.151109 Apr 11 19:51:32.460557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 283/564] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:32 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:32.851495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a4fdc70-5895-4aec-90a8-0c6d3519250e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:32.852422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6a4fdc70-5895-4aec-90a8-0c6d3519250e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:32.861558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a4fdc70-5895-4aec-90a8-0c6d3519250e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:32.862009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a4fdc70-5895-4aec-90a8-0c6d3519250e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:32.862795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a4fdc70-5895-4aec-90a8-0c6d3519250e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:32.863230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a4fdc70-5895-4aec-90a8-0c6d3519250e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:33.004299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a4fdc70-5895-4aec-90a8-0c6d3519250e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:33.011766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6a4fdc70-5895-4aec-90a8-0c6d3519250e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.165123 Apr 11 19:51:33.012311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 282/565] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:32 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:33.076333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:33.077352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:33.084174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:33.084620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:33.085435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:33.085858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:33.225701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:33.236525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:33.238031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:33.239200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02041761-0e4b-41a2-9941-6de65b718fe5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.167174 Apr 11 19:51:33.239782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 284/566] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:33.285840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-19c3f460-6926-48f4-9d69-0e587483eff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:33.286451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-19c3f460-6926-48f4-9d69-0e587483eff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:33.293242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19c3f460-6926-48f4-9d69-0e587483eff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:33.293691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19c3f460-6926-48f4-9d69-0e587483eff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:33.294448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19c3f460-6926-48f4-9d69-0e587483eff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:33.295797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19c3f460-6926-48f4-9d69-0e587483eff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:33.448981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-19c3f460-6926-48f4-9d69-0e587483eff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:33.457461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-19c3f460-6926-48f4-9d69-0e587483eff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.175412 Apr 11 19:51:33.458006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 283/567] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:33.480887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb6ed2e4-9b3f-47b7-ab3a-8581835e35fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:33.481506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb6ed2e4-9b3f-47b7-ab3a-8581835e35fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:33.487909 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb6ed2e4-9b3f-47b7-ab3a-8581835e35fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:33.488352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb6ed2e4-9b3f-47b7-ab3a-8581835e35fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:33.489142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb6ed2e4-9b3f-47b7-ab3a-8581835e35fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:33.489563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb6ed2e4-9b3f-47b7-ab3a-8581835e35fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:33.625635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb6ed2e4-9b3f-47b7-ab3a-8581835e35fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:33.635864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb6ed2e4-9b3f-47b7-ab3a-8581835e35fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.158770 Apr 11 19:51:33.636442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 285/568] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:33 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:34.030036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b00b67f-89fc-43d0-b0d9-98b58b1bbc8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:34.030725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b00b67f-89fc-43d0-b0d9-98b58b1bbc8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:34.037669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b00b67f-89fc-43d0-b0d9-98b58b1bbc8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:34.038121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b00b67f-89fc-43d0-b0d9-98b58b1bbc8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:34.038922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b00b67f-89fc-43d0-b0d9-98b58b1bbc8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:34.039358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b00b67f-89fc-43d0-b0d9-98b58b1bbc8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:34.179245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0b00b67f-89fc-43d0-b0d9-98b58b1bbc8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:34.191165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b00b67f-89fc-43d0-b0d9-98b58b1bbc8e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.165032 Apr 11 19:51:34.192010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 284/569] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:34 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:34.259397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:34.260273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:34.268778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:34.269265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:34.270033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:34.270456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:34.409836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:34.421557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:34.423049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:34.424236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b46afec3-e38f-4f3a-b94c-0408a08f95a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.169810 Apr 11 19:51:34.424808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 286/570] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:34.475383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a3eeb4d-7bf3-4f66-8beb-041baa9e1140 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:34.476015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6a3eeb4d-7bf3-4f66-8beb-041baa9e1140 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:34.483710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a3eeb4d-7bf3-4f66-8beb-041baa9e1140 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:34.484194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a3eeb4d-7bf3-4f66-8beb-041baa9e1140 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:34.484970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a3eeb4d-7bf3-4f66-8beb-041baa9e1140 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:34.485420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a3eeb4d-7bf3-4f66-8beb-041baa9e1140 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:34.633896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a3eeb4d-7bf3-4f66-8beb-041baa9e1140 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:34.642476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6a3eeb4d-7bf3-4f66-8beb-041baa9e1140 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.170985 Apr 11 19:51:34.643065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 285/571] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:34.653545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-60d1cae1-758c-4f3a-86d9-a092bfcde7e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:34.654278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-60d1cae1-758c-4f3a-86d9-a092bfcde7e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:34.662482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60d1cae1-758c-4f3a-86d9-a092bfcde7e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:34.662482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60d1cae1-758c-4f3a-86d9-a092bfcde7e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:34.662482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60d1cae1-758c-4f3a-86d9-a092bfcde7e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:34.662482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60d1cae1-758c-4f3a-86d9-a092bfcde7e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:34.799000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60d1cae1-758c-4f3a-86d9-a092bfcde7e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:34.809526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-60d1cae1-758c-4f3a-86d9-a092bfcde7e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.159867 Apr 11 19:51:34.810143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 287/572] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:34 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:35.212286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1f20dba4-4cdc-4eb8-bdeb-cc2827823458 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:35.212870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1f20dba4-4cdc-4eb8-bdeb-cc2827823458 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:35.220052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f20dba4-4cdc-4eb8-bdeb-cc2827823458 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:35.220468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f20dba4-4cdc-4eb8-bdeb-cc2827823458 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:35.224633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f20dba4-4cdc-4eb8-bdeb-cc2827823458 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:35.224633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f20dba4-4cdc-4eb8-bdeb-cc2827823458 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:35.357882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1f20dba4-4cdc-4eb8-bdeb-cc2827823458 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:35.365734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1f20dba4-4cdc-4eb8-bdeb-cc2827823458 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.157706 Apr 11 19:51:35.366308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 286/573] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:35 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:35.443556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:35.444135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:35.451833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:35.452566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:35.453482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:35.453903 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:35.593072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:35.602330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:35.603822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:35.604972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7345bf4d-28b1-4776-b3c7-6423bf513266 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.165500 Apr 11 19:51:35.605599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 288/574] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:35.660054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9506e795-fc32-4b13-9ae6-bb362ea1ec16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:35.660649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9506e795-fc32-4b13-9ae6-bb362ea1ec16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:35.667219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9506e795-fc32-4b13-9ae6-bb362ea1ec16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:35.667662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9506e795-fc32-4b13-9ae6-bb362ea1ec16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:35.668426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9506e795-fc32-4b13-9ae6-bb362ea1ec16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:35.668848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9506e795-fc32-4b13-9ae6-bb362ea1ec16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:35.824165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9506e795-fc32-4b13-9ae6-bb362ea1ec16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:35.828106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8081d02f-c9f2-4797-bec8-4b3ef0c2fe84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:35.828887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8081d02f-c9f2-4797-bec8-4b3ef0c2fe84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:35.834553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9506e795-fc32-4b13-9ae6-bb362ea1ec16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.178421 Apr 11 19:51:35.835175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8081d02f-c9f2-4797-bec8-4b3ef0c2fe84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:35.835304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 287/575] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:35.835987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8081d02f-c9f2-4797-bec8-4b3ef0c2fe84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:35.836829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8081d02f-c9f2-4797-bec8-4b3ef0c2fe84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:35.837360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8081d02f-c9f2-4797-bec8-4b3ef0c2fe84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:35.979995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8081d02f-c9f2-4797-bec8-4b3ef0c2fe84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:35.987976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8081d02f-c9f2-4797-bec8-4b3ef0c2fe84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.164207 Apr 11 19:51:35.988551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 289/576] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:35 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:36.383535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-93cd6f7a-2997-4ff4-8f14-68384dfbf7a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:36.384150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-93cd6f7a-2997-4ff4-8f14-68384dfbf7a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:36.392307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93cd6f7a-2997-4ff4-8f14-68384dfbf7a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:36.392760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93cd6f7a-2997-4ff4-8f14-68384dfbf7a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:36.393596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93cd6f7a-2997-4ff4-8f14-68384dfbf7a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:36.394032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93cd6f7a-2997-4ff4-8f14-68384dfbf7a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:36.541284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-93cd6f7a-2997-4ff4-8f14-68384dfbf7a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:36.549420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-93cd6f7a-2997-4ff4-8f14-68384dfbf7a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.169752 Apr 11 19:51:36.550036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 288/577] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:36 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:36.623287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:36.624071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:36.631449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:36.631891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:36.632670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:36.633144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:36.772615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:36.781703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:36.784082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:36.785796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d103c919-46c4-4488-8e47-b0b173ed13f6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.166540 Apr 11 19:51:36.786350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 290/578] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:36.852168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-765c55fd-f0e5-447b-88ba-1a183f4559d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:36.852958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-765c55fd-f0e5-447b-88ba-1a183f4559d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:36.859312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-765c55fd-f0e5-447b-88ba-1a183f4559d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:36.859758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-765c55fd-f0e5-447b-88ba-1a183f4559d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:36.860523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-765c55fd-f0e5-447b-88ba-1a183f4559d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:36.860957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-765c55fd-f0e5-447b-88ba-1a183f4559d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:37.006016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65eade6a-2661-420e-b893-fa2f0fa3c195 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:37.006511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65eade6a-2661-420e-b893-fa2f0fa3c195 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:37.012773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65eade6a-2661-420e-b893-fa2f0fa3c195 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:37.013262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65eade6a-2661-420e-b893-fa2f0fa3c195 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:37.013431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-765c55fd-f0e5-447b-88ba-1a183f4559d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:37.014036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65eade6a-2661-420e-b893-fa2f0fa3c195 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:37.014505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65eade6a-2661-420e-b893-fa2f0fa3c195 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:37.021932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-765c55fd-f0e5-447b-88ba-1a183f4559d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.173661 Apr 11 19:51:37.022515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 289/579] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:37.155482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65eade6a-2661-420e-b893-fa2f0fa3c195 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:37.163243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65eade6a-2661-420e-b893-fa2f0fa3c195 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.161163 Apr 11 19:51:37.163823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 291/580] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:37 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:37.570681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-446f3acb-ceda-4a2d-a2a0-9e73a4cfc46c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:37.571624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-446f3acb-ceda-4a2d-a2a0-9e73a4cfc46c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:37.580462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-446f3acb-ceda-4a2d-a2a0-9e73a4cfc46c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:37.580932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-446f3acb-ceda-4a2d-a2a0-9e73a4cfc46c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:37.581689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-446f3acb-ceda-4a2d-a2a0-9e73a4cfc46c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:37.582133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-446f3acb-ceda-4a2d-a2a0-9e73a4cfc46c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:37.720001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-446f3acb-ceda-4a2d-a2a0-9e73a4cfc46c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:37.728499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-446f3acb-ceda-4a2d-a2a0-9e73a4cfc46c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.164143 Apr 11 19:51:37.729116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 290/581] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:37 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:37.810803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:37.811709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:37.819757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:37.820481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:37.821730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:37.822401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:37.976319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:37.984927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:37.986418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:37.987580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e41da59-70d8-48bb-9d2b-433927cc8dd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.180873 Apr 11 19:51:37.988146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 292/582] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:38.045986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8cd5765d-6ac0-4bd4-b8b0-701615ac97eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:38.046757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8cd5765d-6ac0-4bd4-b8b0-701615ac97eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:38.053764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8cd5765d-6ac0-4bd4-b8b0-701615ac97eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:38.054212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8cd5765d-6ac0-4bd4-b8b0-701615ac97eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:38.054977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8cd5765d-6ac0-4bd4-b8b0-701615ac97eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:38.055401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8cd5765d-6ac0-4bd4-b8b0-701615ac97eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:38.182135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd5c2e40-7146-46b1-88ba-692e0ffcf0c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:38.182760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd5c2e40-7146-46b1-88ba-692e0ffcf0c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:38.192813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd5c2e40-7146-46b1-88ba-692e0ffcf0c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:38.193298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd5c2e40-7146-46b1-88ba-692e0ffcf0c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:38.194117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd5c2e40-7146-46b1-88ba-692e0ffcf0c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:38.194542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd5c2e40-7146-46b1-88ba-692e0ffcf0c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:38.229455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8cd5765d-6ac0-4bd4-b8b0-701615ac97eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:38.237883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8cd5765d-6ac0-4bd4-b8b0-701615ac97eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.196290 Apr 11 19:51:38.238497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 291/583] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:38.336589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd5c2e40-7146-46b1-88ba-692e0ffcf0c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:38.344353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd5c2e40-7146-46b1-88ba-692e0ffcf0c7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.166157 Apr 11 19:51:38.344948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 293/584] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:38 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:38.746872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc798eb6-2ca6-4c31-a9a3-4cac1f2bc974 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:38.747458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc798eb6-2ca6-4c31-a9a3-4cac1f2bc974 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:38.754691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc798eb6-2ca6-4c31-a9a3-4cac1f2bc974 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:38.755146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc798eb6-2ca6-4c31-a9a3-4cac1f2bc974 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:38.755911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc798eb6-2ca6-4c31-a9a3-4cac1f2bc974 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:38.756340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc798eb6-2ca6-4c31-a9a3-4cac1f2bc974 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:38.895755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc798eb6-2ca6-4c31-a9a3-4cac1f2bc974 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:38.903800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc798eb6-2ca6-4c31-a9a3-4cac1f2bc974 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.160854 Apr 11 19:51:38.904381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 292/585] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:38 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:39.006787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:39.007337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:39.014182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:39.014626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:39.015398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:39.016006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:39.157915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:39.166808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:39.168260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:39.169464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8dd17893-94e8-4395-be8e-9efec837a09e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.166853 Apr 11 19:51:39.170198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 294/586] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:39.256118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbd84b43-b130-470d-a14e-731a95e44ac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:39.256725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbd84b43-b130-470d-a14e-731a95e44ac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:39.263546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbd84b43-b130-470d-a14e-731a95e44ac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:39.263899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbd84b43-b130-470d-a14e-731a95e44ac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:39.264669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbd84b43-b130-470d-a14e-731a95e44ac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:39.265298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbd84b43-b130-470d-a14e-731a95e44ac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:39.361862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ebd632c-ff6f-4f92-b9f9-e7edf648e99d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:39.362465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ebd632c-ff6f-4f92-b9f9-e7edf648e99d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:39.368738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ebd632c-ff6f-4f92-b9f9-e7edf648e99d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:39.369214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ebd632c-ff6f-4f92-b9f9-e7edf648e99d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:39.369979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ebd632c-ff6f-4f92-b9f9-e7edf648e99d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:39.370436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ebd632c-ff6f-4f92-b9f9-e7edf648e99d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:39.424037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbd84b43-b130-470d-a14e-731a95e44ac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:39.435136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbd84b43-b130-470d-a14e-731a95e44ac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.182748 Apr 11 19:51:39.436301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 293/587] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:39.511337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ebd632c-ff6f-4f92-b9f9-e7edf648e99d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:39.519494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ebd632c-ff6f-4f92-b9f9-e7edf648e99d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.161410 Apr 11 19:51:39.519993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 295/588] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:39 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:39.921429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3c4cc255-f48c-4ef2-bcd4-499bdeb42942 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:39.922018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3c4cc255-f48c-4ef2-bcd4-499bdeb42942 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:39.928859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c4cc255-f48c-4ef2-bcd4-499bdeb42942 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:39.929344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c4cc255-f48c-4ef2-bcd4-499bdeb42942 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:39.930111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c4cc255-f48c-4ef2-bcd4-499bdeb42942 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:39.930544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c4cc255-f48c-4ef2-bcd4-499bdeb42942 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:40.074068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3c4cc255-f48c-4ef2-bcd4-499bdeb42942 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:40.081835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3c4cc255-f48c-4ef2-bcd4-499bdeb42942 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.164485 Apr 11 19:51:40.082587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 294/589] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:39 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:40.188206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:40.188972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:40.195780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:40.196226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:40.197027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:40.197458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:40.340166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:40.350344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:40.351913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:40.353155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-912bd8a7-0d3c-4159-a4d4-b02adbbd2809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.169199 Apr 11 19:51:40.353688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 296/590] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:40.453051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7543490a-a390-4ab0-a443-281ecde5d0ef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:40.453678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7543490a-a390-4ab0-a443-281ecde5d0ef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:40.460234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7543490a-a390-4ab0-a443-281ecde5d0ef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:40.460678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7543490a-a390-4ab0-a443-281ecde5d0ef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:40.461474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7543490a-a390-4ab0-a443-281ecde5d0ef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:40.461900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7543490a-a390-4ab0-a443-281ecde5d0ef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:40.536473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74d0b4b8-17d5-4a59-89d6-6908d3e22c26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:40.537245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74d0b4b8-17d5-4a59-89d6-6908d3e22c26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:40.544060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74d0b4b8-17d5-4a59-89d6-6908d3e22c26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:40.544588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74d0b4b8-17d5-4a59-89d6-6908d3e22c26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:40.545543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74d0b4b8-17d5-4a59-89d6-6908d3e22c26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:40.546035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74d0b4b8-17d5-4a59-89d6-6908d3e22c26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:40.644058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7543490a-a390-4ab0-a443-281ecde5d0ef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:40.652740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7543490a-a390-4ab0-a443-281ecde5d0ef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.203547 Apr 11 19:51:40.653368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 295/591] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:40.701792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74d0b4b8-17d5-4a59-89d6-6908d3e22c26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:40.709989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74d0b4b8-17d5-4a59-89d6-6908d3e22c26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.177467 Apr 11 19:51:40.710584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 297/592] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:40 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:41.099454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48ccb164-02d2-42b0-881d-2ecdf2053709 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:41.100029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-48ccb164-02d2-42b0-881d-2ecdf2053709 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:41.106724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48ccb164-02d2-42b0-881d-2ecdf2053709 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:41.107158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48ccb164-02d2-42b0-881d-2ecdf2053709 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:41.108151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48ccb164-02d2-42b0-881d-2ecdf2053709 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:41.108852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48ccb164-02d2-42b0-881d-2ecdf2053709 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:41.256895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-48ccb164-02d2-42b0-881d-2ecdf2053709 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:41.266112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-48ccb164-02d2-42b0-881d-2ecdf2053709 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.170525 Apr 11 19:51:41.266696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 296/593] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:41 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:41.376043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:41.376612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:41.385956 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:41.386410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:41.387191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:41.387624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:41.525257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:41.535429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:41.536968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:41.538180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-746113e6-cfd4-47c9-ba52-ce0a199075cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.169123 Apr 11 19:51:41.538754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 298/594] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:41.671100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-72704ac3-abda-4f21-9ae9-42a451477e32 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:41.671616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-72704ac3-abda-4f21-9ae9-42a451477e32 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:41.678029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72704ac3-abda-4f21-9ae9-42a451477e32 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:41.678477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72704ac3-abda-4f21-9ae9-42a451477e32 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:41.679244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72704ac3-abda-4f21-9ae9-42a451477e32 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:41.679668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72704ac3-abda-4f21-9ae9-42a451477e32 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:41.727782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-58158cf6-602f-41d1-a062-d52146bec09c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:41.728500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-58158cf6-602f-41d1-a062-d52146bec09c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:41.735366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58158cf6-602f-41d1-a062-d52146bec09c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:41.735925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58158cf6-602f-41d1-a062-d52146bec09c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:41.736701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58158cf6-602f-41d1-a062-d52146bec09c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:41.737175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58158cf6-602f-41d1-a062-d52146bec09c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:41.882320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-72704ac3-abda-4f21-9ae9-42a451477e32 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:41.891301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-72704ac3-abda-4f21-9ae9-42a451477e32 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.224201 Apr 11 19:51:41.891902 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 297/595] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:41.913009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-58158cf6-602f-41d1-a062-d52146bec09c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:41.919290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-58158cf6-602f-41d1-a062-d52146bec09c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.195443 Apr 11 19:51:41.919870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 299/596] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:41 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:42.283399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd43c6fd-cd4c-4749-b17a-c47c24af121b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:42.284009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd43c6fd-cd4c-4749-b17a-c47c24af121b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:42.290618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd43c6fd-cd4c-4749-b17a-c47c24af121b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:42.291089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd43c6fd-cd4c-4749-b17a-c47c24af121b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:42.291846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd43c6fd-cd4c-4749-b17a-c47c24af121b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:42.292278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd43c6fd-cd4c-4749-b17a-c47c24af121b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:42.428018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bd43c6fd-cd4c-4749-b17a-c47c24af121b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:42.435985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd43c6fd-cd4c-4749-b17a-c47c24af121b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.156917 Apr 11 19:51:42.436563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 298/597] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:42 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:42.530739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-63544ff7-9165-4b92-ae90-97639ba957a5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99780c85-49d4-42ee-812a-b72e0bb5db97"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:51:42.531854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-63544ff7-9165-4b92-ae90-97639ba957a5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:42.539069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63544ff7-9165-4b92-ae90-97639ba957a5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:42.539441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63544ff7-9165-4b92-ae90-97639ba957a5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:42.540221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63544ff7-9165-4b92-ae90-97639ba957a5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:42.540650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63544ff7-9165-4b92-ae90-97639ba957a5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:42.555679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:42.556310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:42.562456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:42.562907 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:42.563671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:42.564097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:42.708664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:42.721804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:42.724040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:42.725820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ffdcede7-4466-4be3-8b75-ddd001ee8095 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.173793 Apr 11 19:51:42.726575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 299/598] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:42.910007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6f83bd24-2ed8-4b36-a7df-492bec93b5a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:42.910517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6f83bd24-2ed8-4b36-a7df-492bec93b5a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:42.917251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f83bd24-2ed8-4b36-a7df-492bec93b5a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:42.917693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f83bd24-2ed8-4b36-a7df-492bec93b5a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:42.918456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f83bd24-2ed8-4b36-a7df-492bec93b5a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:42.918879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f83bd24-2ed8-4b36-a7df-492bec93b5a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:43.069211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6f83bd24-2ed8-4b36-a7df-492bec93b5a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:43.078032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6f83bd24-2ed8-4b36-a7df-492bec93b5a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.172109 Apr 11 19:51:43.078616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 300/599] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:43.083138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d580ce8-2698-47c3-b1a3-2d740019400d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:43.083745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d580ce8-2698-47c3-b1a3-2d740019400d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:43.089979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d580ce8-2698-47c3-b1a3-2d740019400d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:43.090391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d580ce8-2698-47c3-b1a3-2d740019400d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:43.091163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d580ce8-2698-47c3-b1a3-2d740019400d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:43.091586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d580ce8-2698-47c3-b1a3-2d740019400d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:43.230303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d580ce8-2698-47c3-b1a3-2d740019400d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:43.238366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d580ce8-2698-47c3-b1a3-2d740019400d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.158743 Apr 11 19:51:43.238951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 301/600] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:43 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:43.454956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-29cbb124-7a1e-4651-9d4f-904e59e70b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:43.455925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-29cbb124-7a1e-4651-9d4f-904e59e70b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:43.461888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29cbb124-7a1e-4651-9d4f-904e59e70b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:43.462335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29cbb124-7a1e-4651-9d4f-904e59e70b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:43.463134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29cbb124-7a1e-4651-9d4f-904e59e70b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:43.463561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29cbb124-7a1e-4651-9d4f-904e59e70b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:43.603670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-29cbb124-7a1e-4651-9d4f-904e59e70b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:43.611740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-29cbb124-7a1e-4651-9d4f-904e59e70b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.161515 Apr 11 19:51:43.612327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 302/601] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:43 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:43.752011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:43.752011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:43.758709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:43.759158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:43.759929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:43.760335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:43.914683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:43.923859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:43.925388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:43.926560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-439ccff4-2a24-46ea-9d4c-9ec2bc72787d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.181664 Apr 11 19:51:43.927119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 303/602] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:44.096177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-40e96228-9803-4c00-90c5-991756cf5e6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:44.096679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-40e96228-9803-4c00-90c5-991756cf5e6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:44.103381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40e96228-9803-4c00-90c5-991756cf5e6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:44.103822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40e96228-9803-4c00-90c5-991756cf5e6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:44.104578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40e96228-9803-4c00-90c5-991756cf5e6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:44.105030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40e96228-9803-4c00-90c5-991756cf5e6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:44.257640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-40e96228-9803-4c00-90c5-991756cf5e6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:44.266049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-40e96228-9803-4c00-90c5-991756cf5e6f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.173918 Apr 11 19:51:44.266631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 304/603] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:44.271140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-879c7d51-d8d8-4e15-b4cf-eb4209943faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:44.271737 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-879c7d51-d8d8-4e15-b4cf-eb4209943faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:44.277926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-879c7d51-d8d8-4e15-b4cf-eb4209943faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:44.278373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-879c7d51-d8d8-4e15-b4cf-eb4209943faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:44.279177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-879c7d51-d8d8-4e15-b4cf-eb4209943faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:44.279603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-879c7d51-d8d8-4e15-b4cf-eb4209943faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:44.419316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-879c7d51-d8d8-4e15-b4cf-eb4209943faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:44.427114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-879c7d51-d8d8-4e15-b4cf-eb4209943faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.159456 Apr 11 19:51:44.427675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 305/604] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:44 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:44.629427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b54f278f-88dc-401b-965e-f286443c0401 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:44.630098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b54f278f-88dc-401b-965e-f286443c0401 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:44.636930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b54f278f-88dc-401b-965e-f286443c0401 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:44.637431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b54f278f-88dc-401b-965e-f286443c0401 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:44.638202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b54f278f-88dc-401b-965e-f286443c0401 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:44.638630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b54f278f-88dc-401b-965e-f286443c0401 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:44.786347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b54f278f-88dc-401b-965e-f286443c0401 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:44.794484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b54f278f-88dc-401b-965e-f286443c0401 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.169505 Apr 11 19:51:44.795063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 306/605] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:44 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:44.945799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:44.946441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:44.952611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:44.953176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:44.953954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:44.954412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:45.100423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:45.109385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:45.110853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:45.112038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83a2f3ba-2f35-4090-9718-981a07145690 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.170240 Apr 11 19:51:45.112592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 307/606] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:51:45.284806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-980b052f-e72e-4820-84f0-45a01c148cc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:45.285365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-980b052f-e72e-4820-84f0-45a01c148cc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:45.291877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-980b052f-e72e-4820-84f0-45a01c148cc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:45.292316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-980b052f-e72e-4820-84f0-45a01c148cc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:45.293147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-980b052f-e72e-4820-84f0-45a01c148cc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:45.293610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-980b052f-e72e-4820-84f0-45a01c148cc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:45.448879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-980b052f-e72e-4820-84f0-45a01c148cc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:45.459992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-980b052f-e72e-4820-84f0-45a01c148cc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.177262 Apr 11 19:51:45.459992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 308/607] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:45.462781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25f8f412-c73e-4789-add4-20c302593de1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:45.463386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25f8f412-c73e-4789-add4-20c302593de1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:45.469628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25f8f412-c73e-4789-add4-20c302593de1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:45.470073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25f8f412-c73e-4789-add4-20c302593de1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:45.470837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25f8f412-c73e-4789-add4-20c302593de1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:45.471264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25f8f412-c73e-4789-add4-20c302593de1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:45.602577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25f8f412-c73e-4789-add4-20c302593de1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:45.610973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25f8f412-c73e-4789-add4-20c302593de1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.151712 Apr 11 19:51:45.611568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 309/608] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:45 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:45.814270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56c01fe1-aeb5-4029-a770-f1a38a46e531 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:45.814964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56c01fe1-aeb5-4029-a770-f1a38a46e531 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:45.822461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c01fe1-aeb5-4029-a770-f1a38a46e531 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:45.822909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c01fe1-aeb5-4029-a770-f1a38a46e531 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:45.824013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c01fe1-aeb5-4029-a770-f1a38a46e531 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:45.824674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c01fe1-aeb5-4029-a770-f1a38a46e531 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:45.964239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56c01fe1-aeb5-4029-a770-f1a38a46e531 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:45.972321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56c01fe1-aeb5-4029-a770-f1a38a46e531 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.163479 Apr 11 19:51:45.972897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 310/609] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:45 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:46.132604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:46.133151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:46.140378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:46.141164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:46.142423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:46.143132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:46.285104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:46.293680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:46.295185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:46.296332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5009be6-e619-4f4f-bed9-3da65b9c4abc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.168615 Apr 11 19:51:46.297133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 311/610] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:46.475533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a79e9eb0-014b-4ac5-89b8-74ad4fbcf3d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:46.476171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a79e9eb0-014b-4ac5-89b8-74ad4fbcf3d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:46.482496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a79e9eb0-014b-4ac5-89b8-74ad4fbcf3d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:46.482947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a79e9eb0-014b-4ac5-89b8-74ad4fbcf3d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:46.483719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a79e9eb0-014b-4ac5-89b8-74ad4fbcf3d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:46.484259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a79e9eb0-014b-4ac5-89b8-74ad4fbcf3d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:46.628809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a79e9eb0-014b-4ac5-89b8-74ad4fbcf3d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:46.637049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a79e9eb0-014b-4ac5-89b8-74ad4fbcf3d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.165426 Apr 11 19:51:46.641626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 312/611] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:46.646342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6f8257f-3772-4af0-9c9a-3ca8616174c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:46.646876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6f8257f-3772-4af0-9c9a-3ca8616174c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:46.653501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6f8257f-3772-4af0-9c9a-3ca8616174c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:46.653951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6f8257f-3772-4af0-9c9a-3ca8616174c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:46.654721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6f8257f-3772-4af0-9c9a-3ca8616174c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:46.655123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6f8257f-3772-4af0-9c9a-3ca8616174c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:46.790779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6f8257f-3772-4af0-9c9a-3ca8616174c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:46.799889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6f8257f-3772-4af0-9c9a-3ca8616174c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.160772 Apr 11 19:51:46.800526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 313/612] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:46 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:46.991094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92415af2-d5ac-4774-ba38-677b8c5c250c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:46.991796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92415af2-d5ac-4774-ba38-677b8c5c250c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:46.998381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92415af2-d5ac-4774-ba38-677b8c5c250c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:46.998824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92415af2-d5ac-4774-ba38-677b8c5c250c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:46.999587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92415af2-d5ac-4774-ba38-677b8c5c250c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:47.000404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92415af2-d5ac-4774-ba38-677b8c5c250c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:47.135657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-92415af2-d5ac-4774-ba38-677b8c5c250c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:47.143912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92415af2-d5ac-4774-ba38-677b8c5c250c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.156642 Apr 11 19:51:47.144532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 314/613] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:46 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:47.317232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:47.317733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:47.325391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:47.326024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:47.327218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:47.328006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:47.467003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:47.476668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:47.478535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:47.479703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-71ab0740-3899-4884-a9db-3d8f2d17c22b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.167434 Apr 11 19:51:47.480258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 315/614] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:47.656109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3ad43d86-4a14-45a4-b59d-1686ab70cd75 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:47.656723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3ad43d86-4a14-45a4-b59d-1686ab70cd75 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:47.663196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ad43d86-4a14-45a4-b59d-1686ab70cd75 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:47.663659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ad43d86-4a14-45a4-b59d-1686ab70cd75 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:47.664466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ad43d86-4a14-45a4-b59d-1686ab70cd75 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:47.664918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ad43d86-4a14-45a4-b59d-1686ab70cd75 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:47.812555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3ad43d86-4a14-45a4-b59d-1686ab70cd75 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:47.821377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3ad43d86-4a14-45a4-b59d-1686ab70cd75 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.169052 Apr 11 19:51:47.821992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 316/615] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:47.826449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-96139cdf-d779-4cf3-8005-1329a4567496 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:47.827065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-96139cdf-d779-4cf3-8005-1329a4567496 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:47.833614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96139cdf-d779-4cf3-8005-1329a4567496 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:47.834064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96139cdf-d779-4cf3-8005-1329a4567496 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:47.834843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96139cdf-d779-4cf3-8005-1329a4567496 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:47.835323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96139cdf-d779-4cf3-8005-1329a4567496 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:47.968091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-96139cdf-d779-4cf3-8005-1329a4567496 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:47.976135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-96139cdf-d779-4cf3-8005-1329a4567496 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.153189 Apr 11 19:51:47.976714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 317/616] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:47 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:48.161197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aac0e695-d4dd-40a7-b3d0-a6a45b427453 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:48.161930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aac0e695-d4dd-40a7-b3d0-a6a45b427453 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:48.168761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aac0e695-d4dd-40a7-b3d0-a6a45b427453 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:48.169164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aac0e695-d4dd-40a7-b3d0-a6a45b427453 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:48.169943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aac0e695-d4dd-40a7-b3d0-a6a45b427453 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:48.170373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aac0e695-d4dd-40a7-b3d0-a6a45b427453 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:48.323146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aac0e695-d4dd-40a7-b3d0-a6a45b427453 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:48.333285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aac0e695-d4dd-40a7-b3d0-a6a45b427453 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.175678 Apr 11 19:51:48.334211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 318/617] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:48 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:48.500257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:48.500862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:48.507428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:48.507875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:48.508675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:48.509149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:48.643125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:48.655351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:48.656835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:48.658022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5e3ba714-0a4f-41c1-8df1-355c040f586e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.162142 Apr 11 19:51:48.658581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 319/618] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:48.839465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-94e04b64-7a42-4959-91ca-053b96fc895c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:48.840021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-94e04b64-7a42-4959-91ca-053b96fc895c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:48.846816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94e04b64-7a42-4959-91ca-053b96fc895c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:48.847251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94e04b64-7a42-4959-91ca-053b96fc895c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:48.848020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94e04b64-7a42-4959-91ca-053b96fc895c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:48.848447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94e04b64-7a42-4959-91ca-053b96fc895c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:49.007697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-94e04b64-7a42-4959-91ca-053b96fc895c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:49.016261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-94e04b64-7a42-4959-91ca-053b96fc895c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.180568 Apr 11 19:51:49.016837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 320/619] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:49.021362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1464ebdb-da76-4861-9d32-6c3496d5069d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:49.021955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1464ebdb-da76-4861-9d32-6c3496d5069d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:49.030895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1464ebdb-da76-4861-9d32-6c3496d5069d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:49.031350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1464ebdb-da76-4861-9d32-6c3496d5069d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:49.032126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1464ebdb-da76-4861-9d32-6c3496d5069d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:49.032558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1464ebdb-da76-4861-9d32-6c3496d5069d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:49.164940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1464ebdb-da76-4861-9d32-6c3496d5069d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:49.173200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1464ebdb-da76-4861-9d32-6c3496d5069d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.155290 Apr 11 19:51:49.173905 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 321/620] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:49 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:49.353060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b5e7be66-96c9-4bb8-bc9c-ee264f4474a0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:49.353674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b5e7be66-96c9-4bb8-bc9c-ee264f4474a0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:49.361093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5e7be66-96c9-4bb8-bc9c-ee264f4474a0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:49.361544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5e7be66-96c9-4bb8-bc9c-ee264f4474a0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:49.362395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5e7be66-96c9-4bb8-bc9c-ee264f4474a0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:49.362761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5e7be66-96c9-4bb8-bc9c-ee264f4474a0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:49.499483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b5e7be66-96c9-4bb8-bc9c-ee264f4474a0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:49.509611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b5e7be66-96c9-4bb8-bc9c-ee264f4474a0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.160499 Apr 11 19:51:49.510233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 322/621] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:49 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:49.678724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:49.679334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:49.685610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:49.686055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:49.686811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:49.687237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:49.826620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:49.837788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:49.839270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:49.840439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ed115c68-7228-4a1d-954a-39c4bec9f3ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.166046 Apr 11 19:51:49.841016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 323/622] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:51:50.037290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9fce70a-bb7e-4484-a3e8-c83f09da5e8a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:50.037938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9fce70a-bb7e-4484-a3e8-c83f09da5e8a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:50.047585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9fce70a-bb7e-4484-a3e8-c83f09da5e8a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:50.048238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9fce70a-bb7e-4484-a3e8-c83f09da5e8a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:50.049158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9fce70a-bb7e-4484-a3e8-c83f09da5e8a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:50.049601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9fce70a-bb7e-4484-a3e8-c83f09da5e8a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:50.212393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9fce70a-bb7e-4484-a3e8-c83f09da5e8a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:50.220676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9fce70a-bb7e-4484-a3e8-c83f09da5e8a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.189819 Apr 11 19:51:50.221289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 324/623] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:50.225843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8aff0fbd-5bd1-4051-a3c7-cc7b4f570ffd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:50.226475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8aff0fbd-5bd1-4051-a3c7-cc7b4f570ffd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:50.235224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8aff0fbd-5bd1-4051-a3c7-cc7b4f570ffd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:50.235755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8aff0fbd-5bd1-4051-a3c7-cc7b4f570ffd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:50.236598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8aff0fbd-5bd1-4051-a3c7-cc7b4f570ffd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:50.237081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8aff0fbd-5bd1-4051-a3c7-cc7b4f570ffd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:50.395269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8aff0fbd-5bd1-4051-a3c7-cc7b4f570ffd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:50.402903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8aff0fbd-5bd1-4051-a3c7-cc7b4f570ffd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.180643 Apr 11 19:51:50.403521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 325/624] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:50 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:50.531021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-487c1ee5-0395-47b0-bc79-38c0dd82e119 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:50.531814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-487c1ee5-0395-47b0-bc79-38c0dd82e119 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:50.539087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-487c1ee5-0395-47b0-bc79-38c0dd82e119 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:50.539539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-487c1ee5-0395-47b0-bc79-38c0dd82e119 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:50.540316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-487c1ee5-0395-47b0-bc79-38c0dd82e119 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:50.540749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-487c1ee5-0395-47b0-bc79-38c0dd82e119 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:50.675346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-487c1ee5-0395-47b0-bc79-38c0dd82e119 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:50.683419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-487c1ee5-0395-47b0-bc79-38c0dd82e119 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.158874 Apr 11 19:51:50.684003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 326/625] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:50 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:50.861792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:50.862392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:50.869072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:50.869559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:50.870260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:50.870683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:51.005159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:51.017813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:51.019289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:51.020447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-324fd740-ee44-4105-983e-ebed072fdfa4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.163294 Apr 11 19:51:51.021050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 327/626] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:51.239851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c191e597-92de-4769-9794-cfcb61e7fa47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:51.240528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c191e597-92de-4769-9794-cfcb61e7fa47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:51.247384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c191e597-92de-4769-9794-cfcb61e7fa47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:51.247833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c191e597-92de-4769-9794-cfcb61e7fa47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:51.248617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c191e597-92de-4769-9794-cfcb61e7fa47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:51.249095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c191e597-92de-4769-9794-cfcb61e7fa47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:51.402269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c191e597-92de-4769-9794-cfcb61e7fa47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:51.411432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c191e597-92de-4769-9794-cfcb61e7fa47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.175624 Apr 11 19:51:51.412012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 328/627] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:51.419374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-061481a1-74ca-46b2-8f48-281ea957168c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:51.420007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-061481a1-74ca-46b2-8f48-281ea957168c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:51.426441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-061481a1-74ca-46b2-8f48-281ea957168c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:51.426887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-061481a1-74ca-46b2-8f48-281ea957168c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:51.427656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-061481a1-74ca-46b2-8f48-281ea957168c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:51.428088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-061481a1-74ca-46b2-8f48-281ea957168c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:51.566718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-061481a1-74ca-46b2-8f48-281ea957168c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:51.575136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-061481a1-74ca-46b2-8f48-281ea957168c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.159411 Apr 11 19:51:51.575711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 329/628] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:51 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:51.700103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bf68be22-f187-4b9e-ab32-5dbd0ddd9f1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:51.700701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bf68be22-f187-4b9e-ab32-5dbd0ddd9f1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:51.707056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf68be22-f187-4b9e-ab32-5dbd0ddd9f1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:51.707552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf68be22-f187-4b9e-ab32-5dbd0ddd9f1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:51.708269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf68be22-f187-4b9e-ab32-5dbd0ddd9f1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:51.708692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf68be22-f187-4b9e-ab32-5dbd0ddd9f1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:51.851865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bf68be22-f187-4b9e-ab32-5dbd0ddd9f1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:51.860097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bf68be22-f187-4b9e-ab32-5dbd0ddd9f1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.163662 Apr 11 19:51:51.860663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 330/629] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:51 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:52.042905 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:52.043793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:52.054089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:52.054688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:52.055860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:52.056467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:52.197252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:52.206290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:52.207760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:52.208953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84cb8cb7-8684-47a3-a424-8ca8dbca8490 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.172850 Apr 11 19:51:52.209524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 331/630] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:52.428965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f918ed1-84e5-4cf6-ac02-607dd2256bc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:52.429737 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f918ed1-84e5-4cf6-ac02-607dd2256bc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:52.436683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f918ed1-84e5-4cf6-ac02-607dd2256bc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:52.437145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f918ed1-84e5-4cf6-ac02-607dd2256bc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:52.437913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f918ed1-84e5-4cf6-ac02-607dd2256bc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:52.438339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f918ed1-84e5-4cf6-ac02-607dd2256bc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:52.601969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0f918ed1-84e5-4cf6-ac02-607dd2256bc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:52.612858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f918ed1-84e5-4cf6-ac02-607dd2256bc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.187579 Apr 11 19:51:52.613526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 332/631] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:52.617845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d8fe76b6-6e11-4b32-8167-2c826dedf14b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:52.618440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d8fe76b6-6e11-4b32-8167-2c826dedf14b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:52.624463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d8fe76b6-6e11-4b32-8167-2c826dedf14b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:52.625469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d8fe76b6-6e11-4b32-8167-2c826dedf14b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:52.626576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d8fe76b6-6e11-4b32-8167-2c826dedf14b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:52.627017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d8fe76b6-6e11-4b32-8167-2c826dedf14b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:52.764423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d8fe76b6-6e11-4b32-8167-2c826dedf14b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:52.772632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d8fe76b6-6e11-4b32-8167-2c826dedf14b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.158097 Apr 11 19:51:52.773247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 333/632] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:52 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:52.878306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-357d965e-4624-4167-a22a-eaed5dafcdc7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:52.879046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-357d965e-4624-4167-a22a-eaed5dafcdc7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:52.887703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-357d965e-4624-4167-a22a-eaed5dafcdc7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:52.888165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-357d965e-4624-4167-a22a-eaed5dafcdc7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:52.888950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-357d965e-4624-4167-a22a-eaed5dafcdc7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:52.889572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-357d965e-4624-4167-a22a-eaed5dafcdc7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:53.026546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-357d965e-4624-4167-a22a-eaed5dafcdc7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:53.035615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-357d965e-4624-4167-a22a-eaed5dafcdc7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.161978 Apr 11 19:51:53.036186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 334/633] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:52 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:53.232855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:53.233463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:53.239837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:53.240286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:53.241088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:53.241522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:53.388166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:53.398773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:53.400234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:53.401441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6817d1a3-72a8-4a8f-ac43-91d26cd890ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.172731 Apr 11 19:51:53.402012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 335/634] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:53.631628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d4143b2c-12ae-4d6b-a87f-054a4b0e583d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:53.632325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d4143b2c-12ae-4d6b-a87f-054a4b0e583d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:53.638827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4143b2c-12ae-4d6b-a87f-054a4b0e583d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:53.639270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4143b2c-12ae-4d6b-a87f-054a4b0e583d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:53.640039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4143b2c-12ae-4d6b-a87f-054a4b0e583d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:53.640467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4143b2c-12ae-4d6b-a87f-054a4b0e583d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:53.789950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d4143b2c-12ae-4d6b-a87f-054a4b0e583d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:53.802357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d4143b2c-12ae-4d6b-a87f-054a4b0e583d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.174912 Apr 11 19:51:53.803068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 336/635] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:53.807639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb01db32-1a77-4c83-8ca9-e12aed7853cd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:53.808245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb01db32-1a77-4c83-8ca9-e12aed7853cd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:53.815200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb01db32-1a77-4c83-8ca9-e12aed7853cd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:53.815646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb01db32-1a77-4c83-8ca9-e12aed7853cd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:53.816432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb01db32-1a77-4c83-8ca9-e12aed7853cd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:53.816862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb01db32-1a77-4c83-8ca9-e12aed7853cd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:53.955987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eb01db32-1a77-4c83-8ca9-e12aed7853cd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:53.967946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb01db32-1a77-4c83-8ca9-e12aed7853cd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.163646 Apr 11 19:51:53.968936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 337/636] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:53 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:54.052046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25870125-0768-4bf2-a63e-a673200a043e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:54.052803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25870125-0768-4bf2-a63e-a673200a043e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:54.059676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25870125-0768-4bf2-a63e-a673200a043e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:54.060126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25870125-0768-4bf2-a63e-a673200a043e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:54.060889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25870125-0768-4bf2-a63e-a673200a043e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:54.061383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25870125-0768-4bf2-a63e-a673200a043e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:54.212196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25870125-0768-4bf2-a63e-a673200a043e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:54.220174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25870125-0768-4bf2-a63e-a673200a043e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.172233 Apr 11 19:51:54.220794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 338/637] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:54 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:54.420730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:54.421321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:54.430673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:54.432309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:54.433361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:54.433809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:54.575724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:54.585030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:54.586513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:54.587691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e02de33-abf2-48c7-93aa-4cca37b700bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.170954 Apr 11 19:51:54.588249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 339/638] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:54.820136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-138b68b4-98a8-47d0-9287-1693cee06f89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:54.820849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-138b68b4-98a8-47d0-9287-1693cee06f89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:54.827596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-138b68b4-98a8-47d0-9287-1693cee06f89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:54.828041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-138b68b4-98a8-47d0-9287-1693cee06f89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:54.828816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-138b68b4-98a8-47d0-9287-1693cee06f89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:54.829254 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-138b68b4-98a8-47d0-9287-1693cee06f89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:54.999736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-138b68b4-98a8-47d0-9287-1693cee06f89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:55.008957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-138b68b4-98a8-47d0-9287-1693cee06f89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.192750 Apr 11 19:51:55.009571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 340/639] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:55.016261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-434e5ac2-07b0-401c-9a90-b09bcf84735f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:55.017192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-434e5ac2-07b0-401c-9a90-b09bcf84735f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:55.024712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-434e5ac2-07b0-401c-9a90-b09bcf84735f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:55.025214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-434e5ac2-07b0-401c-9a90-b09bcf84735f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:55.026333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-434e5ac2-07b0-401c-9a90-b09bcf84735f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:55.026765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-434e5ac2-07b0-401c-9a90-b09bcf84735f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:55.163648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-434e5ac2-07b0-401c-9a90-b09bcf84735f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:55.170421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-434e5ac2-07b0-401c-9a90-b09bcf84735f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.159577 Apr 11 19:51:55.171008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 341/640] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:55 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:55.237938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6daeb3be-58f3-46a8-854f-e1d8a6183076 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:55.238605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6daeb3be-58f3-46a8-854f-e1d8a6183076 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:55.245667 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6daeb3be-58f3-46a8-854f-e1d8a6183076 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:55.246109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6daeb3be-58f3-46a8-854f-e1d8a6183076 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:55.246874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6daeb3be-58f3-46a8-854f-e1d8a6183076 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:55.247302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6daeb3be-58f3-46a8-854f-e1d8a6183076 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:55.637358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6daeb3be-58f3-46a8-854f-e1d8a6183076 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:55.645645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6daeb3be-58f3-46a8-854f-e1d8a6183076 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.411808 Apr 11 19:51:55.646209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 342/641] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:55 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:55.650779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:55.651521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:55.658797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:55.659281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:55.660113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:55.660537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:55.798189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:55.807463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:55.808948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:55.810143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3a42f698-a3b0-4661-a867-c772883ccfce tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.163003 Apr 11 19:51:55.810770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 343/642] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:56.030666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9e2ab66-65db-42fd-a6d1-4a1bec99aafc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:56.031379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9e2ab66-65db-42fd-a6d1-4a1bec99aafc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:56.038169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e2ab66-65db-42fd-a6d1-4a1bec99aafc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:56.038614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e2ab66-65db-42fd-a6d1-4a1bec99aafc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:56.039387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e2ab66-65db-42fd-a6d1-4a1bec99aafc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:56.039844 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e2ab66-65db-42fd-a6d1-4a1bec99aafc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:56.201063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9e2ab66-65db-42fd-a6d1-4a1bec99aafc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:56.209464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9e2ab66-65db-42fd-a6d1-4a1bec99aafc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.182679 Apr 11 19:51:56.210044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 344/643] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:56.214518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0735f93c-ce8a-4879-b630-49b6e3083673 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:56.215150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0735f93c-ce8a-4879-b630-49b6e3083673 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:56.221036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0735f93c-ce8a-4879-b630-49b6e3083673 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:56.221500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0735f93c-ce8a-4879-b630-49b6e3083673 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:56.222267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0735f93c-ce8a-4879-b630-49b6e3083673 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:56.222668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0735f93c-ce8a-4879-b630-49b6e3083673 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:56.360195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0735f93c-ce8a-4879-b630-49b6e3083673 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:56.367767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0735f93c-ce8a-4879-b630-49b6e3083673 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.156767 Apr 11 19:51:56.368338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 345/644] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:56 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:56.663096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a29d710a-a8f6-4111-99fd-cfb527717c28 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:56.663716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a29d710a-a8f6-4111-99fd-cfb527717c28 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:56.671228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a29d710a-a8f6-4111-99fd-cfb527717c28 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:56.671892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a29d710a-a8f6-4111-99fd-cfb527717c28 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:56.672803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a29d710a-a8f6-4111-99fd-cfb527717c28 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:56.673263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a29d710a-a8f6-4111-99fd-cfb527717c28 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:56.814015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a29d710a-a8f6-4111-99fd-cfb527717c28 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:56.822154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a29d710a-a8f6-4111-99fd-cfb527717c28 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.163160 Apr 11 19:51:56.822771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 346/645] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:56 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:56.827584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:56.828223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:56.835178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:56.835622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:56.836388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:56.836787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:56.975701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:56.984850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:56.986609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:56.987795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-af0513a9-048c-43b0-ab5e-22bca28cc1e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.164103 Apr 11 19:51:56.988365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 347/646] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:57.227636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b880762c-3772-41c9-9135-69e751c2a8b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:57.228321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b880762c-3772-41c9-9135-69e751c2a8b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:57.234920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b880762c-3772-41c9-9135-69e751c2a8b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:57.235367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b880762c-3772-41c9-9135-69e751c2a8b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:57.236166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b880762c-3772-41c9-9135-69e751c2a8b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:57.236647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b880762c-3772-41c9-9135-69e751c2a8b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:57.383988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b880762c-3772-41c9-9135-69e751c2a8b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:57.392217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b880762c-3772-41c9-9135-69e751c2a8b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.168461 Apr 11 19:51:57.392885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 348/647] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:57.397578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3954f592-0301-4ba0-a4bc-db1e0e0d2ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:57.398185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3954f592-0301-4ba0-a4bc-db1e0e0d2ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:57.404527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3954f592-0301-4ba0-a4bc-db1e0e0d2ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:57.405001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3954f592-0301-4ba0-a4bc-db1e0e0d2ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:57.405765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3954f592-0301-4ba0-a4bc-db1e0e0d2ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:57.406226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3954f592-0301-4ba0-a4bc-db1e0e0d2ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:57.549591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3954f592-0301-4ba0-a4bc-db1e0e0d2ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:57.557672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3954f592-0301-4ba0-a4bc-db1e0e0d2ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.163736 Apr 11 19:51:57.558246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 349/648] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:57 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:57.839988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d965ade-01ef-4c25-9df7-bc2c449ac195 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:57.840499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d965ade-01ef-4c25-9df7-bc2c449ac195 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:57.847105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d965ade-01ef-4c25-9df7-bc2c449ac195 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:57.847552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d965ade-01ef-4c25-9df7-bc2c449ac195 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:57.848338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d965ade-01ef-4c25-9df7-bc2c449ac195 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:57.848777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d965ade-01ef-4c25-9df7-bc2c449ac195 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:57.989167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d965ade-01ef-4c25-9df7-bc2c449ac195 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:58.000733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d965ade-01ef-4c25-9df7-bc2c449ac195 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.164690 Apr 11 19:51:58.001369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 350/649] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:57 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:58.007268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:58.007905 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:58.014140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:58.014577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:58.015338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:58.015761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:58.150012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:58.164788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:58.167579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:58.169329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-64ed6467-04df-416d-9e35-694d587b6644 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.166244 Apr 11 19:51:58.170175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 351/650] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:51:58.410134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd481c4b-3b02-4439-92e4-996419b346e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:58.410714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd481c4b-3b02-4439-92e4-996419b346e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:58.418456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd481c4b-3b02-4439-92e4-996419b346e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:58.418941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd481c4b-3b02-4439-92e4-996419b346e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:58.419737 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd481c4b-3b02-4439-92e4-996419b346e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:58.420160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd481c4b-3b02-4439-92e4-996419b346e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:58.571758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bd481c4b-3b02-4439-92e4-996419b346e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:58.580368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd481c4b-3b02-4439-92e4-996419b346e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.174520 Apr 11 19:51:58.581015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 352/651] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:51:58.585483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73e8b447-430c-45ae-9577-f5fefd6b3bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:58.586085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73e8b447-430c-45ae-9577-f5fefd6b3bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:58.592334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73e8b447-430c-45ae-9577-f5fefd6b3bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:58.592772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73e8b447-430c-45ae-9577-f5fefd6b3bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:58.593571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73e8b447-430c-45ae-9577-f5fefd6b3bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:58.593996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73e8b447-430c-45ae-9577-f5fefd6b3bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:58.735940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73e8b447-430c-45ae-9577-f5fefd6b3bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:58.744854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73e8b447-430c-45ae-9577-f5fefd6b3bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.162767 Apr 11 19:51:58.745435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 353/652] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:58 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:59.018703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-96a72eeb-6125-43a9-9d7d-73aa9d0526fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:59.019345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-96a72eeb-6125-43a9-9d7d-73aa9d0526fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:59.025921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96a72eeb-6125-43a9-9d7d-73aa9d0526fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:59.026387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96a72eeb-6125-43a9-9d7d-73aa9d0526fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:59.027145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96a72eeb-6125-43a9-9d7d-73aa9d0526fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:59.027545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96a72eeb-6125-43a9-9d7d-73aa9d0526fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:59.174147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-96a72eeb-6125-43a9-9d7d-73aa9d0526fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:59.182222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-96a72eeb-6125-43a9-9d7d-73aa9d0526fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.167463 Apr 11 19:51:59.182895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 354/653] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:59 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:59.188317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:59.188940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:59.197772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:59.198360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:59.199525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:59.200086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:59.336112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:59.347240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:59.348738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:59.349934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b67a2e69-2364-4e00-a788-95d2a31f591e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.166089 Apr 11 19:51:59.350467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 355/654] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:51:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:51:59.599400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-846e6e13-4976-4da2-8f34-0c9258bdd48e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:59.600042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-846e6e13-4976-4da2-8f34-0c9258bdd48e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:59.606801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-846e6e13-4976-4da2-8f34-0c9258bdd48e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:59.607241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-846e6e13-4976-4da2-8f34-0c9258bdd48e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:59.608010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-846e6e13-4976-4da2-8f34-0c9258bdd48e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:59.608438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-846e6e13-4976-4da2-8f34-0c9258bdd48e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:59.764939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-846e6e13-4976-4da2-8f34-0c9258bdd48e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:59.775549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-846e6e13-4976-4da2-8f34-0c9258bdd48e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.179631 Apr 11 19:51:59.779263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 356/655] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:59 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:51:59.780707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6743becb-a122-4dcb-98bf-ec8f67fd50e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:51:59.781369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6743becb-a122-4dcb-98bf-ec8f67fd50e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:51:59.787431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6743becb-a122-4dcb-98bf-ec8f67fd50e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:59.787873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6743becb-a122-4dcb-98bf-ec8f67fd50e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:59.788726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6743becb-a122-4dcb-98bf-ec8f67fd50e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:51:59.789100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6743becb-a122-4dcb-98bf-ec8f67fd50e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:51:59.928787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6743becb-a122-4dcb-98bf-ec8f67fd50e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:51:59.936683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6743becb-a122-4dcb-98bf-ec8f67fd50e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.159495 Apr 11 19:51:59.937295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 357/656] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:51:59 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:00.202833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ca6cc20a-7edc-4d0a-bf57-33f6453a97b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:00.203442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ca6cc20a-7edc-4d0a-bf57-33f6453a97b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:00.210172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca6cc20a-7edc-4d0a-bf57-33f6453a97b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:00.210653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca6cc20a-7edc-4d0a-bf57-33f6453a97b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:00.211409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca6cc20a-7edc-4d0a-bf57-33f6453a97b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:00.211829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca6cc20a-7edc-4d0a-bf57-33f6453a97b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:00.347671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ca6cc20a-7edc-4d0a-bf57-33f6453a97b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:00.357561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ca6cc20a-7edc-4d0a-bf57-33f6453a97b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.158907 Apr 11 19:52:00.358142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 358/657] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:00 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:00.369214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:00.370056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:00.376975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:00.377461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:00.378302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:00.378734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:00.513490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:00.523295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:00.524786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:00.525994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f7920f8-9c93-4e1c-af83-d2d41cdf8a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.162314 Apr 11 19:52:00.526560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 359/658] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:00.794327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b9aa31db-48cf-45ed-b724-5f7cdbd7658e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:00.795017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b9aa31db-48cf-45ed-b724-5f7cdbd7658e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:00.801972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9aa31db-48cf-45ed-b724-5f7cdbd7658e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:00.802496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9aa31db-48cf-45ed-b724-5f7cdbd7658e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:00.803428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9aa31db-48cf-45ed-b724-5f7cdbd7658e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:00.803875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9aa31db-48cf-45ed-b724-5f7cdbd7658e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:00.978796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9aa31db-48cf-45ed-b724-5f7cdbd7658e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:00.987510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b9aa31db-48cf-45ed-b724-5f7cdbd7658e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.197798 Apr 11 19:52:00.988114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 360/659] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:00.992857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0e66b56d-cbd1-4ba9-af33-ae435f6dc53c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:00.993525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0e66b56d-cbd1-4ba9-af33-ae435f6dc53c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:01.000246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e66b56d-cbd1-4ba9-af33-ae435f6dc53c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:01.000702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e66b56d-cbd1-4ba9-af33-ae435f6dc53c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:01.001510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e66b56d-cbd1-4ba9-af33-ae435f6dc53c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:01.001946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e66b56d-cbd1-4ba9-af33-ae435f6dc53c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:01.143264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0e66b56d-cbd1-4ba9-af33-ae435f6dc53c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:01.151103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0e66b56d-cbd1-4ba9-af33-ae435f6dc53c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.161986 Apr 11 19:52:01.151682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 361/660] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:00 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:01.378573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7f525e7-d93c-4caa-af82-ea7739111845 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:01.379119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7f525e7-d93c-4caa-af82-ea7739111845 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:01.387083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7f525e7-d93c-4caa-af82-ea7739111845 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:01.387626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7f525e7-d93c-4caa-af82-ea7739111845 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:01.388836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7f525e7-d93c-4caa-af82-ea7739111845 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:01.389512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7f525e7-d93c-4caa-af82-ea7739111845 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:01.541131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7f525e7-d93c-4caa-af82-ea7739111845 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:01.549595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7f525e7-d93c-4caa-af82-ea7739111845 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.177138 Apr 11 19:52:01.550174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 362/661] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:01 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:01.554823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:01.555489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:01.562555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:01.563047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:01.563757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:01.564190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:01.711900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:01.720745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:01.722327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:01.723484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f1298fc-6992-4ae9-b395-f64457ae86f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.172418 Apr 11 19:52:01.724081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 363/662] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:02.009269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b6efb49-a053-453f-861e-ba3358ae6360 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:02.010354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b6efb49-a053-453f-861e-ba3358ae6360 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:02.018094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b6efb49-a053-453f-861e-ba3358ae6360 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:02.018626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b6efb49-a053-453f-861e-ba3358ae6360 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:02.019386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b6efb49-a053-453f-861e-ba3358ae6360 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:02.019839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b6efb49-a053-453f-861e-ba3358ae6360 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:02.181453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b6efb49-a053-453f-861e-ba3358ae6360 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:02.187617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b6efb49-a053-453f-861e-ba3358ae6360 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.185052 Apr 11 19:52:02.188213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 364/663] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:02.193219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1660f554-58d5-43ba-adfe-73d3dbb4ef86 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:02.193808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1660f554-58d5-43ba-adfe-73d3dbb4ef86 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:02.200322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1660f554-58d5-43ba-adfe-73d3dbb4ef86 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:02.200764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1660f554-58d5-43ba-adfe-73d3dbb4ef86 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:02.201563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1660f554-58d5-43ba-adfe-73d3dbb4ef86 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:02.202013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1660f554-58d5-43ba-adfe-73d3dbb4ef86 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:02.340708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1660f554-58d5-43ba-adfe-73d3dbb4ef86 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:02.351719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1660f554-58d5-43ba-adfe-73d3dbb4ef86 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.162468 Apr 11 19:52:02.352307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 365/664] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:02 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:02.567566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-660caf48-7e23-402e-9ab0-4c6496d44b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:02.568109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-660caf48-7e23-402e-9ab0-4c6496d44b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:02.574557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-660caf48-7e23-402e-9ab0-4c6496d44b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:02.575087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-660caf48-7e23-402e-9ab0-4c6496d44b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:02.575766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-660caf48-7e23-402e-9ab0-4c6496d44b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:02.576188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-660caf48-7e23-402e-9ab0-4c6496d44b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:02.726207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-660caf48-7e23-402e-9ab0-4c6496d44b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:02.734777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-660caf48-7e23-402e-9ab0-4c6496d44b5b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.171102 Apr 11 19:52:02.745016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 366/665] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:02 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:52:02.745016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:02.745016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:02.750155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:02.750595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:02.751415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:02.751836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:02.894157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:02.903031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:02.904656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:02.905856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2f47f981-7120-4fee-a2dd-b468f33facb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.168001 Apr 11 19:52:02.906427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 367/666] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:03.209195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a926abc-a416-4e34-a2c4-5857334301b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:03.210215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a926abc-a416-4e34-a2c4-5857334301b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:03.220753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a926abc-a416-4e34-a2c4-5857334301b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:03.221521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a926abc-a416-4e34-a2c4-5857334301b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:03.222335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a926abc-a416-4e34-a2c4-5857334301b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:03.222767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a926abc-a416-4e34-a2c4-5857334301b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:03.382863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a926abc-a416-4e34-a2c4-5857334301b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:03.392653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a926abc-a416-4e34-a2c4-5857334301b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.188359 Apr 11 19:52:03.393338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 368/667] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:03.398319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b86552f1-7746-4e99-8194-7ee87da61c17 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:03.398967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b86552f1-7746-4e99-8194-7ee87da61c17 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:03.406128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b86552f1-7746-4e99-8194-7ee87da61c17 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:03.406588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b86552f1-7746-4e99-8194-7ee87da61c17 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:03.407505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b86552f1-7746-4e99-8194-7ee87da61c17 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:03.407935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b86552f1-7746-4e99-8194-7ee87da61c17 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:03.556383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b86552f1-7746-4e99-8194-7ee87da61c17 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:03.566150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b86552f1-7746-4e99-8194-7ee87da61c17 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.171790 Apr 11 19:52:03.566708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 369/668] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:03 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:03.756140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6381fb3-925d-4434-9f5c-46805655597e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:03.756873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e6381fb3-925d-4434-9f5c-46805655597e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:03.763960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6381fb3-925d-4434-9f5c-46805655597e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:03.764502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6381fb3-925d-4434-9f5c-46805655597e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:03.765403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6381fb3-925d-4434-9f5c-46805655597e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:03.765906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6381fb3-925d-4434-9f5c-46805655597e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:03.852289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-63544ff7-9165-4b92-ae90-97639ba957a5 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "POST /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 21.325305 Apr 11 19:52:03.854200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 300/669] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 19:51:42 2022] POST /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4/os-volume_attachments => generated 194 bytes in 21328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:03.926758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:03.927648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:03.935717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:03.936632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:03.937954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:03.939458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:03.946302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6381fb3-925d-4434-9f5c-46805655597e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:03.957277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6381fb3-925d-4434-9f5c-46805655597e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.205396 Apr 11 19:52:03.958325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 370/670] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:03 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:52:04.111802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:04.121964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:04.123856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:04.125810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ab9b1800-ba47-4e1c-b0b3-6c1c75026043 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.205842 Apr 11 19:52:04.127340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 301/671] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:52:04.410687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-737ce843-68d5-4d0e-855d-29565f116f2f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:04.410687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-737ce843-68d5-4d0e-855d-29565f116f2f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:04.417774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-737ce843-68d5-4d0e-855d-29565f116f2f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:04.418214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-737ce843-68d5-4d0e-855d-29565f116f2f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:04.419006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-737ce843-68d5-4d0e-855d-29565f116f2f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:04.419428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-737ce843-68d5-4d0e-855d-29565f116f2f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:04.582289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-737ce843-68d5-4d0e-855d-29565f116f2f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:04.584585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d5543828-344d-4622-9def-3f3f9bd2e8e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:04.585256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d5543828-344d-4622-9def-3f3f9bd2e8e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:04.592374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5543828-344d-4622-9def-3f3f9bd2e8e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:04.592880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5543828-344d-4622-9def-3f3f9bd2e8e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:04.593717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5543828-344d-4622-9def-3f3f9bd2e8e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:04.593822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-737ce843-68d5-4d0e-855d-29565f116f2f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1753 microversion: 2.1 time: 0.187797 Apr 11 19:52:04.594146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5543828-344d-4622-9def-3f3f9bd2e8e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:04.601411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 371/672] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:04.742607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d5543828-344d-4622-9def-3f3f9bd2e8e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:04.751102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d5543828-344d-4622-9def-3f3f9bd2e8e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1682 microversion: 2.1 time: 0.170586 Apr 11 19:52:04.752010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 302/673] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:04 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:04.978658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-426f035a-703d-4067-a563-fb11fd4d65f7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:04.979785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-426f035a-703d-4067-a563-fb11fd4d65f7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:04.987780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-426f035a-703d-4067-a563-fb11fd4d65f7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:04.987780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-426f035a-703d-4067-a563-fb11fd4d65f7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:04.987780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-426f035a-703d-4067-a563-fb11fd4d65f7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:04.987780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-426f035a-703d-4067-a563-fb11fd4d65f7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:05.124574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-426f035a-703d-4067-a563-fb11fd4d65f7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:05.132771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-426f035a-703d-4067-a563-fb11fd4d65f7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.158033 Apr 11 19:52:05.133552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 372/674] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:04 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:05.145683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:05.146649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:05.155239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:05.155984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:05.157156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:05.157626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:05.298366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:05.307349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:05.308850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:05.310066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c2de4df-b806-40ca-bddd-3e00fb57f83d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.168579 Apr 11 19:52:05.311039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 303/675] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:05.612362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-096e514e-493c-4f50-8a9b-60efb75f91c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:05.613021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-096e514e-493c-4f50-8a9b-60efb75f91c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:05.619791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-096e514e-493c-4f50-8a9b-60efb75f91c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:05.620231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-096e514e-493c-4f50-8a9b-60efb75f91c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:05.621347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-096e514e-493c-4f50-8a9b-60efb75f91c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:05.621758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-096e514e-493c-4f50-8a9b-60efb75f91c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:05.768136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c5b18bc-dd85-4daa-9128-0af1975723a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:05.769011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c5b18bc-dd85-4daa-9128-0af1975723a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:05.778050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c5b18bc-dd85-4daa-9128-0af1975723a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:05.787125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c5b18bc-dd85-4daa-9128-0af1975723a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:05.788114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c5b18bc-dd85-4daa-9128-0af1975723a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:05.789474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c5b18bc-dd85-4daa-9128-0af1975723a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:05.870094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-096e514e-493c-4f50-8a9b-60efb75f91c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:05.884004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-096e514e-493c-4f50-8a9b-60efb75f91c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.275231 Apr 11 19:52:05.885560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 373/676] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:05.905950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-bec46d11-f744-40a0-be9a-91fb710f01e6 req-2283585d-37ed-4138-bd48-b652de192a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99731dc4-4495-4be7-88d0-764f481cab49", "name": "network-vif-deleted", "tag": "60530c96-56a5-4c58-a966-719dd5fccd75"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:52:05.916321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-bec46d11-f744-40a0-be9a-91fb710f01e6 req-2283585d-37ed-4138-bd48-b652de192a0c service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:05.917621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-bec46d11-f744-40a0-be9a-91fb710f01e6 req-2283585d-37ed-4138-bd48-b652de192a0c service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:05.932310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-bec46d11-f744-40a0-be9a-91fb710f01e6 req-2283585d-37ed-4138-bd48-b652de192a0c service nova] Creating event network-vif-deleted:60530c96-56a5-4c58-a966-719dd5fccd75 for instance 99731dc4-4495-4be7-88d0-764f481cab49 on hv-cinder-83078 Apr 11 19:52:05.938357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-bec46d11-f744-40a0-be9a-91fb710f01e6 req-2283585d-37ed-4138-bd48-b652de192a0c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039446 Apr 11 19:52:05.943710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 374/677] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:05.950635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c5b18bc-dd85-4daa-9128-0af1975723a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:05.961475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c5b18bc-dd85-4daa-9128-0af1975723a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 200 len: 1614 microversion: 2.1 time: 0.197308 Apr 11 19:52:05.962769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 304/678] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:05 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 1614 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:06.158574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-142302a6-84cd-41f9-a56f-d6b62d41f774 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:06.159404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-142302a6-84cd-41f9-a56f-d6b62d41f774 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:06.166555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-142302a6-84cd-41f9-a56f-d6b62d41f774 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:06.167010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-142302a6-84cd-41f9-a56f-d6b62d41f774 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:06.167801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-142302a6-84cd-41f9-a56f-d6b62d41f774 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:06.168237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-142302a6-84cd-41f9-a56f-d6b62d41f774 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:06.331077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:06.331793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:06.341803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:06.342206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:06.344210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:06.344857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:06.368352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-142302a6-84cd-41f9-a56f-d6b62d41f774 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:06.380957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-142302a6-84cd-41f9-a56f-d6b62d41f774 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.226648 Apr 11 19:52:06.382461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 375/679] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:06 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:06.512168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:06.521033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:06.522538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:06.523717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e30c310b-976e-4958-a8ca-ab8119a2db7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.197075 Apr 11 19:52:06.524321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 305/680] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:06.905505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e90b7885-c20e-49cc-99cf-c455b1560275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:06.906708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e90b7885-c20e-49cc-99cf-c455b1560275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:06.914348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e90b7885-c20e-49cc-99cf-c455b1560275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:06.914829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e90b7885-c20e-49cc-99cf-c455b1560275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:06.915706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e90b7885-c20e-49cc-99cf-c455b1560275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:06.916572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e90b7885-c20e-49cc-99cf-c455b1560275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:06.982224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:06.982991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:06.990638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:06.991086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:06.991891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:06.992342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:07.008656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 99731dc4-4495-4be7-88d0-764f481cab49 could not be found. Apr 11 19:52:07.009334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 99731dc4-4495-4be7-88d0-764f481cab49 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:52:07.010193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c2a9fa93-8fd5-4bd6-b7d5-347c2494930e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 404 len: 111 microversion: 2.1 time: 0.034339 Apr 11 19:52:07.011075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 306/681] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:06 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:52:07.019712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04194197-fc60-49cc-860b-a19f12cc9c0c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '.version_select at 0x7f4086d79430>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:07.043261 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04194197-fc60-49cc-860b-a19f12cc9c0c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916147136" status: 202 len: 0 microversion: 2.1 time: 0.027416 Apr 11 19:52:07.046047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 307/682] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Apr 11 19:52:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916147136 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:52:07.106834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e90b7885-c20e-49cc-99cf-c455b1560275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:07.115684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e90b7885-c20e-49cc-99cf-c455b1560275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.215318 Apr 11 19:52:07.116255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 376/683] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:07.399658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bee2722a-27a5-439f-850c-c4cd82436380 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:07.400531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bee2722a-27a5-439f-850c-c4cd82436380 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:07.409290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bee2722a-27a5-439f-850c-c4cd82436380 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:07.409743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bee2722a-27a5-439f-850c-c4cd82436380 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:07.410552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bee2722a-27a5-439f-850c-c4cd82436380 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:07.410991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bee2722a-27a5-439f-850c-c4cd82436380 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:07.542141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:07.543075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:07.556101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:07.556542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:07.561543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:07.562245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:07.574568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bee2722a-27a5-439f-850c-c4cd82436380 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:07.582607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bee2722a-27a5-439f-850c-c4cd82436380 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.187207 Apr 11 19:52:07.583223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 308/684] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:07 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:07.744712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:07.755781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:07.757725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:07.759029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ca94a49d-db15-4451-82ce-2fcf08eda27e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.220690 Apr 11 19:52:07.759839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 377/685] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 19:52:07.832826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-cdf379dc-6bf1-430e-ba07-404aca107259 req-ac1dfcda-467a-4826-a217-1766e635ea17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6aea71-8b17-46b8-ab07-b42b41b573a5", "name": "network-vif-plugged", "status": "completed", "tag": "043741af-b872-498e-a793-2860d820736a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:52:07.845655 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cdf379dc-6bf1-430e-ba07-404aca107259 req-ac1dfcda-467a-4826-a217-1766e635ea17 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:07.846537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cdf379dc-6bf1-430e-ba07-404aca107259 req-ac1dfcda-467a-4826-a217-1766e635ea17 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:07.869458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-cdf379dc-6bf1-430e-ba07-404aca107259 req-ac1dfcda-467a-4826-a217-1766e635ea17 service nova] Creating event network-vif-plugged:043741af-b872-498e-a793-2860d820736a for instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 on hv-cinder-83078 Apr 11 19:52:07.883386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-cdf379dc-6bf1-430e-ba07-404aca107259 req-ac1dfcda-467a-4826-a217-1766e635ea17 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055978 Apr 11 19:52:07.885099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 309/686] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:07.888085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b719a27-6c7c-4156-b1e4-2404d504bea9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:07.888583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b719a27-6c7c-4156-b1e4-2404d504bea9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:07.895159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b719a27-6c7c-4156-b1e4-2404d504bea9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:07.895846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b719a27-6c7c-4156-b1e4-2404d504bea9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:07.896815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b719a27-6c7c-4156-b1e4-2404d504bea9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:07.897439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b719a27-6c7c-4156-b1e4-2404d504bea9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:07.994331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-2b719a27-6c7c-4156-b1e4-2404d504bea9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lazy-loading 'services' on Instance uuid 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:52:08.072208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b719a27-6c7c-4156-b1e4-2404d504bea9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments/2cf1a015-a355-46ae-a828-097410192a8a" status: 202 len: 0 microversion: 2.1 time: 0.187974 Apr 11 19:52:08.072817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 378/687] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 19:52:07 2022] DELETE /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments/2cf1a015-a355-46ae-a828-097410192a8a => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:52:08.082219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6859b186-2dfe-4afd-9d7a-9edbbf98428a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:08.083265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6859b186-2dfe-4afd-9d7a-9edbbf98428a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:08.089990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6859b186-2dfe-4afd-9d7a-9edbbf98428a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:08.090459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6859b186-2dfe-4afd-9d7a-9edbbf98428a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:08.091247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6859b186-2dfe-4afd-9d7a-9edbbf98428a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:08.091677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6859b186-2dfe-4afd-9d7a-9edbbf98428a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:08.132058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6859b186-2dfe-4afd-9d7a-9edbbf98428a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054455 Apr 11 19:52:08.133848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6ea8eb13-5de5-4cba-b5fb-864268196176 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:08.135040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6ea8eb13-5de5-4cba-b5fb-864268196176 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:08.136689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 310/688] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:08.142396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ea8eb13-5de5-4cba-b5fb-864268196176 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:08.142918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ea8eb13-5de5-4cba-b5fb-864268196176 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:08.143940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ea8eb13-5de5-4cba-b5fb-864268196176 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:08.144551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ea8eb13-5de5-4cba-b5fb-864268196176 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:08.314692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6ea8eb13-5de5-4cba-b5fb-864268196176 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:08.332313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6ea8eb13-5de5-4cba-b5fb-864268196176 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.203214 Apr 11 19:52:08.333270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 379/689] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:08.600011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ff0db6d4-a1e0-4a3f-9099-90c182c9cd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:08.600649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ff0db6d4-a1e0-4a3f-9099-90c182c9cd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:08.607518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff0db6d4-a1e0-4a3f-9099-90c182c9cd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:08.607967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff0db6d4-a1e0-4a3f-9099-90c182c9cd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:08.608724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff0db6d4-a1e0-4a3f-9099-90c182c9cd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:08.609216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff0db6d4-a1e0-4a3f-9099-90c182c9cd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:08.754394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ff0db6d4-a1e0-4a3f-9099-90c182c9cd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:08.758911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ff0db6d4-a1e0-4a3f-9099-90c182c9cd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.162963 Apr 11 19:52:08.759552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 311/690] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:08 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:08.777671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:08.778359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:08.784772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:08.785253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:08.786016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:08.786439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:08.918557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:08.927506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:08.929043 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:08.930211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-02f49775-a9a4-4146-8d0f-8df6939655c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.156601 Apr 11 19:52:08.930999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 380/691] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:09.144227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-493d9ad3-4db5-4720-91fe-ebdfbdd36679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:09.145178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-493d9ad3-4db5-4720-91fe-ebdfbdd36679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:09.151764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-493d9ad3-4db5-4720-91fe-ebdfbdd36679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:09.152211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-493d9ad3-4db5-4720-91fe-ebdfbdd36679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:09.153022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-493d9ad3-4db5-4720-91fe-ebdfbdd36679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:09.153448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-493d9ad3-4db5-4720-91fe-ebdfbdd36679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:09.187732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-493d9ad3-4db5-4720-91fe-ebdfbdd36679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047601 Apr 11 19:52:09.188326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 312/692] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:09.350606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-691243e8-6bdb-4099-a9d4-743043890237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:09.351220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-691243e8-6bdb-4099-a9d4-743043890237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:09.358088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-691243e8-6bdb-4099-a9d4-743043890237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:09.358529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-691243e8-6bdb-4099-a9d4-743043890237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:09.359302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-691243e8-6bdb-4099-a9d4-743043890237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:09.359732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-691243e8-6bdb-4099-a9d4-743043890237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:09.511714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-691243e8-6bdb-4099-a9d4-743043890237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:09.520050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-691243e8-6bdb-4099-a9d4-743043890237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.173611 Apr 11 19:52:09.520620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 381/693] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:09.776226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-772b7d85-bbae-410f-ab84-2beb66f545e1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:09.776813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-772b7d85-bbae-410f-ab84-2beb66f545e1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:09.783528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-772b7d85-bbae-410f-ab84-2beb66f545e1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:09.784032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-772b7d85-bbae-410f-ab84-2beb66f545e1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:09.784932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-772b7d85-bbae-410f-ab84-2beb66f545e1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:09.785400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-772b7d85-bbae-410f-ab84-2beb66f545e1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:09.931428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-772b7d85-bbae-410f-ab84-2beb66f545e1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:09.939206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-772b7d85-bbae-410f-ab84-2beb66f545e1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.167037 Apr 11 19:52:09.939775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 313/694] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:09 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:09.948751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:09.949394 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:09.956431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:09.957065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:09.957884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:09.958312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:10.094424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:10.103102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:10.104575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:10.105756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1365340-c0a7-4575-b272-8c31120c2e21 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.160936 Apr 11 19:52:10.106313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 382/695] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:10.200090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e9f3bef6-8a7e-40d6-98fe-c61bc61818f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:10.201078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e9f3bef6-8a7e-40d6-98fe-c61bc61818f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:10.208068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9f3bef6-8a7e-40d6-98fe-c61bc61818f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:10.208520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9f3bef6-8a7e-40d6-98fe-c61bc61818f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:10.209458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9f3bef6-8a7e-40d6-98fe-c61bc61818f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:10.209801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9f3bef6-8a7e-40d6-98fe-c61bc61818f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:10.241882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e9f3bef6-8a7e-40d6-98fe-c61bc61818f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Apr 11 19:52:10.242449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 314/696] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:10.537662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26f63404-9dc5-4759-9151-8a6564ee3ce0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:10.538227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-26f63404-9dc5-4759-9151-8a6564ee3ce0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:10.544695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26f63404-9dc5-4759-9151-8a6564ee3ce0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:10.545118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26f63404-9dc5-4759-9151-8a6564ee3ce0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:10.545889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26f63404-9dc5-4759-9151-8a6564ee3ce0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:10.546321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26f63404-9dc5-4759-9151-8a6564ee3ce0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:10.695232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-26f63404-9dc5-4759-9151-8a6564ee3ce0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:10.703629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26f63404-9dc5-4759-9151-8a6564ee3ce0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.170054 Apr 11 19:52:10.704214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 383/697] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:10.958395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f3f2d797-ce92-4566-b30f-52ce3f243a01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:10.959030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f3f2d797-ce92-4566-b30f-52ce3f243a01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:10.965860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3f2d797-ce92-4566-b30f-52ce3f243a01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:10.966315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3f2d797-ce92-4566-b30f-52ce3f243a01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:10.967093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3f2d797-ce92-4566-b30f-52ce3f243a01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:10.967556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3f2d797-ce92-4566-b30f-52ce3f243a01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:11.103774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f3f2d797-ce92-4566-b30f-52ce3f243a01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:11.111614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f3f2d797-ce92-4566-b30f-52ce3f243a01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.158555 Apr 11 19:52:11.112241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 315/698] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:10 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:11.128543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:11.129173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:11.136995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:11.137330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:11.138088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:11.138514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:11.254191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7783d77a-686b-4463-a57f-b8a9dedd6856 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:11.255509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7783d77a-686b-4463-a57f-b8a9dedd6856 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:11.261881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7783d77a-686b-4463-a57f-b8a9dedd6856 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:11.262442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7783d77a-686b-4463-a57f-b8a9dedd6856 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:11.263326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7783d77a-686b-4463-a57f-b8a9dedd6856 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:11.263858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7783d77a-686b-4463-a57f-b8a9dedd6856 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:11.279114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:11.289307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:11.292447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:11.293718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f047692a-c6cb-40bf-878e-6fb98635fdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1808 microversion: 2.20 time: 0.170831 Apr 11 19:52:11.294281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 384/699] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:11.313878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7783d77a-686b-4463-a57f-b8a9dedd6856 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059703 Apr 11 19:52:11.313878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 316/700] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:52:11.721449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4dd2d52f-a68f-4f11-bcb8-920f8ecae910 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:11.722035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4dd2d52f-a68f-4f11-bcb8-920f8ecae910 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:11.728852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dd2d52f-a68f-4f11-bcb8-920f8ecae910 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:11.729326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dd2d52f-a68f-4f11-bcb8-920f8ecae910 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:11.730113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dd2d52f-a68f-4f11-bcb8-920f8ecae910 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:11.730546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dd2d52f-a68f-4f11-bcb8-920f8ecae910 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:11.886802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4dd2d52f-a68f-4f11-bcb8-920f8ecae910 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:11.896773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4dd2d52f-a68f-4f11-bcb8-920f8ecae910 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.179174 Apr 11 19:52:11.897402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 385/701] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:12.130524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa245d7b-bb1a-4046-8fd3-2238dbf2a63f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:12.131070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa245d7b-bb1a-4046-8fd3-2238dbf2a63f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:12.138797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa245d7b-bb1a-4046-8fd3-2238dbf2a63f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:12.139267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa245d7b-bb1a-4046-8fd3-2238dbf2a63f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:12.140215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa245d7b-bb1a-4046-8fd3-2238dbf2a63f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:12.140688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa245d7b-bb1a-4046-8fd3-2238dbf2a63f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:12.296976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aa245d7b-bb1a-4046-8fd3-2238dbf2a63f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:12.303987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa245d7b-bb1a-4046-8fd3-2238dbf2a63f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.178748 Apr 11 19:52:12.304599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 317/702] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:12 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:12.312298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:12.312930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:12.320687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:12.321405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:12.321902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e1dd8c34-6164-45d2-b905-33a80c4525cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:12.322358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:12.322987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:12.323347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e1dd8c34-6164-45d2-b905-33a80c4525cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:12.330726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1dd8c34-6164-45d2-b905-33a80c4525cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:12.331193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1dd8c34-6164-45d2-b905-33a80c4525cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:12.332008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1dd8c34-6164-45d2-b905-33a80c4525cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:12.332438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1dd8c34-6164-45d2-b905-33a80c4525cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:12.374400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e1dd8c34-6164-45d2-b905-33a80c4525cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054923 Apr 11 19:52:12.374400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 318/703] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:12.477436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:12.486103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:12.487719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:12.489509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2ea02993-47b0-4111-b18d-1c9be37a70ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1795 microversion: 2.20 time: 0.181669 Apr 11 19:52:12.490043 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 386/704] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 19:52:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1795 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 19:52:12.914273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7533ac6b-fd54-4c4d-9d6a-e74cc4459e7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:12.914880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7533ac6b-fd54-4c4d-9d6a-e74cc4459e7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:12.921643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7533ac6b-fd54-4c4d-9d6a-e74cc4459e7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:12.922091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7533ac6b-fd54-4c4d-9d6a-e74cc4459e7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:12.922857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7533ac6b-fd54-4c4d-9d6a-e74cc4459e7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:12.923286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7533ac6b-fd54-4c4d-9d6a-e74cc4459e7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:13.075356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7533ac6b-fd54-4c4d-9d6a-e74cc4459e7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:13.083785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7533ac6b-fd54-4c4d-9d6a-e74cc4459e7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.173557 Apr 11 19:52:13.084375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 319/705] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:13.323085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15fa9c17-09f0-412e-b973-0d3dc71e3623 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:13.323722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15fa9c17-09f0-412e-b973-0d3dc71e3623 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:13.331834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15fa9c17-09f0-412e-b973-0d3dc71e3623 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:13.332281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15fa9c17-09f0-412e-b973-0d3dc71e3623 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:13.333096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15fa9c17-09f0-412e-b973-0d3dc71e3623 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:13.333532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15fa9c17-09f0-412e-b973-0d3dc71e3623 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:13.384841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4af7d368-53a1-4dad-9375-81d8dba9cb23 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:13.385808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4af7d368-53a1-4dad-9375-81d8dba9cb23 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:13.392590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4af7d368-53a1-4dad-9375-81d8dba9cb23 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:13.393070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4af7d368-53a1-4dad-9375-81d8dba9cb23 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:13.393908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4af7d368-53a1-4dad-9375-81d8dba9cb23 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:13.394346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4af7d368-53a1-4dad-9375-81d8dba9cb23 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:13.430873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4af7d368-53a1-4dad-9375-81d8dba9cb23 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049972 Apr 11 19:52:13.431708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 320/706] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:13.489675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15fa9c17-09f0-412e-b973-0d3dc71e3623 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:13.494806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15fa9c17-09f0-412e-b973-0d3dc71e3623 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.176333 Apr 11 19:52:13.495378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 387/707] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:13 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:13.816167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-6f21cfd5-7b6d-4521-8cd3-7e349d912b3d req-3175fe7a-58b8-4b64-8a68-9fd14cb8d3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2485fb-c412-422f-84b0-26e9200f5940", "name": "network-vif-plugged", "status": "completed", "tag": "38b4cc6e-f072-46cf-a68a-a3af8cc3637a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:52:13.824120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-6f21cfd5-7b6d-4521-8cd3-7e349d912b3d req-3175fe7a-58b8-4b64-8a68-9fd14cb8d3f4 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:13.824560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-6f21cfd5-7b6d-4521-8cd3-7e349d912b3d req-3175fe7a-58b8-4b64-8a68-9fd14cb8d3f4 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:13.836011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-6f21cfd5-7b6d-4521-8cd3-7e349d912b3d req-3175fe7a-58b8-4b64-8a68-9fd14cb8d3f4 service nova] Creating event network-vif-plugged:38b4cc6e-f072-46cf-a68a-a3af8cc3637a for instance 2b2485fb-c412-422f-84b0-26e9200f5940 on hv-cinder-83078 Apr 11 19:52:13.841022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-6f21cfd5-7b6d-4521-8cd3-7e349d912b3d req-3175fe7a-58b8-4b64-8a68-9fd14cb8d3f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028626 Apr 11 19:52:13.841631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 321/708] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:14.104943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75c26068-5dee-4b81-ae6c-721aa623ae55 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:14.105566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75c26068-5dee-4b81-ae6c-721aa623ae55 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:14.113946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75c26068-5dee-4b81-ae6c-721aa623ae55 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:14.114510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75c26068-5dee-4b81-ae6c-721aa623ae55 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:14.115439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75c26068-5dee-4b81-ae6c-721aa623ae55 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:14.115888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75c26068-5dee-4b81-ae6c-721aa623ae55 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:14.264296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-75c26068-5dee-4b81-ae6c-721aa623ae55 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:14.272731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75c26068-5dee-4b81-ae6c-721aa623ae55 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.173707 Apr 11 19:52:14.273461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 388/709] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:14.444257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3f6b405-5c45-4b07-9105-0dc3206a6d72 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:14.445314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3f6b405-5c45-4b07-9105-0dc3206a6d72 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:14.452431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3f6b405-5c45-4b07-9105-0dc3206a6d72 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:14.452872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3f6b405-5c45-4b07-9105-0dc3206a6d72 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:14.453674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3f6b405-5c45-4b07-9105-0dc3206a6d72 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:14.454098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3f6b405-5c45-4b07-9105-0dc3206a6d72 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:14.492289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3f6b405-5c45-4b07-9105-0dc3206a6d72 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053531 Apr 11 19:52:14.492876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 322/710] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:14.512081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c4a3c695-d485-4bc4-acc7-84bcbede83f1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:14.512796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c4a3c695-d485-4bc4-acc7-84bcbede83f1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:14.519118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4a3c695-d485-4bc4-acc7-84bcbede83f1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:14.519513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4a3c695-d485-4bc4-acc7-84bcbede83f1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:14.520275 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4a3c695-d485-4bc4-acc7-84bcbede83f1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:14.520772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4a3c695-d485-4bc4-acc7-84bcbede83f1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:14.661327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c4a3c695-d485-4bc4-acc7-84bcbede83f1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:14.669086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c4a3c695-d485-4bc4-acc7-84bcbede83f1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.160877 Apr 11 19:52:14.669592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 389/711] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:14 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:15.291466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-96e79f80-0fdd-4156-af69-ca7574c57926 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:15.292066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-96e79f80-0fdd-4156-af69-ca7574c57926 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:15.298614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96e79f80-0fdd-4156-af69-ca7574c57926 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:15.299055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96e79f80-0fdd-4156-af69-ca7574c57926 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:15.299810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96e79f80-0fdd-4156-af69-ca7574c57926 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:15.300243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96e79f80-0fdd-4156-af69-ca7574c57926 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:15.455962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-96e79f80-0fdd-4156-af69-ca7574c57926 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:15.464215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-96e79f80-0fdd-4156-af69-ca7574c57926 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.177323 Apr 11 19:52:15.464787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 323/712] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:15.507292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5543f357-9e14-4690-b070-17aca1ab2f67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:15.508921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5543f357-9e14-4690-b070-17aca1ab2f67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:15.518911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5543f357-9e14-4690-b070-17aca1ab2f67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:15.519748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5543f357-9e14-4690-b070-17aca1ab2f67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:15.520113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5543f357-9e14-4690-b070-17aca1ab2f67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:15.520539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5543f357-9e14-4690-b070-17aca1ab2f67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:15.554061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5543f357-9e14-4690-b070-17aca1ab2f67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053269 Apr 11 19:52:15.554756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 390/713] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:15.687488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d183f973-7752-420b-b605-c0060a8cb6ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:15.688107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d183f973-7752-420b-b605-c0060a8cb6ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:15.694719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d183f973-7752-420b-b605-c0060a8cb6ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:15.695168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d183f973-7752-420b-b605-c0060a8cb6ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:15.695941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d183f973-7752-420b-b605-c0060a8cb6ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:15.696370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d183f973-7752-420b-b605-c0060a8cb6ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:15.835128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d183f973-7752-420b-b605-c0060a8cb6ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:15.843117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d183f973-7752-420b-b605-c0060a8cb6ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1265 microversion: 2.1 time: 0.160549 Apr 11 19:52:15.843722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 324/714] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:15 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:16.481840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-736f70e4-85cc-400f-8dad-1f4d436e3e69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:16.482364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-736f70e4-85cc-400f-8dad-1f4d436e3e69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:16.488946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-736f70e4-85cc-400f-8dad-1f4d436e3e69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:16.489453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-736f70e4-85cc-400f-8dad-1f4d436e3e69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:16.490219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-736f70e4-85cc-400f-8dad-1f4d436e3e69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:16.490647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-736f70e4-85cc-400f-8dad-1f4d436e3e69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:16.566579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d26d9bd5-69b3-4893-b2e3-132a633a75e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:16.567671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d26d9bd5-69b3-4893-b2e3-132a633a75e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:16.574146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d26d9bd5-69b3-4893-b2e3-132a633a75e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:16.574614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d26d9bd5-69b3-4893-b2e3-132a633a75e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:16.575391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d26d9bd5-69b3-4893-b2e3-132a633a75e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:16.575801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d26d9bd5-69b3-4893-b2e3-132a633a75e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:16.615143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d26d9bd5-69b3-4893-b2e3-132a633a75e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052598 Apr 11 19:52:16.619195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 325/715] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:52:16.655031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-736f70e4-85cc-400f-8dad-1f4d436e3e69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:16.663485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-736f70e4-85cc-400f-8dad-1f4d436e3e69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.185633 Apr 11 19:52:16.664061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 391/716] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:16.861564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6580d34c-d8e0-466e-9065-1b6d75103d15 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:16.862650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6580d34c-d8e0-466e-9065-1b6d75103d15 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:16.870098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6580d34c-d8e0-466e-9065-1b6d75103d15 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:16.870545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6580d34c-d8e0-466e-9065-1b6d75103d15 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:16.871342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6580d34c-d8e0-466e-9065-1b6d75103d15 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:16.871792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6580d34c-d8e0-466e-9065-1b6d75103d15 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:17.018754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6580d34c-d8e0-466e-9065-1b6d75103d15 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:17.026869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6580d34c-d8e0-466e-9065-1b6d75103d15 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1451 microversion: 2.1 time: 0.170235 Apr 11 19:52:17.027426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 326/717] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:16 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:17.048933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53229ec5-96dd-42f1-a293-fe05563e214f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:17.049661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53229ec5-96dd-42f1-a293-fe05563e214f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:17.055758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53229ec5-96dd-42f1-a293-fe05563e214f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:17.056207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53229ec5-96dd-42f1-a293-fe05563e214f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:17.057013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53229ec5-96dd-42f1-a293-fe05563e214f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:17.057450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53229ec5-96dd-42f1-a293-fe05563e214f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:17.200129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-53229ec5-96dd-42f1-a293-fe05563e214f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:17.209321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53229ec5-96dd-42f1-a293-fe05563e214f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1451 microversion: 2.1 time: 0.163795 Apr 11 19:52:17.210055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 392/718] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:17 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:17.626565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2125b8a3-f17e-4be9-8cf1-f30dcad7ce95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:17.627602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2125b8a3-f17e-4be9-8cf1-f30dcad7ce95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:17.634681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2125b8a3-f17e-4be9-8cf1-f30dcad7ce95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:17.635118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2125b8a3-f17e-4be9-8cf1-f30dcad7ce95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:17.635911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2125b8a3-f17e-4be9-8cf1-f30dcad7ce95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:17.636336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2125b8a3-f17e-4be9-8cf1-f30dcad7ce95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:17.672656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2125b8a3-f17e-4be9-8cf1-f30dcad7ce95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050403 Apr 11 19:52:17.673671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 327/719] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:17.684233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-831fd67f-c8d2-4439-a191-4f099d6f777c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:17.684957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-831fd67f-c8d2-4439-a191-4f099d6f777c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:17.691379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-831fd67f-c8d2-4439-a191-4f099d6f777c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:17.691826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-831fd67f-c8d2-4439-a191-4f099d6f777c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:17.692656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-831fd67f-c8d2-4439-a191-4f099d6f777c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:17.693295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-831fd67f-c8d2-4439-a191-4f099d6f777c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:17.929942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-831fd67f-c8d2-4439-a191-4f099d6f777c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:17.937883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-831fd67f-c8d2-4439-a191-4f099d6f777c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.257708 Apr 11 19:52:17.938488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 393/720] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:18.687764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bd83d644-bc58-45f8-9efb-b21a3d0f395e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:18.688785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bd83d644-bc58-45f8-9efb-b21a3d0f395e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:18.697147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd83d644-bc58-45f8-9efb-b21a3d0f395e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:18.697605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd83d644-bc58-45f8-9efb-b21a3d0f395e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:18.698442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd83d644-bc58-45f8-9efb-b21a3d0f395e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:18.698820 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd83d644-bc58-45f8-9efb-b21a3d0f395e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:18.736708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bd83d644-bc58-45f8-9efb-b21a3d0f395e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053904 Apr 11 19:52:18.737639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 328/721] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:18.955977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fa61ba3b-ec15-44c1-a160-6eddde57090e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:18.956722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fa61ba3b-ec15-44c1-a160-6eddde57090e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:18.964025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa61ba3b-ec15-44c1-a160-6eddde57090e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:18.964468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa61ba3b-ec15-44c1-a160-6eddde57090e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:18.965371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa61ba3b-ec15-44c1-a160-6eddde57090e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:18.965800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa61ba3b-ec15-44c1-a160-6eddde57090e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:19.217928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fa61ba3b-ec15-44c1-a160-6eddde57090e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:19.226382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fa61ba3b-ec15-44c1-a160-6eddde57090e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.274515 Apr 11 19:52:19.226948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 394/722] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:19.417455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-e37e9900-9835-4978-965f-df65b2f7a7fa req-41cade4f-832c-4ca2-9367-c2b0008bccbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2485fb-c412-422f-84b0-26e9200f5940", "tag": "38b4cc6e-f072-46cf-a68a-a3af8cc3637a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:52:19.425984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-e37e9900-9835-4978-965f-df65b2f7a7fa req-41cade4f-832c-4ca2-9367-c2b0008bccbd service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:19.426427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-e37e9900-9835-4978-965f-df65b2f7a7fa req-41cade4f-832c-4ca2-9367-c2b0008bccbd service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:19.438697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-e37e9900-9835-4978-965f-df65b2f7a7fa req-41cade4f-832c-4ca2-9367-c2b0008bccbd service nova] Creating event network-changed:38b4cc6e-f072-46cf-a68a-a3af8cc3637a for instance 2b2485fb-c412-422f-84b0-26e9200f5940 on hv-cinder-83078 Apr 11 19:52:19.447538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-e37e9900-9835-4978-965f-df65b2f7a7fa req-41cade4f-832c-4ca2-9367-c2b0008bccbd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033753 Apr 11 19:52:19.448055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 329/723] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:19.747957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-08d116e1-8509-4dae-8f4a-76e7ee80c5ac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:19.748882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-08d116e1-8509-4dae-8f4a-76e7ee80c5ac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:19.758095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08d116e1-8509-4dae-8f4a-76e7ee80c5ac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:19.758537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08d116e1-8509-4dae-8f4a-76e7ee80c5ac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:19.759314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08d116e1-8509-4dae-8f4a-76e7ee80c5ac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:19.759740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08d116e1-8509-4dae-8f4a-76e7ee80c5ac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:19.791802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-08d116e1-8509-4dae-8f4a-76e7ee80c5ac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047763 Apr 11 19:52:19.792761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 395/724] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:20.245083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5c3a2ca-acd0-4c7a-9004-621b9cc8b625 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:20.245692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5c3a2ca-acd0-4c7a-9004-621b9cc8b625 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:20.252468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c3a2ca-acd0-4c7a-9004-621b9cc8b625 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:20.253001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c3a2ca-acd0-4c7a-9004-621b9cc8b625 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:20.253813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c3a2ca-acd0-4c7a-9004-621b9cc8b625 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:20.254241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c3a2ca-acd0-4c7a-9004-621b9cc8b625 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:20.416616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5c3a2ca-acd0-4c7a-9004-621b9cc8b625 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:20.425133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5c3a2ca-acd0-4c7a-9004-621b9cc8b625 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.184911 Apr 11 19:52:20.425955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 330/725] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:20.807148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-61794316-7a9e-4274-9904-f9da4ae350d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:20.807962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-61794316-7a9e-4274-9904-f9da4ae350d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:20.814963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61794316-7a9e-4274-9904-f9da4ae350d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:20.815410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61794316-7a9e-4274-9904-f9da4ae350d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:20.816193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61794316-7a9e-4274-9904-f9da4ae350d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:20.816636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61794316-7a9e-4274-9904-f9da4ae350d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:20.847714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-61794316-7a9e-4274-9904-f9da4ae350d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Apr 11 19:52:20.848251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 396/726] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:21.442889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b92a73ff-ad41-4729-a8f5-6573f771bd24 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:21.443467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b92a73ff-ad41-4729-a8f5-6573f771bd24 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:21.450163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b92a73ff-ad41-4729-a8f5-6573f771bd24 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:21.450609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b92a73ff-ad41-4729-a8f5-6573f771bd24 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:21.451338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b92a73ff-ad41-4729-a8f5-6573f771bd24 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:21.451767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b92a73ff-ad41-4729-a8f5-6573f771bd24 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:21.598799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b92a73ff-ad41-4729-a8f5-6573f771bd24 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:21.607215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b92a73ff-ad41-4729-a8f5-6573f771bd24 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1758 microversion: 2.1 time: 0.168265 Apr 11 19:52:21.607792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 331/727] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:21.863511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-24fe56f6-60a2-41c0-beaa-01cc646da4d6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:21.864588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-24fe56f6-60a2-41c0-beaa-01cc646da4d6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:21.873198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24fe56f6-60a2-41c0-beaa-01cc646da4d6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:21.873843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24fe56f6-60a2-41c0-beaa-01cc646da4d6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:21.875203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24fe56f6-60a2-41c0-beaa-01cc646da4d6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:21.875765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24fe56f6-60a2-41c0-beaa-01cc646da4d6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:21.908255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-24fe56f6-60a2-41c0-beaa-01cc646da4d6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051335 Apr 11 19:52:21.909012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 397/728] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:22.624486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aaf01f79-7181-40ed-8c22-d012856ff69b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:22.625487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aaf01f79-7181-40ed-8c22-d012856ff69b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:22.633422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aaf01f79-7181-40ed-8c22-d012856ff69b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:22.633868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aaf01f79-7181-40ed-8c22-d012856ff69b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:22.634634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aaf01f79-7181-40ed-8c22-d012856ff69b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:22.635059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aaf01f79-7181-40ed-8c22-d012856ff69b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:22.800634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aaf01f79-7181-40ed-8c22-d012856ff69b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:52:22.808761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aaf01f79-7181-40ed-8c22-d012856ff69b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1761 microversion: 2.1 time: 0.188745 Apr 11 19:52:22.809355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 332/729] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:52:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1761 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:52:22.920603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ee50e14-3434-41fc-9735-fb313853fa97 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:22.921478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ee50e14-3434-41fc-9735-fb313853fa97 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:22.928357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee50e14-3434-41fc-9735-fb313853fa97 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:22.928810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee50e14-3434-41fc-9735-fb313853fa97 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:22.929635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee50e14-3434-41fc-9735-fb313853fa97 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:22.930069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee50e14-3434-41fc-9735-fb313853fa97 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:22.963378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ee50e14-3434-41fc-9735-fb313853fa97 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046923 Apr 11 19:52:22.964034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 398/730] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:23.975600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bbb4cac2-cce1-45be-ba38-f3c2250460de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:23.976560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bbb4cac2-cce1-45be-ba38-f3c2250460de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:23.983281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb4cac2-cce1-45be-ba38-f3c2250460de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:23.983724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb4cac2-cce1-45be-ba38-f3c2250460de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:23.984490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb4cac2-cce1-45be-ba38-f3c2250460de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:23.984890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb4cac2-cce1-45be-ba38-f3c2250460de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:24.015294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bbb4cac2-cce1-45be-ba38-f3c2250460de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043680 Apr 11 19:52:24.015849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 333/731] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:25.027898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd313b35-7735-4e78-ae90-314b8ab1f1ea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:25.028799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd313b35-7735-4e78-ae90-314b8ab1f1ea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:25.035525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd313b35-7735-4e78-ae90-314b8ab1f1ea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:25.035969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd313b35-7735-4e78-ae90-314b8ab1f1ea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:25.036731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd313b35-7735-4e78-ae90-314b8ab1f1ea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:25.037184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd313b35-7735-4e78-ae90-314b8ab1f1ea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:25.066737 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd313b35-7735-4e78-ae90-314b8ab1f1ea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042769 Apr 11 19:52:25.067330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 399/732] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:26.081306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-436df662-d9a0-4b91-93c9-d02109530ea1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:26.082256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-436df662-d9a0-4b91-93c9-d02109530ea1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:26.089374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-436df662-d9a0-4b91-93c9-d02109530ea1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:26.089823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-436df662-d9a0-4b91-93c9-d02109530ea1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:26.090592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-436df662-d9a0-4b91-93c9-d02109530ea1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:26.091027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-436df662-d9a0-4b91-93c9-d02109530ea1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:26.120690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-436df662-d9a0-4b91-93c9-d02109530ea1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044578 Apr 11 19:52:26.121406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 334/733] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:27.133150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3d58e655-69af-4461-8f0b-df32b411eaa8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:27.134118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3d58e655-69af-4461-8f0b-df32b411eaa8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:27.140419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d58e655-69af-4461-8f0b-df32b411eaa8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:27.140858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d58e655-69af-4461-8f0b-df32b411eaa8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:27.141647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d58e655-69af-4461-8f0b-df32b411eaa8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:27.142071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d58e655-69af-4461-8f0b-df32b411eaa8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:27.173557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3d58e655-69af-4461-8f0b-df32b411eaa8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Apr 11 19:52:27.177612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 400/734] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:28.185438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-426b2a85-1ea5-4b12-9131-b977518bdc1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:28.186391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-426b2a85-1ea5-4b12-9131-b977518bdc1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:28.193243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-426b2a85-1ea5-4b12-9131-b977518bdc1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:28.193698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-426b2a85-1ea5-4b12-9131-b977518bdc1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:28.194477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-426b2a85-1ea5-4b12-9131-b977518bdc1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:28.194906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-426b2a85-1ea5-4b12-9131-b977518bdc1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:28.225380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-426b2a85-1ea5-4b12-9131-b977518bdc1b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Apr 11 19:52:28.225961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 335/735] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:29.238263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-05cde7b3-f8b6-467b-80d9-01940992e95d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:29.239225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-05cde7b3-f8b6-467b-80d9-01940992e95d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:29.246186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05cde7b3-f8b6-467b-80d9-01940992e95d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:29.246638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05cde7b3-f8b6-467b-80d9-01940992e95d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:29.247424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05cde7b3-f8b6-467b-80d9-01940992e95d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:29.247840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05cde7b3-f8b6-467b-80d9-01940992e95d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:29.279208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-05cde7b3-f8b6-467b-80d9-01940992e95d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Apr 11 19:52:29.279805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 401/736] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:30.290898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c806318-e1cc-4159-ad2a-02c9b4bd4499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:30.291820 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c806318-e1cc-4159-ad2a-02c9b4bd4499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:30.298824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c806318-e1cc-4159-ad2a-02c9b4bd4499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:30.299273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c806318-e1cc-4159-ad2a-02c9b4bd4499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:30.300036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c806318-e1cc-4159-ad2a-02c9b4bd4499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:30.300458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c806318-e1cc-4159-ad2a-02c9b4bd4499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:30.329726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c806318-e1cc-4159-ad2a-02c9b4bd4499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042886 Apr 11 19:52:30.330286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 336/737] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:31.341851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-24695f78-e9ab-4998-a1e7-8be8ddddc6cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:31.342778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-24695f78-e9ab-4998-a1e7-8be8ddddc6cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:31.349606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24695f78-e9ab-4998-a1e7-8be8ddddc6cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:31.350057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24695f78-e9ab-4998-a1e7-8be8ddddc6cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:31.350826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24695f78-e9ab-4998-a1e7-8be8ddddc6cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:31.351256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24695f78-e9ab-4998-a1e7-8be8ddddc6cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:31.384014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-24695f78-e9ab-4998-a1e7-8be8ddddc6cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Apr 11 19:52:31.384866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 402/738] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:32.397929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2955917-43de-41dd-86cb-d9719a9afca3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:32.398892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2955917-43de-41dd-86cb-d9719a9afca3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:32.406117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2955917-43de-41dd-86cb-d9719a9afca3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:32.406590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2955917-43de-41dd-86cb-d9719a9afca3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:32.407406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2955917-43de-41dd-86cb-d9719a9afca3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:32.407843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2955917-43de-41dd-86cb-d9719a9afca3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:32.437756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2955917-43de-41dd-86cb-d9719a9afca3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 Apr 11 19:52:32.438359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 337/739] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:33.450086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-459cd238-bc7e-4382-a86f-084770a4eb09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:33.450947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-459cd238-bc7e-4382-a86f-084770a4eb09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:33.457959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-459cd238-bc7e-4382-a86f-084770a4eb09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:33.458407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-459cd238-bc7e-4382-a86f-084770a4eb09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:33.459180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-459cd238-bc7e-4382-a86f-084770a4eb09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:33.459602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-459cd238-bc7e-4382-a86f-084770a4eb09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:33.490964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-459cd238-bc7e-4382-a86f-084770a4eb09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Apr 11 19:52:33.491571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 403/740] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:34.502799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9a8f183b-a096-46c6-8d52-3ad1afe0c809 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:34.503629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9a8f183b-a096-46c6-8d52-3ad1afe0c809 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:34.510389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a8f183b-a096-46c6-8d52-3ad1afe0c809 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:34.510838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a8f183b-a096-46c6-8d52-3ad1afe0c809 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:34.511603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a8f183b-a096-46c6-8d52-3ad1afe0c809 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:34.512027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a8f183b-a096-46c6-8d52-3ad1afe0c809 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:34.543978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9a8f183b-a096-46c6-8d52-3ad1afe0c809 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045575 Apr 11 19:52:34.544548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 338/741] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:35.556300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-18e7dbbe-a6db-4d2a-9822-dae9aa6c7b39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:35.557222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-18e7dbbe-a6db-4d2a-9822-dae9aa6c7b39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:35.564209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbe-a6db-4d2a-9822-dae9aa6c7b39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:35.564652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbe-a6db-4d2a-9822-dae9aa6c7b39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:35.565555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbe-a6db-4d2a-9822-dae9aa6c7b39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:35.565978 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbe-a6db-4d2a-9822-dae9aa6c7b39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:35.596699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-18e7dbbe-a6db-4d2a-9822-dae9aa6c7b39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Apr 11 19:52:35.597310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 404/742] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:36.609671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1846363-4e8a-4631-966d-3a3f52996fd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:36.610612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1846363-4e8a-4631-966d-3a3f52996fd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:36.617667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1846363-4e8a-4631-966d-3a3f52996fd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:36.618129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1846363-4e8a-4631-966d-3a3f52996fd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:36.618878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1846363-4e8a-4631-966d-3a3f52996fd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:36.619338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1846363-4e8a-4631-966d-3a3f52996fd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:36.650681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1846363-4e8a-4631-966d-3a3f52996fd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Apr 11 19:52:36.651283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 339/743] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:37.664092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c253bcb2-ef32-48f9-893e-b899a42b2add tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:37.665217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c253bcb2-ef32-48f9-893e-b899a42b2add tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:37.671792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c253bcb2-ef32-48f9-893e-b899a42b2add tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:37.672257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c253bcb2-ef32-48f9-893e-b899a42b2add tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:37.673100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c253bcb2-ef32-48f9-893e-b899a42b2add tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:37.673553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c253bcb2-ef32-48f9-893e-b899a42b2add tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:37.705127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c253bcb2-ef32-48f9-893e-b899a42b2add tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045472 Apr 11 19:52:37.709084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 405/744] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:38.717749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4cb083a7-d850-4144-ad1e-4dbe57db9ca9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:38.718715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4cb083a7-d850-4144-ad1e-4dbe57db9ca9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:38.725537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cb083a7-d850-4144-ad1e-4dbe57db9ca9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:38.726134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cb083a7-d850-4144-ad1e-4dbe57db9ca9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:38.727303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cb083a7-d850-4144-ad1e-4dbe57db9ca9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:38.727914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cb083a7-d850-4144-ad1e-4dbe57db9ca9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:38.759037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4cb083a7-d850-4144-ad1e-4dbe57db9ca9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046426 Apr 11 19:52:38.759613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 340/745] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:39.771870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b315be94-c422-4a56-9784-e75de4b454b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:39.773957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b315be94-c422-4a56-9784-e75de4b454b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:39.781772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b315be94-c422-4a56-9784-e75de4b454b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:39.782248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b315be94-c422-4a56-9784-e75de4b454b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:39.783049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b315be94-c422-4a56-9784-e75de4b454b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:39.783478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b315be94-c422-4a56-9784-e75de4b454b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:39.971790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b315be94-c422-4a56-9784-e75de4b454b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204306 Apr 11 19:52:39.972518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 406/746] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:40.983003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f06a0b53-7988-4121-adf6-4e461fa137df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:40.983909 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f06a0b53-7988-4121-adf6-4e461fa137df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:40.991579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06a0b53-7988-4121-adf6-4e461fa137df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:40.992023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06a0b53-7988-4121-adf6-4e461fa137df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:40.992795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06a0b53-7988-4121-adf6-4e461fa137df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:40.993265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06a0b53-7988-4121-adf6-4e461fa137df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:41.025178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f06a0b53-7988-4121-adf6-4e461fa137df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Apr 11 19:52:41.025777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 341/747] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:42.039148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-30b8fd27-dd5b-4993-9e7d-ab26b19015dc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:42.040121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-30b8fd27-dd5b-4993-9e7d-ab26b19015dc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:42.047187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30b8fd27-dd5b-4993-9e7d-ab26b19015dc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:42.047646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30b8fd27-dd5b-4993-9e7d-ab26b19015dc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:42.048420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30b8fd27-dd5b-4993-9e7d-ab26b19015dc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:42.048855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30b8fd27-dd5b-4993-9e7d-ab26b19015dc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:42.079236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-30b8fd27-dd5b-4993-9e7d-ab26b19015dc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Apr 11 19:52:42.079820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 407/748] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:43.091333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74da518e-a0e6-4d6d-b2ad-281393263079 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:43.092261 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74da518e-a0e6-4d6d-b2ad-281393263079 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:43.098788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74da518e-a0e6-4d6d-b2ad-281393263079 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:43.099244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74da518e-a0e6-4d6d-b2ad-281393263079 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:43.100152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74da518e-a0e6-4d6d-b2ad-281393263079 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:43.100581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74da518e-a0e6-4d6d-b2ad-281393263079 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:43.130137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74da518e-a0e6-4d6d-b2ad-281393263079 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042726 Apr 11 19:52:43.130700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 342/749] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:44.143881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c704ff3a-842e-4522-a233-65394dae2258 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:44.145485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c704ff3a-842e-4522-a233-65394dae2258 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:44.152138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c704ff3a-842e-4522-a233-65394dae2258 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:44.152583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c704ff3a-842e-4522-a233-65394dae2258 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:44.153406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c704ff3a-842e-4522-a233-65394dae2258 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:44.153841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c704ff3a-842e-4522-a233-65394dae2258 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:44.183148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c704ff3a-842e-4522-a233-65394dae2258 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Apr 11 19:52:44.183699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 408/750] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:44.603367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:52:44.603755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 19:52:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 19:52:45.195575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-90596fae-4256-494c-b57d-4c1a36dfb1ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:45.196525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-90596fae-4256-494c-b57d-4c1a36dfb1ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:45.202668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90596fae-4256-494c-b57d-4c1a36dfb1ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:45.203135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90596fae-4256-494c-b57d-4c1a36dfb1ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:45.203893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90596fae-4256-494c-b57d-4c1a36dfb1ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:45.204320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90596fae-4256-494c-b57d-4c1a36dfb1ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:45.236391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-90596fae-4256-494c-b57d-4c1a36dfb1ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045175 Apr 11 19:52:45.237022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 343/751] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:46.248076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4292ec99-ec90-4658-939a-34efa75cd266 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:46.249084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4292ec99-ec90-4658-939a-34efa75cd266 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:46.256936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4292ec99-ec90-4658-939a-34efa75cd266 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:46.257393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4292ec99-ec90-4658-939a-34efa75cd266 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:46.258169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4292ec99-ec90-4658-939a-34efa75cd266 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:46.258612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4292ec99-ec90-4658-939a-34efa75cd266 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:46.288855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4292ec99-ec90-4658-939a-34efa75cd266 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 Apr 11 19:52:46.289590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 409/752] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:47.469950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e38a89e4-41ef-45d9-b4fa-1ea66c6e5816 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:47.470921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e38a89e4-41ef-45d9-b4fa-1ea66c6e5816 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:47.477043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e38a89e4-41ef-45d9-b4fa-1ea66c6e5816 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:47.477487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e38a89e4-41ef-45d9-b4fa-1ea66c6e5816 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:47.478242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e38a89e4-41ef-45d9-b4fa-1ea66c6e5816 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:47.478670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e38a89e4-41ef-45d9-b4fa-1ea66c6e5816 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:47.508619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e38a89e4-41ef-45d9-b4fa-1ea66c6e5816 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211237 Apr 11 19:52:47.509429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 344/753] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:47.556408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:52:47.557211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 19:52:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 19:52:48.519999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1733e4c8-67c2-40ea-b583-bcfabba15ace tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:48.521253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1733e4c8-67c2-40ea-b583-bcfabba15ace tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:48.528643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1733e4c8-67c2-40ea-b583-bcfabba15ace tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:48.529130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1733e4c8-67c2-40ea-b583-bcfabba15ace tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:48.529912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1733e4c8-67c2-40ea-b583-bcfabba15ace tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:48.530342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1733e4c8-67c2-40ea-b583-bcfabba15ace tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:48.560921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1733e4c8-67c2-40ea-b583-bcfabba15ace tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Apr 11 19:52:48.561619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 410/754] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:49.575447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce521c71-f737-4ef0-a8be-18b1dc7c208e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:49.576522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce521c71-f737-4ef0-a8be-18b1dc7c208e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:49.583740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce521c71-f737-4ef0-a8be-18b1dc7c208e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:49.584184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce521c71-f737-4ef0-a8be-18b1dc7c208e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:49.585000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce521c71-f737-4ef0-a8be-18b1dc7c208e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:49.585433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce521c71-f737-4ef0-a8be-18b1dc7c208e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:49.616830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce521c71-f737-4ef0-a8be-18b1dc7c208e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Apr 11 19:52:49.617438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 345/755] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:50.630012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3997445d-83d3-4234-ba59-6fa33b7ba6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:50.630947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3997445d-83d3-4234-ba59-6fa33b7ba6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:50.637984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3997445d-83d3-4234-ba59-6fa33b7ba6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:50.638449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3997445d-83d3-4234-ba59-6fa33b7ba6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:50.639225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3997445d-83d3-4234-ba59-6fa33b7ba6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:50.639646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3997445d-83d3-4234-ba59-6fa33b7ba6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:50.671682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3997445d-83d3-4234-ba59-6fa33b7ba6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045754 Apr 11 19:52:50.672251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 411/756] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:50.993802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eee90997-d9e3-4f97-bfa9-5b6e4fdfff12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:50.994787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eee90997-d9e3-4f97-bfa9-5b6e4fdfff12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:51.002207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eee90997-d9e3-4f97-bfa9-5b6e4fdfff12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:51.002654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eee90997-d9e3-4f97-bfa9-5b6e4fdfff12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:51.003432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eee90997-d9e3-4f97-bfa9-5b6e4fdfff12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:51.003868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eee90997-d9e3-4f97-bfa9-5b6e4fdfff12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:51.036114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eee90997-d9e3-4f97-bfa9-5b6e4fdfff12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments/744d9242-d7d2-47b5-b9e8-cbfb89b54d6c" status: 200 len: 194 microversion: 2.20 time: 0.048267 Apr 11 19:52:51.036723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 346/757] 10.222.0.62 () {60 vars in 1453 bytes} [Mon Apr 11 19:52:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments/744d9242-d7d2-47b5-b9e8-cbfb89b54d6c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:52:51.101184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a9fd0b1f-c26f-4500-9a35-50daa0309d40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:51.101674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a9fd0b1f-c26f-4500-9a35-50daa0309d40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:51.107987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9fd0b1f-c26f-4500-9a35-50daa0309d40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:51.108419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9fd0b1f-c26f-4500-9a35-50daa0309d40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:51.109247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9fd0b1f-c26f-4500-9a35-50daa0309d40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:51.109671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9fd0b1f-c26f-4500-9a35-50daa0309d40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:51.339189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-a9fd0b1f-c26f-4500-9a35-50daa0309d40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lazy-loading 'services' on Instance uuid fb6aea71-8b17-46b8-ab07-b42b41b573a5 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:52:51.415565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a9fd0b1f-c26f-4500-9a35-50daa0309d40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments/744d9242-d7d2-47b5-b9e8-cbfb89b54d6c" status: 202 len: 0 microversion: 2.20 time: 0.318401 Apr 11 19:52:51.416171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 412/758] 10.222.0.62 () {60 vars in 1456 bytes} [Mon Apr 11 19:52:51 2022] DELETE /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments/744d9242-d7d2-47b5-b9e8-cbfb89b54d6c => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:52:51.426692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-470711a3-e056-4165-a3cd-0778a44228a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:51.427621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-470711a3-e056-4165-a3cd-0778a44228a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:51.433970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-470711a3-e056-4165-a3cd-0778a44228a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:51.434699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-470711a3-e056-4165-a3cd-0778a44228a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:51.435676 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-470711a3-e056-4165-a3cd-0778a44228a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:51.436104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-470711a3-e056-4165-a3cd-0778a44228a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:51.468184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-470711a3-e056-4165-a3cd-0778a44228a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045590 Apr 11 19:52:51.469038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 347/759] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:52:51.684357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-176e8c4c-0b1f-4d5f-8182-bff017854882 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:51.685492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-176e8c4c-0b1f-4d5f-8182-bff017854882 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:51.692390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-176e8c4c-0b1f-4d5f-8182-bff017854882 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:51.692835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-176e8c4c-0b1f-4d5f-8182-bff017854882 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:51.693647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-176e8c4c-0b1f-4d5f-8182-bff017854882 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:51.694109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-176e8c4c-0b1f-4d5f-8182-bff017854882 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:51.725062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-176e8c4c-0b1f-4d5f-8182-bff017854882 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Apr 11 19:52:51.725638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 413/760] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:52.481079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-48a7c26d-18f4-4dfe-a78f-edd26ff484ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:52.482100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-48a7c26d-18f4-4dfe-a78f-edd26ff484ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:52.489433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48a7c26d-18f4-4dfe-a78f-edd26ff484ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:52.490059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48a7c26d-18f4-4dfe-a78f-edd26ff484ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:52.491206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48a7c26d-18f4-4dfe-a78f-edd26ff484ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:52.491806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48a7c26d-18f4-4dfe-a78f-edd26ff484ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:52.524846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-48a7c26d-18f4-4dfe-a78f-edd26ff484ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047806 Apr 11 19:52:52.525437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 348/761] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:52:52.742009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8124365c-ea74-47d9-b712-54c7d780737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:52.742803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8124365c-ea74-47d9-b712-54c7d780737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:52.751701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8124365c-ea74-47d9-b712-54c7d780737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:52.752133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8124365c-ea74-47d9-b712-54c7d780737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:52.752946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8124365c-ea74-47d9-b712-54c7d780737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:52.753402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8124365c-ea74-47d9-b712-54c7d780737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:52.784960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8124365c-ea74-47d9-b712-54c7d780737e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050393 Apr 11 19:52:52.785568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 414/762] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:53.536608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3dfd5c68-a067-4a36-9b10-c131c0ffc43b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:53.537949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3dfd5c68-a067-4a36-9b10-c131c0ffc43b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:53.544581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dfd5c68-a067-4a36-9b10-c131c0ffc43b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:53.545066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dfd5c68-a067-4a36-9b10-c131c0ffc43b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:53.545870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dfd5c68-a067-4a36-9b10-c131c0ffc43b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:53.546303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dfd5c68-a067-4a36-9b10-c131c0ffc43b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:53.576676 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3dfd5c68-a067-4a36-9b10-c131c0ffc43b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044224 Apr 11 19:52:53.577276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 349/763] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:52:53.799081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2e197dd2-c071-424d-893c-571a3dc752f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:53.799908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2e197dd2-c071-424d-893c-571a3dc752f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:53.806232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e197dd2-c071-424d-893c-571a3dc752f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:53.806670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e197dd2-c071-424d-893c-571a3dc752f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:53.807450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e197dd2-c071-424d-893c-571a3dc752f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:53.807877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e197dd2-c071-424d-893c-571a3dc752f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:53.838422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2e197dd2-c071-424d-893c-571a3dc752f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Apr 11 19:52:53.839224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 415/764] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:54.588799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a355ab40-33b3-4946-8be9-aeba2754c65f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:54.589772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a355ab40-33b3-4946-8be9-aeba2754c65f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:54.597052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a355ab40-33b3-4946-8be9-aeba2754c65f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:54.597508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a355ab40-33b3-4946-8be9-aeba2754c65f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:54.598282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a355ab40-33b3-4946-8be9-aeba2754c65f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:54.598917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a355ab40-33b3-4946-8be9-aeba2754c65f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:54.631193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a355ab40-33b3-4946-8be9-aeba2754c65f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046338 Apr 11 19:52:54.631789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 350/765] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:52:54.850508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d293f6c0-8604-4606-aa27-ecc57ede8ab4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:54.851508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d293f6c0-8604-4606-aa27-ecc57ede8ab4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:54.858192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d293f6c0-8604-4606-aa27-ecc57ede8ab4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:54.858632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d293f6c0-8604-4606-aa27-ecc57ede8ab4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:54.859376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d293f6c0-8604-4606-aa27-ecc57ede8ab4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:54.859799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d293f6c0-8604-4606-aa27-ecc57ede8ab4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:54.892249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d293f6c0-8604-4606-aa27-ecc57ede8ab4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045672 Apr 11 19:52:54.892809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 416/766] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:55.771284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d73f0b50-8277-40ae-a4ec-39f09e5cfe85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:55.772210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d73f0b50-8277-40ae-a4ec-39f09e5cfe85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:55.778258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73f0b50-8277-40ae-a4ec-39f09e5cfe85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:55.778792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73f0b50-8277-40ae-a4ec-39f09e5cfe85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:55.779537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73f0b50-8277-40ae-a4ec-39f09e5cfe85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:55.779993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73f0b50-8277-40ae-a4ec-39f09e5cfe85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:55.810926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d73f0b50-8277-40ae-a4ec-39f09e5cfe85 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.170531 Apr 11 19:52:55.811481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 351/767] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:52:55.904196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd6c488e-0865-44ce-9307-6a3671a33ef8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:55.905175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd6c488e-0865-44ce-9307-6a3671a33ef8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:55.912466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd6c488e-0865-44ce-9307-6a3671a33ef8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:55.912995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd6c488e-0865-44ce-9307-6a3671a33ef8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:55.913715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd6c488e-0865-44ce-9307-6a3671a33ef8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:55.914143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd6c488e-0865-44ce-9307-6a3671a33ef8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:55.946927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd6c488e-0865-44ce-9307-6a3671a33ef8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046656 Apr 11 19:52:55.947511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 417/768] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:56.824471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-379e3492-cb0e-4c29-9c6e-107e78ce2ee5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:56.825706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-379e3492-cb0e-4c29-9c6e-107e78ce2ee5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:56.832498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-379e3492-cb0e-4c29-9c6e-107e78ce2ee5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:56.832982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-379e3492-cb0e-4c29-9c6e-107e78ce2ee5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:56.833771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-379e3492-cb0e-4c29-9c6e-107e78ce2ee5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:56.834205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-379e3492-cb0e-4c29-9c6e-107e78ce2ee5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:56.864421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-379e3492-cb0e-4c29-9c6e-107e78ce2ee5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045134 Apr 11 19:52:56.865027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 352/769] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:52:56.960255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15dc7b40-80ef-40c5-9cd9-cd837aff9221 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:56.961222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15dc7b40-80ef-40c5-9cd9-cd837aff9221 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:56.968945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15dc7b40-80ef-40c5-9cd9-cd837aff9221 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:56.969401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15dc7b40-80ef-40c5-9cd9-cd837aff9221 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:56.970169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15dc7b40-80ef-40c5-9cd9-cd837aff9221 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:56.970594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15dc7b40-80ef-40c5-9cd9-cd837aff9221 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:57.007950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15dc7b40-80ef-40c5-9cd9-cd837aff9221 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051608 Apr 11 19:52:57.008428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 418/770] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:57.876374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-57dbf369-e4d4-45a7-ab87-61bb71384b14 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:57.877331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57dbf369-e4d4-45a7-ab87-61bb71384b14 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:57.884270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57dbf369-e4d4-45a7-ab87-61bb71384b14 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:57.884724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57dbf369-e4d4-45a7-ab87-61bb71384b14 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:57.885531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57dbf369-e4d4-45a7-ab87-61bb71384b14 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:57.885967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57dbf369-e4d4-45a7-ab87-61bb71384b14 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:57.917028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-57dbf369-e4d4-45a7-ab87-61bb71384b14 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044771 Apr 11 19:52:57.917507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 353/771] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:52:58.021421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-500d2818-bdfd-4bd3-bbed-5e8f8f60ec83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:58.022418 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-500d2818-bdfd-4bd3-bbed-5e8f8f60ec83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:58.029356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-500d2818-bdfd-4bd3-bbed-5e8f8f60ec83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:58.029803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-500d2818-bdfd-4bd3-bbed-5e8f8f60ec83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:58.030578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-500d2818-bdfd-4bd3-bbed-5e8f8f60ec83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:58.031006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-500d2818-bdfd-4bd3-bbed-5e8f8f60ec83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:58.068849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-500d2818-bdfd-4bd3-bbed-5e8f8f60ec83 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051406 Apr 11 19:52:58.069455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 419/772] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:58.932001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-24439a0c-e13b-42b6-b1b0-a9c3ffb7ce18 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:58.933392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-24439a0c-e13b-42b6-b1b0-a9c3ffb7ce18 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:58.941437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24439a0c-e13b-42b6-b1b0-a9c3ffb7ce18 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:58.941980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24439a0c-e13b-42b6-b1b0-a9c3ffb7ce18 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:58.942801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24439a0c-e13b-42b6-b1b0-a9c3ffb7ce18 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:58.943374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24439a0c-e13b-42b6-b1b0-a9c3ffb7ce18 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:58.981714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-24439a0c-e13b-42b6-b1b0-a9c3ffb7ce18 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056178 Apr 11 19:52:58.982636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 354/773] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:52:59.081225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-394b42d8-da67-4def-8b49-0bfaabdca45a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:59.082274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-394b42d8-da67-4def-8b49-0bfaabdca45a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:52:59.089139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-394b42d8-da67-4def-8b49-0bfaabdca45a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:59.089583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-394b42d8-da67-4def-8b49-0bfaabdca45a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:59.090349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-394b42d8-da67-4def-8b49-0bfaabdca45a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:52:59.090776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-394b42d8-da67-4def-8b49-0bfaabdca45a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:52:59.120928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-394b42d8-da67-4def-8b49-0bfaabdca45a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043685 Apr 11 19:52:59.121414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 420/774] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:52:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:52:59.994244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-29f40068-8c61-4261-926e-c4fca026168f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:52:59.995176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-29f40068-8c61-4261-926e-c4fca026168f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:00.001968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29f40068-8c61-4261-926e-c4fca026168f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:00.002413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29f40068-8c61-4261-926e-c4fca026168f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:00.003184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29f40068-8c61-4261-926e-c4fca026168f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:00.003629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29f40068-8c61-4261-926e-c4fca026168f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:00.035155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-29f40068-8c61-4261-926e-c4fca026168f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044845 Apr 11 19:53:00.035748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 355/775] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:52:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:00.133016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1fc8008-a300-4b72-b20b-9036aab45967 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:00.133939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1fc8008-a300-4b72-b20b-9036aab45967 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:00.141808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1fc8008-a300-4b72-b20b-9036aab45967 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:00.142250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1fc8008-a300-4b72-b20b-9036aab45967 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:00.143010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1fc8008-a300-4b72-b20b-9036aab45967 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:00.143432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1fc8008-a300-4b72-b20b-9036aab45967 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:00.173974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1fc8008-a300-4b72-b20b-9036aab45967 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Apr 11 19:53:00.174544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 421/776] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:01.047825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-548edf80-a01b-4ef7-8758-18b730578c75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:01.048883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-548edf80-a01b-4ef7-8758-18b730578c75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:01.056068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-548edf80-a01b-4ef7-8758-18b730578c75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:01.056518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-548edf80-a01b-4ef7-8758-18b730578c75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:01.057332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-548edf80-a01b-4ef7-8758-18b730578c75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:01.057753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-548edf80-a01b-4ef7-8758-18b730578c75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:01.089350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-548edf80-a01b-4ef7-8758-18b730578c75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045689 Apr 11 19:53:01.089905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 356/777] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:01.187433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5f7e75ea-a389-4f39-8623-a24759c4beb1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:01.188377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5f7e75ea-a389-4f39-8623-a24759c4beb1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:01.196524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f7e75ea-a389-4f39-8623-a24759c4beb1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:01.197007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f7e75ea-a389-4f39-8623-a24759c4beb1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:01.197791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f7e75ea-a389-4f39-8623-a24759c4beb1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:01.198224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f7e75ea-a389-4f39-8623-a24759c4beb1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:01.228583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5f7e75ea-a389-4f39-8623-a24759c4beb1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Apr 11 19:53:01.229158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 422/778] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:02.090390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec2a2143-1b69-4645-bd4e-a75429dd22a3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1622476716"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:02.091017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec2a2143-1b69-4645-bd4e-a75429dd22a3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:02.099620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec2a2143-1b69-4645-bd4e-a75429dd22a3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:02.100062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec2a2143-1b69-4645-bd4e-a75429dd22a3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:02.100826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec2a2143-1b69-4645-bd4e-a75429dd22a3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:02.100993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fda09b06-d227-4c30-b4f9-6f2cde5f76ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:02.101285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec2a2143-1b69-4645-bd4e-a75429dd22a3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:02.101871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fda09b06-d227-4c30-b4f9-6f2cde5f76ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:02.108428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fda09b06-d227-4c30-b4f9-6f2cde5f76ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:02.108870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fda09b06-d227-4c30-b4f9-6f2cde5f76ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:02.109685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fda09b06-d227-4c30-b4f9-6f2cde5f76ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:02.110115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fda09b06-d227-4c30-b4f9-6f2cde5f76ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:02.142731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fda09b06-d227-4c30-b4f9-6f2cde5f76ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045689 Apr 11 19:53:02.144218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 423/779] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:02.239943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-354782bc-ac57-4be8-9ad1-e0f2942f55de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:02.240946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-354782bc-ac57-4be8-9ad1-e0f2942f55de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:02.249466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-354782bc-ac57-4be8-9ad1-e0f2942f55de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:02.250322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-354782bc-ac57-4be8-9ad1-e0f2942f55de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:02.252796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-354782bc-ac57-4be8-9ad1-e0f2942f55de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:02.253572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-354782bc-ac57-4be8-9ad1-e0f2942f55de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:02.284238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-354782bc-ac57-4be8-9ad1-e0f2942f55de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048220 Apr 11 19:53:02.284816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 424/780] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:02.314069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.network.security_group_api [None req-ec2a2143-1b69-4645-bd4e-a75429dd22a3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Removing security group 8fa812fa-176b-4d53-9cb6-10a0bf30b377 from port 6932f8ee-b8ec-4779-99f0-59715534dce0 Apr 11 19:53:02.692745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec2a2143-1b69-4645-bd4e-a75429dd22a3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/action" status: 202 len: 0 microversion: 2.1 time: 0.607764 Apr 11 19:53:02.693851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 357/781] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 19:53:02 2022] POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:53:02.707371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-e906b849-0100-4796-9986-a392f1dbded5 req-faa36935-c84e-4052-93c1-452022e01bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f85f237-46f1-47d2-badc-2e3cffe85c90", "tag": "6932f8ee-b8ec-4779-99f0-59715534dce0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:02.726223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-e906b849-0100-4796-9986-a392f1dbded5 req-faa36935-c84e-4052-93c1-452022e01bb1 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:02.726658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-e906b849-0100-4796-9986-a392f1dbded5 req-faa36935-c84e-4052-93c1-452022e01bb1 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:02.757878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-e906b849-0100-4796-9986-a392f1dbded5 req-faa36935-c84e-4052-93c1-452022e01bb1 service nova] Creating event network-changed:6932f8ee-b8ec-4779-99f0-59715534dce0 for instance 4f85f237-46f1-47d2-badc-2e3cffe85c90 on hv-cinder-83078 Apr 11 19:53:02.775327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-e906b849-0100-4796-9986-a392f1dbded5 req-faa36935-c84e-4052-93c1-452022e01bb1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072563 Apr 11 19:53:02.781369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 425/782] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:03.156366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95c7a7f7-b680-4ab2-a3ca-d2f989b864db tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:03.157375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95c7a7f7-b680-4ab2-a3ca-d2f989b864db tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:03.171991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c7a7f7-b680-4ab2-a3ca-d2f989b864db tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:03.172442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c7a7f7-b680-4ab2-a3ca-d2f989b864db tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:03.173276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c7a7f7-b680-4ab2-a3ca-d2f989b864db tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:03.173713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c7a7f7-b680-4ab2-a3ca-d2f989b864db tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:03.216133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95c7a7f7-b680-4ab2-a3ca-d2f989b864db tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064931 Apr 11 19:53:03.217824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 358/783] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:03.297322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-003d49af-cba7-4e05-8066-393a8b8f4323 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:03.298579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-003d49af-cba7-4e05-8066-393a8b8f4323 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:03.305614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003d49af-cba7-4e05-8066-393a8b8f4323 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:03.306240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003d49af-cba7-4e05-8066-393a8b8f4323 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:03.309725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003d49af-cba7-4e05-8066-393a8b8f4323 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:03.309725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003d49af-cba7-4e05-8066-393a8b8f4323 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:03.349655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-003d49af-cba7-4e05-8066-393a8b8f4323 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057527 Apr 11 19:53:03.353708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 426/784] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:03.454703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:53:03.455031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 19:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 19:53:04.179027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02ca7d0b-a7e4-4a82-8627-698ef9076ce3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:04.179763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02ca7d0b-a7e4-4a82-8627-698ef9076ce3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:04.188571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02ca7d0b-a7e4-4a82-8627-698ef9076ce3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.189537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02ca7d0b-a7e4-4a82-8627-698ef9076ce3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.190799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02ca7d0b-a7e4-4a82-8627-698ef9076ce3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.191750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02ca7d0b-a7e4-4a82-8627-698ef9076ce3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.234483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a192f0b8-6917-49ec-87b8-d1fadca4e2a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:04.236142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a192f0b8-6917-49ec-87b8-d1fadca4e2a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:04.241925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a192f0b8-6917-49ec-87b8-d1fadca4e2a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.242369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a192f0b8-6917-49ec-87b8-d1fadca4e2a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.243139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a192f0b8-6917-49ec-87b8-d1fadca4e2a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.243569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a192f0b8-6917-49ec-87b8-d1fadca4e2a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.283066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a192f0b8-6917-49ec-87b8-d1fadca4e2a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054233 Apr 11 19:53:04.283637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 427/785] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:04.361963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5d9fabe3-f76f-47a6-b95a-d2003dd13e77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:04.362966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5d9fabe3-f76f-47a6-b95a-d2003dd13e77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:04.370173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d9fabe3-f76f-47a6-b95a-d2003dd13e77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.371084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d9fabe3-f76f-47a6-b95a-d2003dd13e77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.371874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-02ca7d0b-a7e4-4a82-8627-698ef9076ce3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lazy-loading 'services' on Instance uuid 4f85f237-46f1-47d2-badc-2e3cffe85c90 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:53:04.372563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d9fabe3-f76f-47a6-b95a-d2003dd13e77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.373208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d9fabe3-f76f-47a6-b95a-d2003dd13e77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.413334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5d9fabe3-f76f-47a6-b95a-d2003dd13e77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055307 Apr 11 19:53:04.417405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 428/786] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:04.518447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02ca7d0b-a7e4-4a82-8627-698ef9076ce3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b" status: 202 len: 0 microversion: 2.1 time: 0.342739 Apr 11 19:53:04.526143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 359/787] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 19:53:04 2022] DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 19:53:04.527892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-62f923ec-0427-41c0-b6c9-22f14f81cf95 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:04.529204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-62f923ec-0427-41c0-b6c9-22f14f81cf95 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:04.536397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62f923ec-0427-41c0-b6c9-22f14f81cf95 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.537098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62f923ec-0427-41c0-b6c9-22f14f81cf95 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.538296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62f923ec-0427-41c0-b6c9-22f14f81cf95 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.539194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62f923ec-0427-41c0-b6c9-22f14f81cf95 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.572101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-62f923ec-0427-41c0-b6c9-22f14f81cf95 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048371 Apr 11 19:53:04.576056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 429/788] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:53:04.792785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-ff08ed95-3af1-44e6-8dab-a31b4adfe7c9 req-0260c2b0-f394-4174-a008-5d8685859ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f85f237-46f1-47d2-badc-2e3cffe85c90", "tag": "6932f8ee-b8ec-4779-99f0-59715534dce0"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:53:04.801601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ff08ed95-3af1-44e6-8dab-a31b4adfe7c9 req-0260c2b0-f394-4174-a008-5d8685859ded service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:04.802054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ff08ed95-3af1-44e6-8dab-a31b4adfe7c9 req-0260c2b0-f394-4174-a008-5d8685859ded service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:04.813651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-ff08ed95-3af1-44e6-8dab-a31b4adfe7c9 req-0260c2b0-f394-4174-a008-5d8685859ded service nova] Creating event network-changed:6932f8ee-b8ec-4779-99f0-59715534dce0 for instance 4f85f237-46f1-47d2-badc-2e3cffe85c90 on hv-cinder-83078 Apr 11 19:53:04.818575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-ff08ed95-3af1-44e6-8dab-a31b4adfe7c9 req-0260c2b0-f394-4174-a008-5d8685859ded service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030116 Apr 11 19:53:04.819167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 360/789] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:05.295205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f7ba0eaf-3d06-4e34-9366-6d4a23d90930 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:05.296223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f7ba0eaf-3d06-4e34-9366-6d4a23d90930 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:05.302485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7ba0eaf-3d06-4e34-9366-6d4a23d90930 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:05.303018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7ba0eaf-3d06-4e34-9366-6d4a23d90930 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:05.303820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7ba0eaf-3d06-4e34-9366-6d4a23d90930 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:05.304237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7ba0eaf-3d06-4e34-9366-6d4a23d90930 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:05.339156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f7ba0eaf-3d06-4e34-9366-6d4a23d90930 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048307 Apr 11 19:53:05.343641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 430/790] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:05.426905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-60875bc1-cb01-41c4-a8fe-e388f4c9950f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:05.428020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-60875bc1-cb01-41c4-a8fe-e388f4c9950f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:05.434451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60875bc1-cb01-41c4-a8fe-e388f4c9950f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:05.434954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60875bc1-cb01-41c4-a8fe-e388f4c9950f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:05.435760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60875bc1-cb01-41c4-a8fe-e388f4c9950f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:05.436181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60875bc1-cb01-41c4-a8fe-e388f4c9950f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:05.466867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-60875bc1-cb01-41c4-a8fe-e388f4c9950f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045163 Apr 11 19:53:05.467467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 361/791] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:53:05.588746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4968ca8a-1f9f-4b11-a29b-f177d21be0b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:05.590089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4968ca8a-1f9f-4b11-a29b-f177d21be0b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:05.597234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4968ca8a-1f9f-4b11-a29b-f177d21be0b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:05.597703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4968ca8a-1f9f-4b11-a29b-f177d21be0b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:05.598600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4968ca8a-1f9f-4b11-a29b-f177d21be0b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:05.598913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4968ca8a-1f9f-4b11-a29b-f177d21be0b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:05.629596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4968ca8a-1f9f-4b11-a29b-f177d21be0b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047891 Apr 11 19:53:05.630173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 431/792] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:06.351560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e65d0e70-d35f-4fa0-8b13-65841ae254fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:06.352516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e65d0e70-d35f-4fa0-8b13-65841ae254fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:06.359418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e65d0e70-d35f-4fa0-8b13-65841ae254fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:06.359867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e65d0e70-d35f-4fa0-8b13-65841ae254fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:06.360620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e65d0e70-d35f-4fa0-8b13-65841ae254fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:06.361082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e65d0e70-d35f-4fa0-8b13-65841ae254fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:06.393974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e65d0e70-d35f-4fa0-8b13-65841ae254fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046332 Apr 11 19:53:06.394714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 362/793] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:06.480229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e9e7cd05-4f73-4fb0-8680-604bd0f3daa4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:06.481208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e9e7cd05-4f73-4fb0-8680-604bd0f3daa4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:06.487431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9e7cd05-4f73-4fb0-8680-604bd0f3daa4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:06.487882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9e7cd05-4f73-4fb0-8680-604bd0f3daa4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:06.488647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9e7cd05-4f73-4fb0-8680-604bd0f3daa4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:06.489126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9e7cd05-4f73-4fb0-8680-604bd0f3daa4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:06.522119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e9e7cd05-4f73-4fb0-8680-604bd0f3daa4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046595 Apr 11 19:53:06.522684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 432/794] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:06.642921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53c711ba-353b-4e2e-8c19-7495ddb7780d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:06.643902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53c711ba-353b-4e2e-8c19-7495ddb7780d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:06.651360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53c711ba-353b-4e2e-8c19-7495ddb7780d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:06.651803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53c711ba-353b-4e2e-8c19-7495ddb7780d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:06.652592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53c711ba-353b-4e2e-8c19-7495ddb7780d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:06.653065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53c711ba-353b-4e2e-8c19-7495ddb7780d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:06.682351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53c711ba-353b-4e2e-8c19-7495ddb7780d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Apr 11 19:53:06.682930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 363/795] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:07.406192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-be319869-72f1-43c7-ac65-2b6c3c0c4c17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:07.407114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-be319869-72f1-43c7-ac65-2b6c3c0c4c17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:07.413964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be319869-72f1-43c7-ac65-2b6c3c0c4c17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:07.414420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be319869-72f1-43c7-ac65-2b6c3c0c4c17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:07.415202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be319869-72f1-43c7-ac65-2b6c3c0c4c17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:07.415635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be319869-72f1-43c7-ac65-2b6c3c0c4c17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:07.446412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-be319869-72f1-43c7-ac65-2b6c3c0c4c17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044064 Apr 11 19:53:07.446870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 433/796] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:07.534376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56fffb34-0cf8-4bc2-90c8-d022dda92e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:07.535351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56fffb34-0cf8-4bc2-90c8-d022dda92e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:07.544391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56fffb34-0cf8-4bc2-90c8-d022dda92e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:07.545102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56fffb34-0cf8-4bc2-90c8-d022dda92e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:07.545872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56fffb34-0cf8-4bc2-90c8-d022dda92e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:07.546305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56fffb34-0cf8-4bc2-90c8-d022dda92e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:07.575339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56fffb34-0cf8-4bc2-90c8-d022dda92e98 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Apr 11 19:53:07.575943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 364/797] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:07.694888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3eb73ba8-eeb7-41a8-9705-b05266b48b85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:07.695807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3eb73ba8-eeb7-41a8-9705-b05266b48b85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:07.704078 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3eb73ba8-eeb7-41a8-9705-b05266b48b85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:07.704452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3eb73ba8-eeb7-41a8-9705-b05266b48b85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:07.705572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3eb73ba8-eeb7-41a8-9705-b05266b48b85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:07.706128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3eb73ba8-eeb7-41a8-9705-b05266b48b85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:07.739121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3eb73ba8-eeb7-41a8-9705-b05266b48b85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049287 Apr 11 19:53:07.739688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 434/798] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:08.458536 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c4e2f130-1940-4e42-9182-f0d8b5e196e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:08.459459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c4e2f130-1940-4e42-9182-f0d8b5e196e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:08.466195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4e2f130-1940-4e42-9182-f0d8b5e196e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:08.466721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4e2f130-1940-4e42-9182-f0d8b5e196e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:08.467493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4e2f130-1940-4e42-9182-f0d8b5e196e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:08.467929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4e2f130-1940-4e42-9182-f0d8b5e196e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:08.496872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c4e2f130-1940-4e42-9182-f0d8b5e196e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042333 Apr 11 19:53:08.497519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 365/799] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:08.588026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-43ce4ab1-a487-481a-b3bc-14e90e488060 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:08.589060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-43ce4ab1-a487-481a-b3bc-14e90e488060 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:08.596312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43ce4ab1-a487-481a-b3bc-14e90e488060 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:08.597051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43ce4ab1-a487-481a-b3bc-14e90e488060 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:08.597823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43ce4ab1-a487-481a-b3bc-14e90e488060 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:08.598284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43ce4ab1-a487-481a-b3bc-14e90e488060 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:08.633047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-43ce4ab1-a487-481a-b3bc-14e90e488060 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048892 Apr 11 19:53:08.633610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 435/800] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:08.756768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb0165bb-178a-484b-8caf-0739402f40ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:08.758152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb0165bb-178a-484b-8caf-0739402f40ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:08.766621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb0165bb-178a-484b-8caf-0739402f40ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:08.767062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb0165bb-178a-484b-8caf-0739402f40ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:08.767822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb0165bb-178a-484b-8caf-0739402f40ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:08.768893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb0165bb-178a-484b-8caf-0739402f40ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:08.803665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb0165bb-178a-484b-8caf-0739402f40ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054017 Apr 11 19:53:08.804221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 366/801] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:09.512098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-04e4df73-adeb-4d37-81ac-1df7f40e7ed0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:09.513619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-04e4df73-adeb-4d37-81ac-1df7f40e7ed0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:09.520094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04e4df73-adeb-4d37-81ac-1df7f40e7ed0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:09.520542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04e4df73-adeb-4d37-81ac-1df7f40e7ed0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:09.521357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04e4df73-adeb-4d37-81ac-1df7f40e7ed0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:09.521785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04e4df73-adeb-4d37-81ac-1df7f40e7ed0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:09.551958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-04e4df73-adeb-4d37-81ac-1df7f40e7ed0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045618 Apr 11 19:53:09.552564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 436/802] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:09.646402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-314da9dc-fc2e-4c8f-8ac2-099ac3ee2c10 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:09.647325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-314da9dc-fc2e-4c8f-8ac2-099ac3ee2c10 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:09.654072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-314da9dc-fc2e-4c8f-8ac2-099ac3ee2c10 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:09.654669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-314da9dc-fc2e-4c8f-8ac2-099ac3ee2c10 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:09.655469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-314da9dc-fc2e-4c8f-8ac2-099ac3ee2c10 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:09.655893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-314da9dc-fc2e-4c8f-8ac2-099ac3ee2c10 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:09.687541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-314da9dc-fc2e-4c8f-8ac2-099ac3ee2c10 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045097 Apr 11 19:53:09.688075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 367/803] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:09.816830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-35784ed2-ec19-4311-b95d-21a290a676d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:09.817856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-35784ed2-ec19-4311-b95d-21a290a676d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:09.825920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35784ed2-ec19-4311-b95d-21a290a676d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:09.826387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35784ed2-ec19-4311-b95d-21a290a676d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:09.827188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35784ed2-ec19-4311-b95d-21a290a676d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:09.827620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35784ed2-ec19-4311-b95d-21a290a676d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:09.855944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-35784ed2-ec19-4311-b95d-21a290a676d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Apr 11 19:53:09.856482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 437/804] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:10.568110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f900bfc-64c6-4967-9ff4-068cc0c05cf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:10.569591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f900bfc-64c6-4967-9ff4-068cc0c05cf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:10.578420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f900bfc-64c6-4967-9ff4-068cc0c05cf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:10.578865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f900bfc-64c6-4967-9ff4-068cc0c05cf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:10.579614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f900bfc-64c6-4967-9ff4-068cc0c05cf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:10.580045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f900bfc-64c6-4967-9ff4-068cc0c05cf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:10.700037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac3ad426-c93a-4452-90dd-36bef2fe1ddc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:10.701021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac3ad426-c93a-4452-90dd-36bef2fe1ddc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:10.710584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac3ad426-c93a-4452-90dd-36bef2fe1ddc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:10.711029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac3ad426-c93a-4452-90dd-36bef2fe1ddc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:10.711816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac3ad426-c93a-4452-90dd-36bef2fe1ddc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:10.712251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac3ad426-c93a-4452-90dd-36bef2fe1ddc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:10.749179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac3ad426-c93a-4452-90dd-36bef2fe1ddc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053484 Apr 11 19:53:10.749774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 438/805] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:10.772267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f900bfc-64c6-4967-9ff4-068cc0c05cf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.210629 Apr 11 19:53:10.772968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 368/806] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:10.867415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7ba2e8c7-d828-4174-8e8a-f9811ec146a0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:10.868348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7ba2e8c7-d828-4174-8e8a-f9811ec146a0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:10.875620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ba2e8c7-d828-4174-8e8a-f9811ec146a0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:10.876055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ba2e8c7-d828-4174-8e8a-f9811ec146a0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:10.877000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ba2e8c7-d828-4174-8e8a-f9811ec146a0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:10.877437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ba2e8c7-d828-4174-8e8a-f9811ec146a0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:10.906213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7ba2e8c7-d828-4174-8e8a-f9811ec146a0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Apr 11 19:53:10.906774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 439/807] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:11.763273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b012ccb-8d07-4470-a7fb-ef78da26af25 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:11.764206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b012ccb-8d07-4470-a7fb-ef78da26af25 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:11.770880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b012ccb-8d07-4470-a7fb-ef78da26af25 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:11.771323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b012ccb-8d07-4470-a7fb-ef78da26af25 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:11.772084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b012ccb-8d07-4470-a7fb-ef78da26af25 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:11.772519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b012ccb-8d07-4470-a7fb-ef78da26af25 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:11.783868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2e5abb9d-e682-433d-bd28-30829cc659c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:11.784944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2e5abb9d-e682-433d-bd28-30829cc659c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:11.791338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e5abb9d-e682-433d-bd28-30829cc659c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:11.791785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e5abb9d-e682-433d-bd28-30829cc659c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:11.792552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e5abb9d-e682-433d-bd28-30829cc659c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:11.793017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e5abb9d-e682-433d-bd28-30829cc659c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:11.802997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b012ccb-8d07-4470-a7fb-ef78da26af25 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043634 Apr 11 19:53:11.803560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 369/808] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:11.822710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2e5abb9d-e682-433d-bd28-30829cc659c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042770 Apr 11 19:53:11.823263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 440/809] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:11.921637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c6a08c1-4c1b-4046-a66f-7f6ede147725 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:11.922574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c6a08c1-4c1b-4046-a66f-7f6ede147725 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:11.929141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c6a08c1-4c1b-4046-a66f-7f6ede147725 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:11.929593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c6a08c1-4c1b-4046-a66f-7f6ede147725 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:11.930360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c6a08c1-4c1b-4046-a66f-7f6ede147725 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:11.931099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c6a08c1-4c1b-4046-a66f-7f6ede147725 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:11.962592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c6a08c1-4c1b-4046-a66f-7f6ede147725 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Apr 11 19:53:11.963052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 370/810] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:12.814869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c7734ca-ffa6-40e1-9caa-c9d06c0502ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:12.815787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c7734ca-ffa6-40e1-9caa-c9d06c0502ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:12.822501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c7734ca-ffa6-40e1-9caa-c9d06c0502ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:12.822938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c7734ca-ffa6-40e1-9caa-c9d06c0502ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:12.823692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c7734ca-ffa6-40e1-9caa-c9d06c0502ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:12.824099 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c7734ca-ffa6-40e1-9caa-c9d06c0502ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:12.834509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b225bd7-2ef1-4b14-a863-8513bd54a9bd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:12.835417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b225bd7-2ef1-4b14-a863-8513bd54a9bd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:12.842160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b225bd7-2ef1-4b14-a863-8513bd54a9bd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:12.842707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b225bd7-2ef1-4b14-a863-8513bd54a9bd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:12.843500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b225bd7-2ef1-4b14-a863-8513bd54a9bd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:12.843928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b225bd7-2ef1-4b14-a863-8513bd54a9bd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:12.853910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c7734ca-ffa6-40e1-9caa-c9d06c0502ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Apr 11 19:53:12.854499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 441/811] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:53:12.874420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b225bd7-2ef1-4b14-a863-8513bd54a9bd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043722 Apr 11 19:53:12.875498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 371/812] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:53:12.977037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f22b89d-bb84-4a96-89b0-3a8edd78d7ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:12.978087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f22b89d-bb84-4a96-89b0-3a8edd78d7ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:12.987616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f22b89d-bb84-4a96-89b0-3a8edd78d7ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:12.988204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f22b89d-bb84-4a96-89b0-3a8edd78d7ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:12.989445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f22b89d-bb84-4a96-89b0-3a8edd78d7ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:12.990073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f22b89d-bb84-4a96-89b0-3a8edd78d7ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:13.021983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f22b89d-bb84-4a96-89b0-3a8edd78d7ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051064 Apr 11 19:53:13.022445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 442/813] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:13.865859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3803f157-8315-46de-8f9e-b56724eacb51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:13.866782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3803f157-8315-46de-8f9e-b56724eacb51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:13.873910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3803f157-8315-46de-8f9e-b56724eacb51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:13.874361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3803f157-8315-46de-8f9e-b56724eacb51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:13.875483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3803f157-8315-46de-8f9e-b56724eacb51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:13.875915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3803f157-8315-46de-8f9e-b56724eacb51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:13.889690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9bc35d3-700b-48a0-bb3b-5f4acd4baa00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:13.889690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9bc35d3-700b-48a0-bb3b-5f4acd4baa00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:13.895081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9bc35d3-700b-48a0-bb3b-5f4acd4baa00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:13.895528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9bc35d3-700b-48a0-bb3b-5f4acd4baa00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:13.896293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9bc35d3-700b-48a0-bb3b-5f4acd4baa00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:13.896719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9bc35d3-700b-48a0-bb3b-5f4acd4baa00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:13.906256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3803f157-8315-46de-8f9e-b56724eacb51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Apr 11 19:53:13.906926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 372/814] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:13.926853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9bc35d3-700b-48a0-bb3b-5f4acd4baa00 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043736 Apr 11 19:53:13.927399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 443/815] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:14.033979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dedb4889-69ce-49e2-a12e-8038ba67f914 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:14.034949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dedb4889-69ce-49e2-a12e-8038ba67f914 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:14.041510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dedb4889-69ce-49e2-a12e-8038ba67f914 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:14.041955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dedb4889-69ce-49e2-a12e-8038ba67f914 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:14.042726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dedb4889-69ce-49e2-a12e-8038ba67f914 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:14.043163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dedb4889-69ce-49e2-a12e-8038ba67f914 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:14.072766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dedb4889-69ce-49e2-a12e-8038ba67f914 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 Apr 11 19:53:14.073323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 373/816] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:14.918131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4d10bb20-b50e-4dbf-bc5a-85fc45246cf9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:14.919047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4d10bb20-b50e-4dbf-bc5a-85fc45246cf9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:14.933599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d10bb20-b50e-4dbf-bc5a-85fc45246cf9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:14.934073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d10bb20-b50e-4dbf-bc5a-85fc45246cf9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:14.934840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d10bb20-b50e-4dbf-bc5a-85fc45246cf9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:14.935231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d10bb20-b50e-4dbf-bc5a-85fc45246cf9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:14.939364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-034bd09c-a31a-4e17-a8df-45563db6cd84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:14.940294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-034bd09c-a31a-4e17-a8df-45563db6cd84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:14.946795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-034bd09c-a31a-4e17-a8df-45563db6cd84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:14.947246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-034bd09c-a31a-4e17-a8df-45563db6cd84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:14.948014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-034bd09c-a31a-4e17-a8df-45563db6cd84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:14.948478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-034bd09c-a31a-4e17-a8df-45563db6cd84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:14.964028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4d10bb20-b50e-4dbf-bc5a-85fc45246cf9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049760 Apr 11 19:53:14.964817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 444/817] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:14.977413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-034bd09c-a31a-4e17-a8df-45563db6cd84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042531 Apr 11 19:53:14.977966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 374/818] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:53:15.088307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9960f6e5-167b-464f-aada-7350866f328f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:15.089834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9960f6e5-167b-464f-aada-7350866f328f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:15.096797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9960f6e5-167b-464f-aada-7350866f328f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:15.097274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9960f6e5-167b-464f-aada-7350866f328f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:15.098028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9960f6e5-167b-464f-aada-7350866f328f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:15.098460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9960f6e5-167b-464f-aada-7350866f328f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:15.127550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9960f6e5-167b-464f-aada-7350866f328f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045533 Apr 11 19:53:15.128016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 445/819] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:15.975910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c6ae8112-3063-47a7-bfb3-7533d08d8c7c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:15.976936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c6ae8112-3063-47a7-bfb3-7533d08d8c7c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:15.985613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6ae8112-3063-47a7-bfb3-7533d08d8c7c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:15.986066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6ae8112-3063-47a7-bfb3-7533d08d8c7c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:15.986837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6ae8112-3063-47a7-bfb3-7533d08d8c7c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:15.987269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6ae8112-3063-47a7-bfb3-7533d08d8c7c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:15.989619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9bd0d794-a46e-4903-b8a0-6dba5108a5d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:15.992207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9bd0d794-a46e-4903-b8a0-6dba5108a5d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:15.997482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bd0d794-a46e-4903-b8a0-6dba5108a5d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:15.997934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bd0d794-a46e-4903-b8a0-6dba5108a5d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:15.998706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bd0d794-a46e-4903-b8a0-6dba5108a5d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:15.999135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bd0d794-a46e-4903-b8a0-6dba5108a5d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:16.016809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c6ae8112-3063-47a7-bfb3-7533d08d8c7c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044963 Apr 11 19:53:16.017416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 375/820] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:16.028853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9bd0d794-a46e-4903-b8a0-6dba5108a5d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043410 Apr 11 19:53:16.029436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 446/821] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:16.143453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4e13dd4c-3ad1-432c-8506-e32a6c07b995 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:16.145103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4e13dd4c-3ad1-432c-8506-e32a6c07b995 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:16.154769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e13dd4c-3ad1-432c-8506-e32a6c07b995 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:16.155196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e13dd4c-3ad1-432c-8506-e32a6c07b995 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:16.155959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e13dd4c-3ad1-432c-8506-e32a6c07b995 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:16.156390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e13dd4c-3ad1-432c-8506-e32a6c07b995 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:16.185426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4e13dd4c-3ad1-432c-8506-e32a6c07b995 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048319 Apr 11 19:53:16.185911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 376/822] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:17.028331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6ba2aec-3783-4767-bbd2-0e94bbc03815 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:17.029316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6ba2aec-3783-4767-bbd2-0e94bbc03815 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:17.035803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6ba2aec-3783-4767-bbd2-0e94bbc03815 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:17.036257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6ba2aec-3783-4767-bbd2-0e94bbc03815 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:17.037056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6ba2aec-3783-4767-bbd2-0e94bbc03815 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:17.037487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6ba2aec-3783-4767-bbd2-0e94bbc03815 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:17.040243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dad4eceb-367b-4834-a13f-c176de587650 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:17.041174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dad4eceb-367b-4834-a13f-c176de587650 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:17.048165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dad4eceb-367b-4834-a13f-c176de587650 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:17.048600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dad4eceb-367b-4834-a13f-c176de587650 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:17.049434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dad4eceb-367b-4834-a13f-c176de587650 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:17.049859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dad4eceb-367b-4834-a13f-c176de587650 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:17.075909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6ba2aec-3783-4767-bbd2-0e94bbc03815 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051327 Apr 11 19:53:17.076467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 447/823] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:17.080515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dad4eceb-367b-4834-a13f-c176de587650 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044586 Apr 11 19:53:17.081229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 377/824] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:17.200985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f93c004-57e4-4a5d-a61f-5356a1f88684 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:17.201924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f93c004-57e4-4a5d-a61f-5356a1f88684 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:17.208311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f93c004-57e4-4a5d-a61f-5356a1f88684 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:17.208756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f93c004-57e4-4a5d-a61f-5356a1f88684 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:17.209570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f93c004-57e4-4a5d-a61f-5356a1f88684 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:17.210000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f93c004-57e4-4a5d-a61f-5356a1f88684 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:17.238922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f93c004-57e4-4a5d-a61f-5356a1f88684 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Apr 11 19:53:17.239391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 448/825] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:18.088761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c08a104-6323-4e15-8904-1f5db77c1475 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:18.089758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4c08a104-6323-4e15-8904-1f5db77c1475 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:18.093086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-603ab10c-b676-4686-bcee-28eeeade2e49 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:18.094168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-603ab10c-b676-4686-bcee-28eeeade2e49 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:18.096159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c08a104-6323-4e15-8904-1f5db77c1475 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:18.096605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c08a104-6323-4e15-8904-1f5db77c1475 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:18.097386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c08a104-6323-4e15-8904-1f5db77c1475 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:18.098001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c08a104-6323-4e15-8904-1f5db77c1475 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:18.109711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-603ab10c-b676-4686-bcee-28eeeade2e49 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:18.109711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-603ab10c-b676-4686-bcee-28eeeade2e49 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:18.109711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-603ab10c-b676-4686-bcee-28eeeade2e49 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:18.109711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-603ab10c-b676-4686-bcee-28eeeade2e49 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:18.129773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c08a104-6323-4e15-8904-1f5db77c1475 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Apr 11 19:53:18.130507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 378/826] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:18.135063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-603ab10c-b676-4686-bcee-28eeeade2e49 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046962 Apr 11 19:53:18.135608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 449/827] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:53:18.254142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-420bc25e-53d0-4b57-aa68-b2f7cb237d8c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:18.255699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-420bc25e-53d0-4b57-aa68-b2f7cb237d8c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:18.264940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-420bc25e-53d0-4b57-aa68-b2f7cb237d8c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:18.265405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-420bc25e-53d0-4b57-aa68-b2f7cb237d8c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:18.266609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-420bc25e-53d0-4b57-aa68-b2f7cb237d8c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:18.266609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-420bc25e-53d0-4b57-aa68-b2f7cb237d8c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:18.294861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-420bc25e-53d0-4b57-aa68-b2f7cb237d8c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047656 Apr 11 19:53:18.295394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 379/828] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:19.141940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1439907d-47d0-4aab-8687-39ee66ccec19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:19.142868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1439907d-47d0-4aab-8687-39ee66ccec19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:19.146839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3307d754-ee8c-4654-8d53-8b40a61c1347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:19.148281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3307d754-ee8c-4654-8d53-8b40a61c1347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:19.149019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1439907d-47d0-4aab-8687-39ee66ccec19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:19.149475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1439907d-47d0-4aab-8687-39ee66ccec19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:19.150239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1439907d-47d0-4aab-8687-39ee66ccec19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:19.150676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1439907d-47d0-4aab-8687-39ee66ccec19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:19.154749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3307d754-ee8c-4654-8d53-8b40a61c1347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:19.155208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3307d754-ee8c-4654-8d53-8b40a61c1347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:19.155977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3307d754-ee8c-4654-8d53-8b40a61c1347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:19.156432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3307d754-ee8c-4654-8d53-8b40a61c1347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:19.181250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1439907d-47d0-4aab-8687-39ee66ccec19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Apr 11 19:53:19.182019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 450/829] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:19.188010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3307d754-ee8c-4654-8d53-8b40a61c1347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045102 Apr 11 19:53:19.193818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 380/830] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:19.310595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e26657a1-fa0e-44c1-9a53-19c212acbde9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:19.311505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e26657a1-fa0e-44c1-9a53-19c212acbde9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:19.318197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e26657a1-fa0e-44c1-9a53-19c212acbde9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:19.318639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e26657a1-fa0e-44c1-9a53-19c212acbde9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:19.319402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e26657a1-fa0e-44c1-9a53-19c212acbde9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:19.319822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e26657a1-fa0e-44c1-9a53-19c212acbde9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:19.350310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e26657a1-fa0e-44c1-9a53-19c212acbde9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Apr 11 19:53:19.350900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 451/831] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:20.193215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f6d9bc65-7261-46c7-9947-aadc16e2927f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:20.194202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f6d9bc65-7261-46c7-9947-aadc16e2927f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:20.199655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c6c28037-6735-4bac-a7d1-441c351aa903 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:20.200550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c6c28037-6735-4bac-a7d1-441c351aa903 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:20.200693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6d9bc65-7261-46c7-9947-aadc16e2927f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:20.201186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6d9bc65-7261-46c7-9947-aadc16e2927f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:20.201947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6d9bc65-7261-46c7-9947-aadc16e2927f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:20.202344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6d9bc65-7261-46c7-9947-aadc16e2927f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:20.207503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6c28037-6735-4bac-a7d1-441c351aa903 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:20.208180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6c28037-6735-4bac-a7d1-441c351aa903 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:20.209181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6c28037-6735-4bac-a7d1-441c351aa903 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:20.209795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6c28037-6735-4bac-a7d1-441c351aa903 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:20.232599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f6d9bc65-7261-46c7-9947-aadc16e2927f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Apr 11 19:53:20.236479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 381/832] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:20.241137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c6c28037-6735-4bac-a7d1-441c351aa903 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045371 Apr 11 19:53:20.241660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 452/833] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:20.364199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e23fa3c-7fcc-4ef5-925b-b1c5cc47bf1e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:20.365308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e23fa3c-7fcc-4ef5-925b-b1c5cc47bf1e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:20.373105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e23fa3c-7fcc-4ef5-925b-b1c5cc47bf1e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:20.373635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e23fa3c-7fcc-4ef5-925b-b1c5cc47bf1e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:20.374524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e23fa3c-7fcc-4ef5-925b-b1c5cc47bf1e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:20.375355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e23fa3c-7fcc-4ef5-925b-b1c5cc47bf1e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:20.406520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e23fa3c-7fcc-4ef5-925b-b1c5cc47bf1e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046949 Apr 11 19:53:20.407071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 382/834] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:21.243853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-793c43e9-8ba2-4f67-9a27-97f77cc033b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:21.244816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-793c43e9-8ba2-4f67-9a27-97f77cc033b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:21.251836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-793c43e9-8ba2-4f67-9a27-97f77cc033b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:21.252014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-014df678-0167-40dc-b74d-bb813e747f44 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:21.252434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-793c43e9-8ba2-4f67-9a27-97f77cc033b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:21.253045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-014df678-0167-40dc-b74d-bb813e747f44 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:21.253209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-793c43e9-8ba2-4f67-9a27-97f77cc033b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:21.253516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-793c43e9-8ba2-4f67-9a27-97f77cc033b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:21.260316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-014df678-0167-40dc-b74d-bb813e747f44 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:21.260743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-014df678-0167-40dc-b74d-bb813e747f44 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:21.261762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-014df678-0167-40dc-b74d-bb813e747f44 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:21.261975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-014df678-0167-40dc-b74d-bb813e747f44 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:21.293543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-014df678-0167-40dc-b74d-bb813e747f44 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045715 Apr 11 19:53:21.294340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 383/835] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:21.294497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-793c43e9-8ba2-4f67-9a27-97f77cc033b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054113 Apr 11 19:53:21.295392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 453/836] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:21.424118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a44d9877-11b4-4e4d-b104-14b25e751056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:21.425879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a44d9877-11b4-4e4d-b104-14b25e751056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:21.436347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a44d9877-11b4-4e4d-b104-14b25e751056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:21.437139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a44d9877-11b4-4e4d-b104-14b25e751056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:21.438768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a44d9877-11b4-4e4d-b104-14b25e751056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:21.439554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a44d9877-11b4-4e4d-b104-14b25e751056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:21.468664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a44d9877-11b4-4e4d-b104-14b25e751056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051180 Apr 11 19:53:21.469372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 384/837] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:22.306727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a2a544a8-93e4-4dce-9577-bf0b130acebb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:22.307319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c0d6729-a3e1-41c9-a20e-9ec57ab9b508 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:22.307913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a2a544a8-93e4-4dce-9577-bf0b130acebb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:22.308060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c0d6729-a3e1-41c9-a20e-9ec57ab9b508 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:22.315066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2a544a8-93e4-4dce-9577-bf0b130acebb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:22.315241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c0d6729-a3e1-41c9-a20e-9ec57ab9b508 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:22.315640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2a544a8-93e4-4dce-9577-bf0b130acebb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:22.315775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c0d6729-a3e1-41c9-a20e-9ec57ab9b508 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:22.316462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c0d6729-a3e1-41c9-a20e-9ec57ab9b508 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:22.316596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2a544a8-93e4-4dce-9577-bf0b130acebb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:22.316891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c0d6729-a3e1-41c9-a20e-9ec57ab9b508 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:22.317378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2a544a8-93e4-4dce-9577-bf0b130acebb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:22.355592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c0d6729-a3e1-41c9-a20e-9ec57ab9b508 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052050 Apr 11 19:53:22.356965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a2a544a8-93e4-4dce-9577-bf0b130acebb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054214 Apr 11 19:53:22.357670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 454/838] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:22.359231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 385/839] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:22.482715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f70d0c1c-74b8-4bc3-9fda-42f517dbb9ea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:22.483835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f70d0c1c-74b8-4bc3-9fda-42f517dbb9ea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:22.490959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f70d0c1c-74b8-4bc3-9fda-42f517dbb9ea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:22.491492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f70d0c1c-74b8-4bc3-9fda-42f517dbb9ea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:22.492310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f70d0c1c-74b8-4bc3-9fda-42f517dbb9ea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:22.492740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f70d0c1c-74b8-4bc3-9fda-42f517dbb9ea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:22.522569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f70d0c1c-74b8-4bc3-9fda-42f517dbb9ea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Apr 11 19:53:22.523106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 455/840] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:23.367250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac3d6e7e-9b23-4a09-818c-866c76362aaa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:23.368234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac3d6e7e-9b23-4a09-818c-866c76362aaa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:23.370122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-692f7d0c-a258-4791-9f4c-f6982f5dd216 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:23.371529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-692f7d0c-a258-4791-9f4c-f6982f5dd216 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:23.374780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3d6e7e-9b23-4a09-818c-866c76362aaa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:23.375548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3d6e7e-9b23-4a09-818c-866c76362aaa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:23.376311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3d6e7e-9b23-4a09-818c-866c76362aaa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:23.376849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3d6e7e-9b23-4a09-818c-866c76362aaa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:23.380014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-692f7d0c-a258-4791-9f4c-f6982f5dd216 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:23.380552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-692f7d0c-a258-4791-9f4c-f6982f5dd216 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:23.381570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-692f7d0c-a258-4791-9f4c-f6982f5dd216 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:23.382192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-692f7d0c-a258-4791-9f4c-f6982f5dd216 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:23.407444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac3d6e7e-9b23-4a09-818c-866c76362aaa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Apr 11 19:53:23.410222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 386/841] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:53:23.429495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-692f7d0c-a258-4791-9f4c-f6982f5dd216 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064188 Apr 11 19:53:23.430218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 456/842] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:23.537614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e6c9ae6-53e3-4f3d-aefd-833dc0373e03 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:23.538580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9e6c9ae6-53e3-4f3d-aefd-833dc0373e03 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:23.545390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e6c9ae6-53e3-4f3d-aefd-833dc0373e03 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:23.545843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e6c9ae6-53e3-4f3d-aefd-833dc0373e03 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:23.546625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e6c9ae6-53e3-4f3d-aefd-833dc0373e03 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:23.547063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e6c9ae6-53e3-4f3d-aefd-833dc0373e03 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:23.577234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e6c9ae6-53e3-4f3d-aefd-833dc0373e03 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Apr 11 19:53:23.577794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 387/843] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:24.418721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1f007ae-2e74-4d78-8f3e-f93ab71c813a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:24.419759 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1f007ae-2e74-4d78-8f3e-f93ab71c813a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:24.426686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1f007ae-2e74-4d78-8f3e-f93ab71c813a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:24.427113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1f007ae-2e74-4d78-8f3e-f93ab71c813a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:24.427886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1f007ae-2e74-4d78-8f3e-f93ab71c813a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:24.428297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1f007ae-2e74-4d78-8f3e-f93ab71c813a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:24.441270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-482bc02e-f4ba-45b4-95d5-e97e68d9c198 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:24.442890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-482bc02e-f4ba-45b4-95d5-e97e68d9c198 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:24.449319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-482bc02e-f4ba-45b4-95d5-e97e68d9c198 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:24.457702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-482bc02e-f4ba-45b4-95d5-e97e68d9c198 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:24.457702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-482bc02e-f4ba-45b4-95d5-e97e68d9c198 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:24.457702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-482bc02e-f4ba-45b4-95d5-e97e68d9c198 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:24.466625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1f007ae-2e74-4d78-8f3e-f93ab71c813a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051802 Apr 11 19:53:24.467253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 457/844] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:24.492538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-482bc02e-f4ba-45b4-95d5-e97e68d9c198 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055348 Apr 11 19:53:24.493419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 388/845] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:53:24.594186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73d42f5c-5ebd-428e-b7e1-cbd7b4214997 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:24.595659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73d42f5c-5ebd-428e-b7e1-cbd7b4214997 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:24.602703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73d42f5c-5ebd-428e-b7e1-cbd7b4214997 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:24.605408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73d42f5c-5ebd-428e-b7e1-cbd7b4214997 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:24.605408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73d42f5c-5ebd-428e-b7e1-cbd7b4214997 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:24.605408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73d42f5c-5ebd-428e-b7e1-cbd7b4214997 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:24.635323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73d42f5c-5ebd-428e-b7e1-cbd7b4214997 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Apr 11 19:53:24.635323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 458/846] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:25.478836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-28c758f2-8054-4ea7-8bb9-52cafde91778 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:25.479832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-28c758f2-8054-4ea7-8bb9-52cafde91778 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:25.486859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28c758f2-8054-4ea7-8bb9-52cafde91778 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:25.487313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28c758f2-8054-4ea7-8bb9-52cafde91778 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:25.488082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28c758f2-8054-4ea7-8bb9-52cafde91778 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:25.488518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28c758f2-8054-4ea7-8bb9-52cafde91778 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:25.510125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-33d7e78f-bd2a-4c7c-98cc-c1a4726d690a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:25.510125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-33d7e78f-bd2a-4c7c-98cc-c1a4726d690a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:25.514698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33d7e78f-bd2a-4c7c-98cc-c1a4726d690a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:25.515234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33d7e78f-bd2a-4c7c-98cc-c1a4726d690a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:25.516081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33d7e78f-bd2a-4c7c-98cc-c1a4726d690a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:25.516588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33d7e78f-bd2a-4c7c-98cc-c1a4726d690a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:25.525253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-28c758f2-8054-4ea7-8bb9-52cafde91778 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050579 Apr 11 19:53:25.525825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 389/847] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:25.557243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-33d7e78f-bd2a-4c7c-98cc-c1a4726d690a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054494 Apr 11 19:53:25.557803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 459/848] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:25.649805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5359bd8-80ed-494d-8ab9-f04f6365e4f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:25.651260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5359bd8-80ed-494d-8ab9-f04f6365e4f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:25.661120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5359bd8-80ed-494d-8ab9-f04f6365e4f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:25.661812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5359bd8-80ed-494d-8ab9-f04f6365e4f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:25.662850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5359bd8-80ed-494d-8ab9-f04f6365e4f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:25.663446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5359bd8-80ed-494d-8ab9-f04f6365e4f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:25.695389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5359bd8-80ed-494d-8ab9-f04f6365e4f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052105 Apr 11 19:53:25.695935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 390/849] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:26.537419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c066817b-824f-4e4f-a93c-3dada7391d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:26.538335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c066817b-824f-4e4f-a93c-3dada7391d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:26.544931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c066817b-824f-4e4f-a93c-3dada7391d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:26.545397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c066817b-824f-4e4f-a93c-3dada7391d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:26.546140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c066817b-824f-4e4f-a93c-3dada7391d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:26.546560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c066817b-824f-4e4f-a93c-3dada7391d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:26.570945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f8cd5231-152e-42ca-8518-c6e2971901e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:26.571856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f8cd5231-152e-42ca-8518-c6e2971901e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:26.576424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c066817b-824f-4e4f-a93c-3dada7391d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043008 Apr 11 19:53:26.580979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 460/850] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:26.581163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8cd5231-152e-42ca-8518-c6e2971901e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:26.581163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8cd5231-152e-42ca-8518-c6e2971901e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:26.581163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8cd5231-152e-42ca-8518-c6e2971901e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:26.581163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8cd5231-152e-42ca-8518-c6e2971901e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:26.611372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f8cd5231-152e-42ca-8518-c6e2971901e9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044001 Apr 11 19:53:26.612065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 391/851] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:26.711848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-741f3a66-bfdd-4f63-b86f-8707e83ee127 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:26.713356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-741f3a66-bfdd-4f63-b86f-8707e83ee127 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:26.723125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-741f3a66-bfdd-4f63-b86f-8707e83ee127 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:26.723546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-741f3a66-bfdd-4f63-b86f-8707e83ee127 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:26.724368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-741f3a66-bfdd-4f63-b86f-8707e83ee127 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:26.724796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-741f3a66-bfdd-4f63-b86f-8707e83ee127 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:26.757002 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-741f3a66-bfdd-4f63-b86f-8707e83ee127 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051988 Apr 11 19:53:26.757937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 461/852] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:27.589421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c3e4dbf-6df5-477f-86f9-2d51cecbe5d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:27.590366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c3e4dbf-6df5-477f-86f9-2d51cecbe5d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:27.597365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c3e4dbf-6df5-477f-86f9-2d51cecbe5d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:27.597812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c3e4dbf-6df5-477f-86f9-2d51cecbe5d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:27.598613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c3e4dbf-6df5-477f-86f9-2d51cecbe5d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:27.599038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c3e4dbf-6df5-477f-86f9-2d51cecbe5d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:27.626459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50412204-2f4e-4936-9257-ebdd5fc09c8c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:27.626459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50412204-2f4e-4936-9257-ebdd5fc09c8c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:27.631421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50412204-2f4e-4936-9257-ebdd5fc09c8c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:27.631947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50412204-2f4e-4936-9257-ebdd5fc09c8c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:27.632719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50412204-2f4e-4936-9257-ebdd5fc09c8c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:27.633181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50412204-2f4e-4936-9257-ebdd5fc09c8c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:27.638204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c3e4dbf-6df5-477f-86f9-2d51cecbe5d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052529 Apr 11 19:53:27.638750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 392/853] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:27.662793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50412204-2f4e-4936-9257-ebdd5fc09c8c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042816 Apr 11 19:53:27.663345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 462/854] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:27.771756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2de8da68-78e4-4638-923b-d9ed6752605d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:27.772947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2de8da68-78e4-4638-923b-d9ed6752605d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:27.781104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de8da68-78e4-4638-923b-d9ed6752605d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:27.781657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de8da68-78e4-4638-923b-d9ed6752605d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:27.782602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de8da68-78e4-4638-923b-d9ed6752605d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:27.783135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de8da68-78e4-4638-923b-d9ed6752605d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:27.815157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2de8da68-78e4-4638-923b-d9ed6752605d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049030 Apr 11 19:53:27.815726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 393/855] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:28.650195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b2e7f17-17e0-46ba-b9cc-66ca15be8373 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:28.651118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b2e7f17-17e0-46ba-b9cc-66ca15be8373 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:28.657750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b2e7f17-17e0-46ba-b9cc-66ca15be8373 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:28.658199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b2e7f17-17e0-46ba-b9cc-66ca15be8373 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:28.658948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b2e7f17-17e0-46ba-b9cc-66ca15be8373 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:28.659374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b2e7f17-17e0-46ba-b9cc-66ca15be8373 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:28.684591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1042f5c8-1e14-41d8-8d75-f27fabb529e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:28.684591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1042f5c8-1e14-41d8-8d75-f27fabb529e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:28.684591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1042f5c8-1e14-41d8-8d75-f27fabb529e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:28.684591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1042f5c8-1e14-41d8-8d75-f27fabb529e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:28.685659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1042f5c8-1e14-41d8-8d75-f27fabb529e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:28.685659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1042f5c8-1e14-41d8-8d75-f27fabb529e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:28.690390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b2e7f17-17e0-46ba-b9cc-66ca15be8373 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Apr 11 19:53:28.691407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 463/856] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:28.712610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1042f5c8-1e14-41d8-8d75-f27fabb529e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042631 Apr 11 19:53:28.713135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 394/857] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:53:28.827240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-acd4d84a-1c8e-4f54-ad05-ad9228a5afdc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:28.828166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-acd4d84a-1c8e-4f54-ad05-ad9228a5afdc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:28.834948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acd4d84a-1c8e-4f54-ad05-ad9228a5afdc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:28.835392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acd4d84a-1c8e-4f54-ad05-ad9228a5afdc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:28.836166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acd4d84a-1c8e-4f54-ad05-ad9228a5afdc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:28.836562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acd4d84a-1c8e-4f54-ad05-ad9228a5afdc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:28.866152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-acd4d84a-1c8e-4f54-ad05-ad9228a5afdc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Apr 11 19:53:28.867053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 464/858] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:29.702385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e1d7309b-4b2e-44a4-b4f8-b1e1e4a74104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:29.703361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e1d7309b-4b2e-44a4-b4f8-b1e1e4a74104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:29.710796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1d7309b-4b2e-44a4-b4f8-b1e1e4a74104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:29.711401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1d7309b-4b2e-44a4-b4f8-b1e1e4a74104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:29.712483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1d7309b-4b2e-44a4-b4f8-b1e1e4a74104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:29.712924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1d7309b-4b2e-44a4-b4f8-b1e1e4a74104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:29.724343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ce2c2cf-7a9d-41f6-bad5-0e772f3ba74a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:29.725477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ce2c2cf-7a9d-41f6-bad5-0e772f3ba74a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:29.732061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ce2c2cf-7a9d-41f6-bad5-0e772f3ba74a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:29.732518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ce2c2cf-7a9d-41f6-bad5-0e772f3ba74a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:29.733357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ce2c2cf-7a9d-41f6-bad5-0e772f3ba74a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:29.733764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ce2c2cf-7a9d-41f6-bad5-0e772f3ba74a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:29.751728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e1d7309b-4b2e-44a4-b4f8-b1e1e4a74104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Apr 11 19:53:29.751728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 395/859] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:29.770782 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ce2c2cf-7a9d-41f6-bad5-0e772f3ba74a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050395 Apr 11 19:53:29.771351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 465/860] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:29.879459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6c995cf9-9ca8-4e1f-a5cb-58cccfd46ff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:29.880450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6c995cf9-9ca8-4e1f-a5cb-58cccfd46ff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:29.887267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c995cf9-9ca8-4e1f-a5cb-58cccfd46ff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:29.887712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c995cf9-9ca8-4e1f-a5cb-58cccfd46ff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:29.888497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c995cf9-9ca8-4e1f-a5cb-58cccfd46ff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:29.888961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c995cf9-9ca8-4e1f-a5cb-58cccfd46ff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:29.919187 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6c995cf9-9ca8-4e1f-a5cb-58cccfd46ff2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044794 Apr 11 19:53:29.919776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 396/861] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:30.757516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-feb284c7-e009-4edb-8e8c-9f0aab6637bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:30.758371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-feb284c7-e009-4edb-8e8c-9f0aab6637bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:30.765756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-feb284c7-e009-4edb-8e8c-9f0aab6637bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:30.766279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-feb284c7-e009-4edb-8e8c-9f0aab6637bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:30.766910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-feb284c7-e009-4edb-8e8c-9f0aab6637bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:30.767340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-feb284c7-e009-4edb-8e8c-9f0aab6637bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:30.783958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53d17b6d-2da6-4a86-8b04-6e2dc040d891 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:30.785091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53d17b6d-2da6-4a86-8b04-6e2dc040d891 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:30.791717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53d17b6d-2da6-4a86-8b04-6e2dc040d891 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:30.792112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53d17b6d-2da6-4a86-8b04-6e2dc040d891 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:30.792868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53d17b6d-2da6-4a86-8b04-6e2dc040d891 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:30.793340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53d17b6d-2da6-4a86-8b04-6e2dc040d891 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:30.797558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-feb284c7-e009-4edb-8e8c-9f0aab6637bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Apr 11 19:53:30.798108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 466/862] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:30.824408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53d17b6d-2da6-4a86-8b04-6e2dc040d891 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044515 Apr 11 19:53:30.825019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 397/863] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:30.935570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ce3c5c7a-cd1d-4e8a-b90a-d0a4a97c9fdf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:30.936483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ce3c5c7a-cd1d-4e8a-b90a-d0a4a97c9fdf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:30.943110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce3c5c7a-cd1d-4e8a-b90a-d0a4a97c9fdf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:30.943565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce3c5c7a-cd1d-4e8a-b90a-d0a4a97c9fdf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:30.944331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce3c5c7a-cd1d-4e8a-b90a-d0a4a97c9fdf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:30.944811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce3c5c7a-cd1d-4e8a-b90a-d0a4a97c9fdf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:30.974191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ce3c5c7a-cd1d-4e8a-b90a-d0a4a97c9fdf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042548 Apr 11 19:53:30.974744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 467/864] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:31.810216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee6cb26e-b4f4-4c1f-9d3a-2277e3390b70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:31.811130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee6cb26e-b4f4-4c1f-9d3a-2277e3390b70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:31.817913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee6cb26e-b4f4-4c1f-9d3a-2277e3390b70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:31.818332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee6cb26e-b4f4-4c1f-9d3a-2277e3390b70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:31.819116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee6cb26e-b4f4-4c1f-9d3a-2277e3390b70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:31.819545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee6cb26e-b4f4-4c1f-9d3a-2277e3390b70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:31.836243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9986774d-225a-494d-8cf4-a5b5b28fc4e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:31.837788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9986774d-225a-494d-8cf4-a5b5b28fc4e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:31.843878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9986774d-225a-494d-8cf4-a5b5b28fc4e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:31.844326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9986774d-225a-494d-8cf4-a5b5b28fc4e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:31.845118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9986774d-225a-494d-8cf4-a5b5b28fc4e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:31.845571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9986774d-225a-494d-8cf4-a5b5b28fc4e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:31.852095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee6cb26e-b4f4-4c1f-9d3a-2277e3390b70 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045751 Apr 11 19:53:31.852860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 398/865] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:31.876477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9986774d-225a-494d-8cf4-a5b5b28fc4e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044486 Apr 11 19:53:31.877303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 468/866] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:31.986496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e76103e-7dd2-4d7c-93fb-fa8618c6fb7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:31.987415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e76103e-7dd2-4d7c-93fb-fa8618c6fb7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:31.995089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e76103e-7dd2-4d7c-93fb-fa8618c6fb7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:31.995529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e76103e-7dd2-4d7c-93fb-fa8618c6fb7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:31.996289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e76103e-7dd2-4d7c-93fb-fa8618c6fb7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:31.996720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e76103e-7dd2-4d7c-93fb-fa8618c6fb7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:32.026238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e76103e-7dd2-4d7c-93fb-fa8618c6fb7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Apr 11 19:53:32.026799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 399/867] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:32.864288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d6c22384-d3e1-46f5-9dc3-7c818d6ebfbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:32.865205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d6c22384-d3e1-46f5-9dc3-7c818d6ebfbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:32.872072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6c22384-d3e1-46f5-9dc3-7c818d6ebfbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:32.872532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6c22384-d3e1-46f5-9dc3-7c818d6ebfbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:32.873333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6c22384-d3e1-46f5-9dc3-7c818d6ebfbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:32.873763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6c22384-d3e1-46f5-9dc3-7c818d6ebfbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:32.888862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23eff6bb-c43c-4e27-8c51-6f7a82d08e7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:32.890457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23eff6bb-c43c-4e27-8c51-6f7a82d08e7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:32.896622 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23eff6bb-c43c-4e27-8c51-6f7a82d08e7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:32.897161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23eff6bb-c43c-4e27-8c51-6f7a82d08e7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:32.898035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23eff6bb-c43c-4e27-8c51-6f7a82d08e7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:32.898525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23eff6bb-c43c-4e27-8c51-6f7a82d08e7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:32.906556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d6c22384-d3e1-46f5-9dc3-7c818d6ebfbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046389 Apr 11 19:53:32.907360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 469/868] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:32.930899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23eff6bb-c43c-4e27-8c51-6f7a82d08e7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046029 Apr 11 19:53:32.931387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 400/869] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:33.037945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-863a0ec8-fc49-436b-a8f1-e6748b829bee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:33.038892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-863a0ec8-fc49-436b-a8f1-e6748b829bee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:33.045324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-863a0ec8-fc49-436b-a8f1-e6748b829bee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:33.045762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-863a0ec8-fc49-436b-a8f1-e6748b829bee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:33.046543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-863a0ec8-fc49-436b-a8f1-e6748b829bee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:33.046963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-863a0ec8-fc49-436b-a8f1-e6748b829bee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:33.076152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-863a0ec8-fc49-436b-a8f1-e6748b829bee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042243 Apr 11 19:53:33.076693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 470/870] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:33.917892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a8f046a6-482d-4a9c-a636-9f28191ab265 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:33.918857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a8f046a6-482d-4a9c-a636-9f28191ab265 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:33.925627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8f046a6-482d-4a9c-a636-9f28191ab265 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:33.926135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8f046a6-482d-4a9c-a636-9f28191ab265 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:33.926852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8f046a6-482d-4a9c-a636-9f28191ab265 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:33.927312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8f046a6-482d-4a9c-a636-9f28191ab265 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:33.943085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-114f26ae-81c1-43be-adc3-d18bd113a8c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:33.944036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-114f26ae-81c1-43be-adc3-d18bd113a8c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:33.950943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-114f26ae-81c1-43be-adc3-d18bd113a8c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:33.951047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-114f26ae-81c1-43be-adc3-d18bd113a8c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:33.951969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-114f26ae-81c1-43be-adc3-d18bd113a8c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:33.952400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-114f26ae-81c1-43be-adc3-d18bd113a8c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:33.957780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a8f046a6-482d-4a9c-a636-9f28191ab265 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 Apr 11 19:53:33.959218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 401/871] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:33.981998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-114f26ae-81c1-43be-adc3-d18bd113a8c4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043052 Apr 11 19:53:33.982578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 471/872] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:34.088294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10cda846-cc62-4f71-8f8e-2330b02657d2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:34.089285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10cda846-cc62-4f71-8f8e-2330b02657d2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:34.095863 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10cda846-cc62-4f71-8f8e-2330b02657d2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:34.096310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10cda846-cc62-4f71-8f8e-2330b02657d2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:34.097141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10cda846-cc62-4f71-8f8e-2330b02657d2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:34.097574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10cda846-cc62-4f71-8f8e-2330b02657d2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:34.126279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10cda846-cc62-4f71-8f8e-2330b02657d2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Apr 11 19:53:34.126827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 402/873] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:34.970364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b35b34b1-c9fa-45d4-a3f1-e314d7d40446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:34.971311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b35b34b1-c9fa-45d4-a3f1-e314d7d40446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:34.978146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b35b34b1-c9fa-45d4-a3f1-e314d7d40446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:34.978663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b35b34b1-c9fa-45d4-a3f1-e314d7d40446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:34.979425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b35b34b1-c9fa-45d4-a3f1-e314d7d40446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:34.979850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b35b34b1-c9fa-45d4-a3f1-e314d7d40446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:34.994080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2156433-ae3c-4bb6-9450-d9ff73226253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:34.995115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2156433-ae3c-4bb6-9450-d9ff73226253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:35.002179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2156433-ae3c-4bb6-9450-d9ff73226253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:35.003191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2156433-ae3c-4bb6-9450-d9ff73226253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:35.004074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2156433-ae3c-4bb6-9450-d9ff73226253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:35.004509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2156433-ae3c-4bb6-9450-d9ff73226253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:35.009920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b35b34b1-c9fa-45d4-a3f1-e314d7d40446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043063 Apr 11 19:53:35.013482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 472/874] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:35.035693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2156433-ae3c-4bb6-9450-d9ff73226253 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045530 Apr 11 19:53:35.036524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 403/875] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:35.138636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bde38fd6-2e30-43f1-b4d7-1619def8d71f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:35.139572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bde38fd6-2e30-43f1-b4d7-1619def8d71f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:35.146097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bde38fd6-2e30-43f1-b4d7-1619def8d71f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:35.146540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bde38fd6-2e30-43f1-b4d7-1619def8d71f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:35.147326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bde38fd6-2e30-43f1-b4d7-1619def8d71f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:35.147756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bde38fd6-2e30-43f1-b4d7-1619def8d71f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:35.177180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bde38fd6-2e30-43f1-b4d7-1619def8d71f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042513 Apr 11 19:53:35.177739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 473/876] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:36.022138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db964ca9-0193-4839-abd6-6e657299efbf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:36.023061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db964ca9-0193-4839-abd6-6e657299efbf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:36.029715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db964ca9-0193-4839-abd6-6e657299efbf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:36.030155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db964ca9-0193-4839-abd6-6e657299efbf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:36.030908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db964ca9-0193-4839-abd6-6e657299efbf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:36.031330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db964ca9-0193-4839-abd6-6e657299efbf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:36.047705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3103a6e9-be2c-449f-a77d-4e49847c360a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:36.048656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3103a6e9-be2c-449f-a77d-4e49847c360a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:36.055947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3103a6e9-be2c-449f-a77d-4e49847c360a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:36.056384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3103a6e9-be2c-449f-a77d-4e49847c360a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:36.057374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3103a6e9-be2c-449f-a77d-4e49847c360a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:36.057986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3103a6e9-be2c-449f-a77d-4e49847c360a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:36.062479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db964ca9-0193-4839-abd6-6e657299efbf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Apr 11 19:53:36.062479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 404/877] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:36.087325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3103a6e9-be2c-449f-a77d-4e49847c360a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043536 Apr 11 19:53:36.087876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 474/878] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:36.189393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d5cd6077-9097-425a-bca9-2333e6eb87c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:36.190186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d5cd6077-9097-425a-bca9-2333e6eb87c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:36.197129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5cd6077-9097-425a-bca9-2333e6eb87c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:36.197578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5cd6077-9097-425a-bca9-2333e6eb87c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:36.198364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5cd6077-9097-425a-bca9-2333e6eb87c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:36.198796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5cd6077-9097-425a-bca9-2333e6eb87c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:36.227441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d5cd6077-9097-425a-bca9-2333e6eb87c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042550 Apr 11 19:53:36.227988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 405/879] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:37.074147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56177312-a514-4148-8315-e8c1e2080b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:37.075057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56177312-a514-4148-8315-e8c1e2080b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:37.082026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56177312-a514-4148-8315-e8c1e2080b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:37.082487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56177312-a514-4148-8315-e8c1e2080b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:37.083253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56177312-a514-4148-8315-e8c1e2080b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:37.083679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56177312-a514-4148-8315-e8c1e2080b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:37.102431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6988a4fe-a36a-410f-9c46-1d7c993cc64c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:37.103021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6988a4fe-a36a-410f-9c46-1d7c993cc64c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:37.109866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6988a4fe-a36a-410f-9c46-1d7c993cc64c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:37.110375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6988a4fe-a36a-410f-9c46-1d7c993cc64c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:37.111259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6988a4fe-a36a-410f-9c46-1d7c993cc64c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:37.111728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6988a4fe-a36a-410f-9c46-1d7c993cc64c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:37.116982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56177312-a514-4148-8315-e8c1e2080b8f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Apr 11 19:53:37.117779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 475/880] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:37.143550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6988a4fe-a36a-410f-9c46-1d7c993cc64c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046314 Apr 11 19:53:37.144142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 406/881] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:37.243755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f2a176c-52be-4539-97f5-f1010af87c46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:37.245306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f2a176c-52be-4539-97f5-f1010af87c46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:37.255156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f2a176c-52be-4539-97f5-f1010af87c46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:37.255603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f2a176c-52be-4539-97f5-f1010af87c46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:37.256401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f2a176c-52be-4539-97f5-f1010af87c46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:37.256834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f2a176c-52be-4539-97f5-f1010af87c46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:37.286407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f2a176c-52be-4539-97f5-f1010af87c46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049375 Apr 11 19:53:37.286952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 476/882] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:37 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:38.133513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac333f24-e002-4b24-a07c-840954d0d2d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:38.134995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac333f24-e002-4b24-a07c-840954d0d2d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:38.145802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac333f24-e002-4b24-a07c-840954d0d2d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:38.147051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac333f24-e002-4b24-a07c-840954d0d2d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:38.147945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac333f24-e002-4b24-a07c-840954d0d2d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:38.148627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac333f24-e002-4b24-a07c-840954d0d2d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:38.160546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-01f36539-d429-4bc0-acb3-03108db015b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:38.161579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-01f36539-d429-4bc0-acb3-03108db015b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:38.168185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01f36539-d429-4bc0-acb3-03108db015b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:38.168643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01f36539-d429-4bc0-acb3-03108db015b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:38.169627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01f36539-d429-4bc0-acb3-03108db015b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:38.170195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01f36539-d429-4bc0-acb3-03108db015b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:38.184062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac333f24-e002-4b24-a07c-840954d0d2d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057269 Apr 11 19:53:38.184998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 407/883] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:38.208240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-01f36539-d429-4bc0-acb3-03108db015b4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054336 Apr 11 19:53:38.208808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 477/884] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:38.303011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-236f4700-56f8-440c-a5b1-f5255ecaeec6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:38.303970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-236f4700-56f8-440c-a5b1-f5255ecaeec6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:38.311084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-236f4700-56f8-440c-a5b1-f5255ecaeec6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:38.311482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-236f4700-56f8-440c-a5b1-f5255ecaeec6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:38.312262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-236f4700-56f8-440c-a5b1-f5255ecaeec6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:38.312690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-236f4700-56f8-440c-a5b1-f5255ecaeec6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:38.343274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-236f4700-56f8-440c-a5b1-f5255ecaeec6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047156 Apr 11 19:53:38.343836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 408/885] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:39.196066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e5fddce2-dbc6-4768-a2cb-3a0506dfa909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:39.197016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e5fddce2-dbc6-4768-a2cb-3a0506dfa909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:39.204471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5fddce2-dbc6-4768-a2cb-3a0506dfa909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:39.204942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5fddce2-dbc6-4768-a2cb-3a0506dfa909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:39.205695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5fddce2-dbc6-4768-a2cb-3a0506dfa909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:39.206121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5fddce2-dbc6-4768-a2cb-3a0506dfa909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:39.224294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39795cd6-4394-4d7c-82b6-4e4fb52ecf6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:39.226284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-39795cd6-4394-4d7c-82b6-4e4fb52ecf6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:39.233688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39795cd6-4394-4d7c-82b6-4e4fb52ecf6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:39.234428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39795cd6-4394-4d7c-82b6-4e4fb52ecf6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:39.235972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39795cd6-4394-4d7c-82b6-4e4fb52ecf6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:39.236602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e5fddce2-dbc6-4768-a2cb-3a0506dfa909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Apr 11 19:53:39.236845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39795cd6-4394-4d7c-82b6-4e4fb52ecf6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:39.240700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 478/886] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:39.272315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39795cd6-4394-4d7c-82b6-4e4fb52ecf6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056090 Apr 11 19:53:39.273114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 409/887] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:39.355266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-76871183-81e8-4d7a-b777-e76efac04982 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:39.356302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-76871183-81e8-4d7a-b777-e76efac04982 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:39.362804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76871183-81e8-4d7a-b777-e76efac04982 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:39.363362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76871183-81e8-4d7a-b777-e76efac04982 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:39.364206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76871183-81e8-4d7a-b777-e76efac04982 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:39.364708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76871183-81e8-4d7a-b777-e76efac04982 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:39.399694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-76871183-81e8-4d7a-b777-e76efac04982 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048481 Apr 11 19:53:39.400232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 479/888] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:40.252666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0327a8e4-efba-4acc-bf1b-0e632afc3aac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:40.254234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0327a8e4-efba-4acc-bf1b-0e632afc3aac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:40.261984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0327a8e4-efba-4acc-bf1b-0e632afc3aac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:40.262504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0327a8e4-efba-4acc-bf1b-0e632afc3aac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:40.263264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0327a8e4-efba-4acc-bf1b-0e632afc3aac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:40.263694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0327a8e4-efba-4acc-bf1b-0e632afc3aac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:40.283708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ffc6a3c-59af-4e36-99aa-3566c9486a0b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:40.287088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ffc6a3c-59af-4e36-99aa-3566c9486a0b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:40.293976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ffc6a3c-59af-4e36-99aa-3566c9486a0b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:40.294412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ffc6a3c-59af-4e36-99aa-3566c9486a0b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:40.295265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ffc6a3c-59af-4e36-99aa-3566c9486a0b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:40.295501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0327a8e4-efba-4acc-bf1b-0e632afc3aac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049574 Apr 11 19:53:40.295833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ffc6a3c-59af-4e36-99aa-3566c9486a0b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:40.299471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 410/889] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:40.325840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ffc6a3c-59af-4e36-99aa-3566c9486a0b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046093 Apr 11 19:53:40.326571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 480/890] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:53:40.416020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e16f7a8-33f0-4bf8-9c29-c9bd06f6ad7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:40.417592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e16f7a8-33f0-4bf8-9c29-c9bd06f6ad7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:40.428939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e16f7a8-33f0-4bf8-9c29-c9bd06f6ad7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:40.429723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e16f7a8-33f0-4bf8-9c29-c9bd06f6ad7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:40.430619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e16f7a8-33f0-4bf8-9c29-c9bd06f6ad7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:40.431054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e16f7a8-33f0-4bf8-9c29-c9bd06f6ad7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:40.461438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e16f7a8-33f0-4bf8-9c29-c9bd06f6ad7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052028 Apr 11 19:53:40.461926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 411/891] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:41.311866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3336d1b1-4247-40e9-b8db-ffeda8bb96fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:41.313402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3336d1b1-4247-40e9-b8db-ffeda8bb96fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:41.323842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3336d1b1-4247-40e9-b8db-ffeda8bb96fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:41.324679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3336d1b1-4247-40e9-b8db-ffeda8bb96fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:41.326855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3336d1b1-4247-40e9-b8db-ffeda8bb96fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:41.326855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3336d1b1-4247-40e9-b8db-ffeda8bb96fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:41.341319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00a940c9-815f-4939-9a06-2eca969948c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:41.341319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00a940c9-815f-4939-9a06-2eca969948c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:41.347424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00a940c9-815f-4939-9a06-2eca969948c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:41.347842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00a940c9-815f-4939-9a06-2eca969948c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:41.348649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00a940c9-815f-4939-9a06-2eca969948c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:41.349119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00a940c9-815f-4939-9a06-2eca969948c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:41.360736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3336d1b1-4247-40e9-b8db-ffeda8bb96fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055707 Apr 11 19:53:41.361540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 481/892] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:41.379817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00a940c9-815f-4939-9a06-2eca969948c1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044988 Apr 11 19:53:41.380537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 412/893] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:41.474793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-827197d6-fe28-44fd-807f-7efb07ff6cfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:41.475719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-827197d6-fe28-44fd-807f-7efb07ff6cfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:41.482588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827197d6-fe28-44fd-807f-7efb07ff6cfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:41.483004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827197d6-fe28-44fd-807f-7efb07ff6cfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:41.483753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827197d6-fe28-44fd-807f-7efb07ff6cfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:41.484184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827197d6-fe28-44fd-807f-7efb07ff6cfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:41.514556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-827197d6-fe28-44fd-807f-7efb07ff6cfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Apr 11 19:53:41.516524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 482/894] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:42.377149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0e675961-bf84-4e76-9125-2b7b012ea820 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:42.378709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0e675961-bf84-4e76-9125-2b7b012ea820 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:42.387251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e675961-bf84-4e76-9125-2b7b012ea820 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:42.387707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e675961-bf84-4e76-9125-2b7b012ea820 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:42.388481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e675961-bf84-4e76-9125-2b7b012ea820 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:42.388935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e675961-bf84-4e76-9125-2b7b012ea820 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:42.391477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3c632de7-1049-4d78-a484-0b67aed5b1a7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:42.392439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3c632de7-1049-4d78-a484-0b67aed5b1a7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:42.398511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c632de7-1049-4d78-a484-0b67aed5b1a7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:42.398956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c632de7-1049-4d78-a484-0b67aed5b1a7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:42.400067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c632de7-1049-4d78-a484-0b67aed5b1a7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:42.400499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3c632de7-1049-4d78-a484-0b67aed5b1a7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:42.420528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0e675961-bf84-4e76-9125-2b7b012ea820 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050535 Apr 11 19:53:42.421499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 413/895] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:42.436624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3c632de7-1049-4d78-a484-0b67aed5b1a7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048907 Apr 11 19:53:42.437814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 483/896] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:42.530063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ddab2250-033d-4e49-8c1c-e0822c4d4c7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:42.531478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ddab2250-033d-4e49-8c1c-e0822c4d4c7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:42.540781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddab2250-033d-4e49-8c1c-e0822c4d4c7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:42.541261 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddab2250-033d-4e49-8c1c-e0822c4d4c7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:42.542047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddab2250-033d-4e49-8c1c-e0822c4d4c7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:42.542455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddab2250-033d-4e49-8c1c-e0822c4d4c7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:42.573339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ddab2250-033d-4e49-8c1c-e0822c4d4c7a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049448 Apr 11 19:53:42.573910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 414/897] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:43.436060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-98c555c1-11a5-46c4-9a09-fb7efb16784b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:43.437481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-98c555c1-11a5-46c4-9a09-fb7efb16784b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:43.447555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98c555c1-11a5-46c4-9a09-fb7efb16784b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:43.448285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98c555c1-11a5-46c4-9a09-fb7efb16784b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:43.449532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98c555c1-11a5-46c4-9a09-fb7efb16784b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:43.450198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98c555c1-11a5-46c4-9a09-fb7efb16784b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:43.451764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f677e44-3074-4858-8a30-5e46a63e449a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:43.453556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f677e44-3074-4858-8a30-5e46a63e449a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:43.462840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f677e44-3074-4858-8a30-5e46a63e449a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:43.463283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f677e44-3074-4858-8a30-5e46a63e449a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:43.464045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f677e44-3074-4858-8a30-5e46a63e449a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:43.464471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f677e44-3074-4858-8a30-5e46a63e449a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:43.484307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-98c555c1-11a5-46c4-9a09-fb7efb16784b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054356 Apr 11 19:53:43.485118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 484/898] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:43.493782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f677e44-3074-4858-8a30-5e46a63e449a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048760 Apr 11 19:53:43.494460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 415/899] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:43.589372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a413981c-4532-453a-a8ea-2fc51d547bcf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:43.590512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a413981c-4532-453a-a8ea-2fc51d547bcf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:43.597175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a413981c-4532-453a-a8ea-2fc51d547bcf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:43.597622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a413981c-4532-453a-a8ea-2fc51d547bcf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:43.598394 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a413981c-4532-453a-a8ea-2fc51d547bcf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:43.598815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a413981c-4532-453a-a8ea-2fc51d547bcf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:43.627567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a413981c-4532-453a-a8ea-2fc51d547bcf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Apr 11 19:53:43.628090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 485/900] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:44.496278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a2cc175e-de2a-4a91-ae71-e34c57a4476d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:44.497298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a2cc175e-de2a-4a91-ae71-e34c57a4476d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:44.504369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2cc175e-de2a-4a91-ae71-e34c57a4476d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:44.504854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2cc175e-de2a-4a91-ae71-e34c57a4476d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:44.505629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb587343-36ef-4b38-b54c-655fdc40550f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:44.506083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2cc175e-de2a-4a91-ae71-e34c57a4476d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:44.506083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2cc175e-de2a-4a91-ae71-e34c57a4476d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:44.506713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb587343-36ef-4b38-b54c-655fdc40550f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:44.513523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb587343-36ef-4b38-b54c-655fdc40550f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:44.514035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb587343-36ef-4b38-b54c-655fdc40550f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:44.514840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb587343-36ef-4b38-b54c-655fdc40550f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:44.515267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb587343-36ef-4b38-b54c-655fdc40550f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:44.535910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a2cc175e-de2a-4a91-ae71-e34c57a4476d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Apr 11 19:53:44.536690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 416/901] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:44.544966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb587343-36ef-4b38-b54c-655fdc40550f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043599 Apr 11 19:53:44.545499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 486/902] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:44.644013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e8907551-260b-453c-be71-43da16ce7d85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:44.645717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e8907551-260b-453c-be71-43da16ce7d85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:44.656006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8907551-260b-453c-be71-43da16ce7d85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:44.656743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8907551-260b-453c-be71-43da16ce7d85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:44.658043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8907551-260b-453c-be71-43da16ce7d85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:44.658758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8907551-260b-453c-be71-43da16ce7d85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:44.691110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e8907551-260b-453c-be71-43da16ce7d85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053929 Apr 11 19:53:44.691656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 417/903] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:45.552457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07b5b011-79c9-469e-bb71-5fe97f92af51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:45.553806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07b5b011-79c9-469e-bb71-5fe97f92af51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:45.559784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a04233c-fa3f-47eb-adc7-8773a331ee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:45.560587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a04233c-fa3f-47eb-adc7-8773a331ee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:45.562196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07b5b011-79c9-469e-bb71-5fe97f92af51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:45.562532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07b5b011-79c9-469e-bb71-5fe97f92af51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:45.563311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07b5b011-79c9-469e-bb71-5fe97f92af51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:45.563744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07b5b011-79c9-469e-bb71-5fe97f92af51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:45.566715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a04233c-fa3f-47eb-adc7-8773a331ee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:45.568252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a04233c-fa3f-47eb-adc7-8773a331ee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:45.568252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a04233c-fa3f-47eb-adc7-8773a331ee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:45.568483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a04233c-fa3f-47eb-adc7-8773a331ee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:45.593911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07b5b011-79c9-469e-bb71-5fe97f92af51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048168 Apr 11 19:53:45.594484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 487/904] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:45.598858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a04233c-fa3f-47eb-adc7-8773a331ee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044657 Apr 11 19:53:45.599621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 418/905] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:45.708350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3cfb186a-78f2-4cca-85ff-fff698b87817 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:45.709939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3cfb186a-78f2-4cca-85ff-fff698b87817 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:45.718806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cfb186a-78f2-4cca-85ff-fff698b87817 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:45.719270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cfb186a-78f2-4cca-85ff-fff698b87817 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:45.720055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cfb186a-78f2-4cca-85ff-fff698b87817 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:45.720502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cfb186a-78f2-4cca-85ff-fff698b87817 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:45.748727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3cfb186a-78f2-4cca-85ff-fff698b87817 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047719 Apr 11 19:53:45.749293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 488/906] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:46.608870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-957050e4-80ca-4c67-a37e-b55fd3fae3a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:46.609827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-957050e4-80ca-4c67-a37e-b55fd3fae3a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:46.611741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-06427b1d-1b27-4e18-bcc0-1befff045c86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:46.612821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-06427b1d-1b27-4e18-bcc0-1befff045c86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:46.616401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-957050e4-80ca-4c67-a37e-b55fd3fae3a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:46.616857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-957050e4-80ca-4c67-a37e-b55fd3fae3a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:46.617644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-957050e4-80ca-4c67-a37e-b55fd3fae3a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:46.618069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-957050e4-80ca-4c67-a37e-b55fd3fae3a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:46.619178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06427b1d-1b27-4e18-bcc0-1befff045c86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:46.619659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06427b1d-1b27-4e18-bcc0-1befff045c86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:46.620435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06427b1d-1b27-4e18-bcc0-1befff045c86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:46.620867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06427b1d-1b27-4e18-bcc0-1befff045c86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:46.649495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-957050e4-80ca-4c67-a37e-b55fd3fae3a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Apr 11 19:53:46.652188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-06427b1d-1b27-4e18-bcc0-1befff045c86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044580 Apr 11 19:53:46.653645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 489/908] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:46.653776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 419/908] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:46.765388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f51a13b-55e7-47c1-88df-270ec6cd6cc2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:46.766758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f51a13b-55e7-47c1-88df-270ec6cd6cc2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:46.776982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f51a13b-55e7-47c1-88df-270ec6cd6cc2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:46.777776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f51a13b-55e7-47c1-88df-270ec6cd6cc2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:46.779175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f51a13b-55e7-47c1-88df-270ec6cd6cc2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:46.779889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f51a13b-55e7-47c1-88df-270ec6cd6cc2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:46.813578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f51a13b-55e7-47c1-88df-270ec6cd6cc2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055129 Apr 11 19:53:46.814114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 490/909] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:47.666038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7483b412-f362-4dcf-8f35-952d94d55390 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:47.667506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7483b412-f362-4dcf-8f35-952d94d55390 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:47.667771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fbb6f530-8d72-499a-bd3d-e283f068cd59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:47.669223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fbb6f530-8d72-499a-bd3d-e283f068cd59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:47.675603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7483b412-f362-4dcf-8f35-952d94d55390 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:47.676056 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7483b412-f362-4dcf-8f35-952d94d55390 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:47.676320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbb6f530-8d72-499a-bd3d-e283f068cd59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:47.676753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbb6f530-8d72-499a-bd3d-e283f068cd59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:47.676922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7483b412-f362-4dcf-8f35-952d94d55390 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:47.677268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7483b412-f362-4dcf-8f35-952d94d55390 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:47.677528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbb6f530-8d72-499a-bd3d-e283f068cd59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:47.677965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbb6f530-8d72-499a-bd3d-e283f068cd59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:47.706775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7483b412-f362-4dcf-8f35-952d94d55390 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047788 Apr 11 19:53:47.707638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 420/910] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:47.708133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fbb6f530-8d72-499a-bd3d-e283f068cd59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046860 Apr 11 19:53:47.708875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 491/911] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:53:47.829574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e46ae97-f16f-492f-8a72-7856132574bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:47.831093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e46ae97-f16f-492f-8a72-7856132574bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:47.841543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e46ae97-f16f-492f-8a72-7856132574bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:47.842264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e46ae97-f16f-492f-8a72-7856132574bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:47.843223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e46ae97-f16f-492f-8a72-7856132574bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:47.843643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e46ae97-f16f-492f-8a72-7856132574bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:47.872821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e46ae97-f16f-492f-8a72-7856132574bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049957 Apr 11 19:53:47.873440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 421/912] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:48.721289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7634237-873a-4f2d-a819-c3df88a34d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:48.721873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1c4917dd-043e-4d8f-86aa-272bcd941baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:48.722242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7634237-873a-4f2d-a819-c3df88a34d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:48.722612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1c4917dd-043e-4d8f-86aa-272bcd941baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:48.729816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7634237-873a-4f2d-a819-c3df88a34d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:48.730313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7634237-873a-4f2d-a819-c3df88a34d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:48.730525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c4917dd-043e-4d8f-86aa-272bcd941baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:48.730911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c4917dd-043e-4d8f-86aa-272bcd941baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:48.731102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7634237-873a-4f2d-a819-c3df88a34d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:48.731518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7634237-873a-4f2d-a819-c3df88a34d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:48.731676 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c4917dd-043e-4d8f-86aa-272bcd941baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:48.732114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c4917dd-043e-4d8f-86aa-272bcd941baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:48.763550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7634237-873a-4f2d-a819-c3df88a34d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047317 Apr 11 19:53:48.764290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1c4917dd-043e-4d8f-86aa-272bcd941baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047187 Apr 11 19:53:48.767815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 422/913] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:48.768479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 492/914] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:48.889329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1e296d9-d9f0-4ea1-ab5f-226665d64aaa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:48.890468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1e296d9-d9f0-4ea1-ab5f-226665d64aaa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:48.897055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1e296d9-d9f0-4ea1-ab5f-226665d64aaa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:48.897519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1e296d9-d9f0-4ea1-ab5f-226665d64aaa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:48.898290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1e296d9-d9f0-4ea1-ab5f-226665d64aaa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:48.898715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1e296d9-d9f0-4ea1-ab5f-226665d64aaa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:48.927422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1e296d9-d9f0-4ea1-ab5f-226665d64aaa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Apr 11 19:53:48.927986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 423/915] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:49.780286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4437f760-6e0e-4726-a89d-3fd3f4d03aae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:49.781478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2e794df-017b-48a4-85ea-b48380ea843c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:49.782087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4437f760-6e0e-4726-a89d-3fd3f4d03aae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:49.782958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2e794df-017b-48a4-85ea-b48380ea843c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:49.792698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4437f760-6e0e-4726-a89d-3fd3f4d03aae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:49.793856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4437f760-6e0e-4726-a89d-3fd3f4d03aae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:49.794983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2e794df-017b-48a4-85ea-b48380ea843c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:49.795259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4437f760-6e0e-4726-a89d-3fd3f4d03aae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:49.795718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2e794df-017b-48a4-85ea-b48380ea843c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:49.795910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4437f760-6e0e-4726-a89d-3fd3f4d03aae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:49.797226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2e794df-017b-48a4-85ea-b48380ea843c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:49.797916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2e794df-017b-48a4-85ea-b48380ea843c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:49.827558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4437f760-6e0e-4726-a89d-3fd3f4d03aae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054141 Apr 11 19:53:49.831905 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 493/916] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:49.832320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2e794df-017b-48a4-85ea-b48380ea843c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055805 Apr 11 19:53:49.832320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 424/917] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:49.943593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c41d2d40-1603-4650-ab97-895e62624685 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:49.945175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c41d2d40-1603-4650-ab97-895e62624685 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:49.955395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c41d2d40-1603-4650-ab97-895e62624685 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:49.956139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c41d2d40-1603-4650-ab97-895e62624685 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:49.957451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c41d2d40-1603-4650-ab97-895e62624685 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:49.958164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c41d2d40-1603-4650-ab97-895e62624685 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:49.994954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c41d2d40-1603-4650-ab97-895e62624685 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057860 Apr 11 19:53:49.995661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 494/918] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:50.844415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-86a1ffa2-af26-450e-a173-9f7a70010402 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:50.845290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-462cbb25-ac22-4427-89fe-042f91b51af8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:50.846118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-86a1ffa2-af26-450e-a173-9f7a70010402 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:50.846209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-462cbb25-ac22-4427-89fe-042f91b51af8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:50.852377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86a1ffa2-af26-450e-a173-9f7a70010402 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:50.854400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86a1ffa2-af26-450e-a173-9f7a70010402 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:50.854533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-462cbb25-ac22-4427-89fe-042f91b51af8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:50.854533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-462cbb25-ac22-4427-89fe-042f91b51af8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:50.854724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86a1ffa2-af26-450e-a173-9f7a70010402 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:50.854724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86a1ffa2-af26-450e-a173-9f7a70010402 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:50.854866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-462cbb25-ac22-4427-89fe-042f91b51af8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:50.854866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-462cbb25-ac22-4427-89fe-042f91b51af8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:50.884648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-86a1ffa2-af26-450e-a173-9f7a70010402 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047203 Apr 11 19:53:50.885261 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 425/919] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:50.886914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-462cbb25-ac22-4427-89fe-042f91b51af8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049385 Apr 11 19:53:50.890828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 495/920] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:51.013268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cb6ae96b-d337-42d6-b0ac-25ce6ad2fdae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:51.014964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cb6ae96b-d337-42d6-b0ac-25ce6ad2fdae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:51.022754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb6ae96b-d337-42d6-b0ac-25ce6ad2fdae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:51.023434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb6ae96b-d337-42d6-b0ac-25ce6ad2fdae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:51.024571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb6ae96b-d337-42d6-b0ac-25ce6ad2fdae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:51.025275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb6ae96b-d337-42d6-b0ac-25ce6ad2fdae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:51.062900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cb6ae96b-d337-42d6-b0ac-25ce6ad2fdae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056325 Apr 11 19:53:51.063466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 426/921] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:51.900067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4de37479-b6ba-4573-8b34-7d44b686492e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:51.901573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4de37479-b6ba-4573-8b34-7d44b686492e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:51.901766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a4f0cf5-9a21-4037-9d2f-2b6ae6ae32b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:51.903108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a4f0cf5-9a21-4037-9d2f-2b6ae6ae32b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:51.915365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4de37479-b6ba-4573-8b34-7d44b686492e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:51.915365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4de37479-b6ba-4573-8b34-7d44b686492e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:51.915762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a4f0cf5-9a21-4037-9d2f-2b6ae6ae32b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:51.915926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4de37479-b6ba-4573-8b34-7d44b686492e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:51.916095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a4f0cf5-9a21-4037-9d2f-2b6ae6ae32b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:51.916232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4de37479-b6ba-4573-8b34-7d44b686492e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:51.916358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a4f0cf5-9a21-4037-9d2f-2b6ae6ae32b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:51.916766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a4f0cf5-9a21-4037-9d2f-2b6ae6ae32b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:51.947772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4de37479-b6ba-4573-8b34-7d44b686492e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054409 Apr 11 19:53:51.948340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 496/922] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:51.955744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a4f0cf5-9a21-4037-9d2f-2b6ae6ae32b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054878 Apr 11 19:53:51.956519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 427/923] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:52.076572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f5189de-274f-4807-8458-dac7a4919c2b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:52.077934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f5189de-274f-4807-8458-dac7a4919c2b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:52.084481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f5189de-274f-4807-8458-dac7a4919c2b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:52.084897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f5189de-274f-4807-8458-dac7a4919c2b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:52.085694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f5189de-274f-4807-8458-dac7a4919c2b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:52.086116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f5189de-274f-4807-8458-dac7a4919c2b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:52.113420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f5189de-274f-4807-8458-dac7a4919c2b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043208 Apr 11 19:53:52.113958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 497/924] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:52.964083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b027242-2b38-46df-8220-4f0b6703ecc9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:52.965952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b027242-2b38-46df-8220-4f0b6703ecc9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:52.970707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd41d0be-29f4-48c0-bc70-9d026841db87 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:52.972484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd41d0be-29f4-48c0-bc70-9d026841db87 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:52.974152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b027242-2b38-46df-8220-4f0b6703ecc9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:52.974820 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b027242-2b38-46df-8220-4f0b6703ecc9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:52.975582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b027242-2b38-46df-8220-4f0b6703ecc9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:52.976040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b027242-2b38-46df-8220-4f0b6703ecc9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:52.979136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd41d0be-29f4-48c0-bc70-9d026841db87 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:52.979591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd41d0be-29f4-48c0-bc70-9d026841db87 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:52.980389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd41d0be-29f4-48c0-bc70-9d026841db87 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:52.980820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd41d0be-29f4-48c0-bc70-9d026841db87 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:53.007282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b027242-2b38-46df-8220-4f0b6703ecc9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049958 Apr 11 19:53:53.011258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 428/925] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:53.011494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd41d0be-29f4-48c0-bc70-9d026841db87 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047211 Apr 11 19:53:53.011883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 498/926] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:53.127628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b3d7238-89d0-4a08-b85b-62ddf3cf48c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:53.128562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b3d7238-89d0-4a08-b85b-62ddf3cf48c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:53.134992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b3d7238-89d0-4a08-b85b-62ddf3cf48c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:53.135431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b3d7238-89d0-4a08-b85b-62ddf3cf48c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:53.136185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b3d7238-89d0-4a08-b85b-62ddf3cf48c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:53.136620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b3d7238-89d0-4a08-b85b-62ddf3cf48c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:53.164868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b3d7238-89d0-4a08-b85b-62ddf3cf48c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Apr 11 19:53:53.165440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 429/927] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:54.024343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-747a5b34-18b8-4ddb-ac96-ebf2f29ddf30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:54.025562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-747a5b34-18b8-4ddb-ac96-ebf2f29ddf30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:54.025732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c6c24575-2270-4932-9326-41d59d801ecf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:54.026697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c6c24575-2270-4932-9326-41d59d801ecf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:54.033223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-747a5b34-18b8-4ddb-ac96-ebf2f29ddf30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:54.033787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-747a5b34-18b8-4ddb-ac96-ebf2f29ddf30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:54.034745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-747a5b34-18b8-4ddb-ac96-ebf2f29ddf30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:54.034985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6c24575-2270-4932-9326-41d59d801ecf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:54.035288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-747a5b34-18b8-4ddb-ac96-ebf2f29ddf30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:54.035519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6c24575-2270-4932-9326-41d59d801ecf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:54.036421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6c24575-2270-4932-9326-41d59d801ecf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:54.037024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6c24575-2270-4932-9326-41d59d801ecf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:54.068898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-747a5b34-18b8-4ddb-ac96-ebf2f29ddf30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052190 Apr 11 19:53:54.069274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c6c24575-2270-4932-9326-41d59d801ecf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048931 Apr 11 19:53:54.069866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 499/928] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:54.072626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 430/929] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:54.178283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9c184ac2-fa8f-42fb-a762-5105d918d274 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:54.179218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9c184ac2-fa8f-42fb-a762-5105d918d274 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:54.186793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c184ac2-fa8f-42fb-a762-5105d918d274 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:54.187235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c184ac2-fa8f-42fb-a762-5105d918d274 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:54.188090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c184ac2-fa8f-42fb-a762-5105d918d274 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:54.188525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c184ac2-fa8f-42fb-a762-5105d918d274 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:54.221965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9c184ac2-fa8f-42fb-a762-5105d918d274 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047943 Apr 11 19:53:54.222521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 500/930] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:55.085504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6c518bf5-22a3-49d6-92e3-753d02a11456 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:55.086469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6c518bf5-22a3-49d6-92e3-753d02a11456 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:55.087789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0343711d-e661-4995-be8d-aa5c7d2b7305 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:55.089653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0343711d-e661-4995-be8d-aa5c7d2b7305 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:55.096632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c518bf5-22a3-49d6-92e3-753d02a11456 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:55.097432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c518bf5-22a3-49d6-92e3-753d02a11456 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:55.098750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c518bf5-22a3-49d6-92e3-753d02a11456 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:55.099469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c518bf5-22a3-49d6-92e3-753d02a11456 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:55.099718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0343711d-e661-4995-be8d-aa5c7d2b7305 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:55.100433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0343711d-e661-4995-be8d-aa5c7d2b7305 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:55.101744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0343711d-e661-4995-be8d-aa5c7d2b7305 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:55.102560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0343711d-e661-4995-be8d-aa5c7d2b7305 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:55.133990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6c518bf5-22a3-49d6-92e3-753d02a11456 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055866 Apr 11 19:53:55.134755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 431/931] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:55.136687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0343711d-e661-4995-be8d-aa5c7d2b7305 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055507 Apr 11 19:53:55.137361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 501/932] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:55.238730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb0f4109-7ce0-4cea-89ed-530c145e7bef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:55.240206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb0f4109-7ce0-4cea-89ed-530c145e7bef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:55.250884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb0f4109-7ce0-4cea-89ed-530c145e7bef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:55.251489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb0f4109-7ce0-4cea-89ed-530c145e7bef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:55.252287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb0f4109-7ce0-4cea-89ed-530c145e7bef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:55.252713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb0f4109-7ce0-4cea-89ed-530c145e7bef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:55.281885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb0f4109-7ce0-4cea-89ed-530c145e7bef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050536 Apr 11 19:53:55.282495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 432/933] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:56.150540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6a6a031-746a-43ec-b565-86f3f649ce9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:56.151839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e029166c-5a2a-4764-9107-e72219d99fa7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:56.153354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e029166c-5a2a-4764-9107-e72219d99fa7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:56.153642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a6a6a031-746a-43ec-b565-86f3f649ce9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:56.161761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e029166c-5a2a-4764-9107-e72219d99fa7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:56.162105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6a6a031-746a-43ec-b565-86f3f649ce9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:56.162393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e029166c-5a2a-4764-9107-e72219d99fa7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:56.162539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6a6a031-746a-43ec-b565-86f3f649ce9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:56.163180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e029166c-5a2a-4764-9107-e72219d99fa7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:56.163293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6a6a031-746a-43ec-b565-86f3f649ce9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:56.163716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6a6a031-746a-43ec-b565-86f3f649ce9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:56.165818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e029166c-5a2a-4764-9107-e72219d99fa7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:56.195292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a6a6a031-746a-43ec-b565-86f3f649ce9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051504 Apr 11 19:53:56.195869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 502/934] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:56.198961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e029166c-5a2a-4764-9107-e72219d99fa7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053766 Apr 11 19:53:56.199519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 433/935] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:56.297961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac30f1b1-b2e5-4bb3-ae2e-ea5d9f836831 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:56.299096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac30f1b1-b2e5-4bb3-ae2e-ea5d9f836831 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:56.306157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac30f1b1-b2e5-4bb3-ae2e-ea5d9f836831 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:56.306645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac30f1b1-b2e5-4bb3-ae2e-ea5d9f836831 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:56.307488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac30f1b1-b2e5-4bb3-ae2e-ea5d9f836831 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:56.307968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac30f1b1-b2e5-4bb3-ae2e-ea5d9f836831 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:56.338293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac30f1b1-b2e5-4bb3-ae2e-ea5d9f836831 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047043 Apr 11 19:53:56.338811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 503/936] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:57.207711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-001d9a01-5092-43f1-bb0c-d98fb543242d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:57.209662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-001d9a01-5092-43f1-bb0c-d98fb543242d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:57.214122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25fd886e-935e-4f24-bc31-721dc419ccec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:57.215069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25fd886e-935e-4f24-bc31-721dc419ccec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:57.216729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-001d9a01-5092-43f1-bb0c-d98fb543242d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:57.217121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-001d9a01-5092-43f1-bb0c-d98fb543242d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:57.217897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-001d9a01-5092-43f1-bb0c-d98fb543242d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:57.218585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-001d9a01-5092-43f1-bb0c-d98fb543242d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:57.222953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25fd886e-935e-4f24-bc31-721dc419ccec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:57.223472 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25fd886e-935e-4f24-bc31-721dc419ccec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:57.224356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25fd886e-935e-4f24-bc31-721dc419ccec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:57.225047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25fd886e-935e-4f24-bc31-721dc419ccec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:57.251363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-001d9a01-5092-43f1-bb0c-d98fb543242d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048003 Apr 11 19:53:57.252201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 434/937] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:57.265605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25fd886e-935e-4f24-bc31-721dc419ccec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058569 Apr 11 19:53:57.266180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 504/938] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:57.352955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aed5cb38-51cb-4284-a3ee-016a54970baa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:57.353969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aed5cb38-51cb-4284-a3ee-016a54970baa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:57.360178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aed5cb38-51cb-4284-a3ee-016a54970baa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:57.360719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aed5cb38-51cb-4284-a3ee-016a54970baa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:57.361487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aed5cb38-51cb-4284-a3ee-016a54970baa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:57.361924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aed5cb38-51cb-4284-a3ee-016a54970baa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:57.390231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aed5cb38-51cb-4284-a3ee-016a54970baa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041739 Apr 11 19:53:57.390808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 435/939] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:58.264006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50c560e6-acb2-43dd-910a-74a53575a3ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:58.264945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50c560e6-acb2-43dd-910a-74a53575a3ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:58.271815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50c560e6-acb2-43dd-910a-74a53575a3ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:58.272241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50c560e6-acb2-43dd-910a-74a53575a3ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:58.273067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50c560e6-acb2-43dd-910a-74a53575a3ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:58.273514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50c560e6-acb2-43dd-910a-74a53575a3ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:58.278066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f67fa192-18ad-4aaf-9fff-d8673b8f2736 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:58.279019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f67fa192-18ad-4aaf-9fff-d8673b8f2736 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:58.285884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f67fa192-18ad-4aaf-9fff-d8673b8f2736 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:58.288429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f67fa192-18ad-4aaf-9fff-d8673b8f2736 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:58.288429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f67fa192-18ad-4aaf-9fff-d8673b8f2736 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:58.288429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f67fa192-18ad-4aaf-9fff-d8673b8f2736 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:58.315162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50c560e6-acb2-43dd-910a-74a53575a3ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054765 Apr 11 19:53:58.316404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 505/940] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:58.327297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f67fa192-18ad-4aaf-9fff-d8673b8f2736 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053387 Apr 11 19:53:58.328063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 436/941] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:58.403927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a26cc33-1d4e-4e72-a8c5-e1f139e289b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:58.404948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a26cc33-1d4e-4e72-a8c5-e1f139e289b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:58.411763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a26cc33-1d4e-4e72-a8c5-e1f139e289b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:58.412198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a26cc33-1d4e-4e72-a8c5-e1f139e289b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:58.413032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a26cc33-1d4e-4e72-a8c5-e1f139e289b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:58.413459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a26cc33-1d4e-4e72-a8c5-e1f139e289b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:58.442397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a26cc33-1d4e-4e72-a8c5-e1f139e289b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042426 Apr 11 19:53:58.442884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 506/942] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:59.331241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-50108693-666b-48c8-b8ce-788b4835b7ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:59.332190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-50108693-666b-48c8-b8ce-788b4835b7ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:59.340042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3344d71f-b1bf-4855-9315-440696ae187c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:59.340611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50108693-666b-48c8-b8ce-788b4835b7ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:59.340719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50108693-666b-48c8-b8ce-788b4835b7ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:59.341174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3344d71f-b1bf-4855-9315-440696ae187c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:59.341509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50108693-666b-48c8-b8ce-788b4835b7ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:59.342314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50108693-666b-48c8-b8ce-788b4835b7ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:59.351460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3344d71f-b1bf-4855-9315-440696ae187c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:59.352169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3344d71f-b1bf-4855-9315-440696ae187c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:59.353091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3344d71f-b1bf-4855-9315-440696ae187c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:59.353528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3344d71f-b1bf-4855-9315-440696ae187c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:59.374207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-50108693-666b-48c8-b8ce-788b4835b7ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047229 Apr 11 19:53:59.375522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 437/943] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:53:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:53:59.389481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3344d71f-b1bf-4855-9315-440696ae187c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053785 Apr 11 19:53:59.394324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 507/944] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:53:59.454880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9f66b48d-5af9-4306-8da4-4074bcbfd611 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:53:59.455870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9f66b48d-5af9-4306-8da4-4074bcbfd611 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:53:59.463061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f66b48d-5af9-4306-8da4-4074bcbfd611 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:59.463553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f66b48d-5af9-4306-8da4-4074bcbfd611 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:59.464427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f66b48d-5af9-4306-8da4-4074bcbfd611 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:53:59.464939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f66b48d-5af9-4306-8da4-4074bcbfd611 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:53:59.503577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9f66b48d-5af9-4306-8da4-4074bcbfd611 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053442 Apr 11 19:53:59.504480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 438/945] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:53:59 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:00.387723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2f822c04-e831-4552-8f26-a5ae8484cfea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:00.388805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2f822c04-e831-4552-8f26-a5ae8484cfea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:00.396893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f822c04-e831-4552-8f26-a5ae8484cfea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:00.397681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f822c04-e831-4552-8f26-a5ae8484cfea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:00.398907 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f822c04-e831-4552-8f26-a5ae8484cfea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:00.399663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f822c04-e831-4552-8f26-a5ae8484cfea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:00.406567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-407d1f73-5641-4fef-8dd8-e1e968a7f4ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:00.407859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-407d1f73-5641-4fef-8dd8-e1e968a7f4ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:00.415883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-407d1f73-5641-4fef-8dd8-e1e968a7f4ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:00.416675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-407d1f73-5641-4fef-8dd8-e1e968a7f4ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:00.417695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-407d1f73-5641-4fef-8dd8-e1e968a7f4ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:00.418133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-407d1f73-5641-4fef-8dd8-e1e968a7f4ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:00.436084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2f822c04-e831-4552-8f26-a5ae8484cfea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053083 Apr 11 19:54:00.437035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 508/946] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:00.457327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-407d1f73-5641-4fef-8dd8-e1e968a7f4ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058733 Apr 11 19:54:00.457995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 439/947] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:00.518881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd422f80-be15-438c-8a35-91669bba0283 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:00.519997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd422f80-be15-438c-8a35-91669bba0283 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:00.526734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd422f80-be15-438c-8a35-91669bba0283 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:00.527315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd422f80-be15-438c-8a35-91669bba0283 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:00.528189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd422f80-be15-438c-8a35-91669bba0283 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:00.528662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd422f80-be15-438c-8a35-91669bba0283 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:00.560670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd422f80-be15-438c-8a35-91669bba0283 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046385 Apr 11 19:54:00.561397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 509/948] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:01.448841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65170787-12c8-445f-a891-488bc35b4691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:01.449720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65170787-12c8-445f-a891-488bc35b4691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:01.458974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65170787-12c8-445f-a891-488bc35b4691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:01.459426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65170787-12c8-445f-a891-488bc35b4691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:01.460185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65170787-12c8-445f-a891-488bc35b4691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:01.460617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65170787-12c8-445f-a891-488bc35b4691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:01.469114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ab5abde-a734-438b-b402-73e16816115f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:01.470111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ab5abde-a734-438b-b402-73e16816115f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:01.476361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ab5abde-a734-438b-b402-73e16816115f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:01.476827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ab5abde-a734-438b-b402-73e16816115f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:01.477616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ab5abde-a734-438b-b402-73e16816115f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:01.478061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ab5abde-a734-438b-b402-73e16816115f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:01.498174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65170787-12c8-445f-a891-488bc35b4691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053687 Apr 11 19:54:01.502907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 440/949] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:01.509534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ab5abde-a734-438b-b402-73e16816115f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Apr 11 19:54:01.510273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 510/950] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:01.572847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1a07a73f-09d4-46e7-9c01-6447d36b12ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:01.573819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1a07a73f-09d4-46e7-9c01-6447d36b12ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:01.580117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a07a73f-09d4-46e7-9c01-6447d36b12ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:01.580577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a07a73f-09d4-46e7-9c01-6447d36b12ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:01.581374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a07a73f-09d4-46e7-9c01-6447d36b12ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:01.581810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a07a73f-09d4-46e7-9c01-6447d36b12ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:01.610721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1a07a73f-09d4-46e7-9c01-6447d36b12ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041808 Apr 11 19:54:01.611296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 441/951] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:02.510423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a2aac178-df16-40c4-83fb-205ecc085e25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:02.511345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a2aac178-df16-40c4-83fb-205ecc085e25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:02.518736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2aac178-df16-40c4-83fb-205ecc085e25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:02.519438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2aac178-df16-40c4-83fb-205ecc085e25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:02.520318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2aac178-df16-40c4-83fb-205ecc085e25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:02.521944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2aac178-df16-40c4-83fb-205ecc085e25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:02.522094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee86d09f-8209-4b73-bfa0-512be7b83318 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:02.522840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee86d09f-8209-4b73-bfa0-512be7b83318 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:02.530169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee86d09f-8209-4b73-bfa0-512be7b83318 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:02.530169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee86d09f-8209-4b73-bfa0-512be7b83318 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:02.530674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee86d09f-8209-4b73-bfa0-512be7b83318 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:02.531110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee86d09f-8209-4b73-bfa0-512be7b83318 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:02.560976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a2aac178-df16-40c4-83fb-205ecc085e25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054362 Apr 11 19:54:02.561690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 511/952] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:02.563155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee86d09f-8209-4b73-bfa0-512be7b83318 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Apr 11 19:54:02.563895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 442/953] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:02.622682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-477a0dcc-030a-4458-973c-fa6acfbbe362 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:02.623623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-477a0dcc-030a-4458-973c-fa6acfbbe362 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:02.630271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477a0dcc-030a-4458-973c-fa6acfbbe362 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:02.630800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477a0dcc-030a-4458-973c-fa6acfbbe362 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:02.631485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477a0dcc-030a-4458-973c-fa6acfbbe362 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:02.631919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477a0dcc-030a-4458-973c-fa6acfbbe362 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:02.659981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-477a0dcc-030a-4458-973c-fa6acfbbe362 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Apr 11 19:54:02.660663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 512/954] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:03.575396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-35c008c8-b4a8-42f1-b3b8-f3c1015a025d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:03.575993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-02abd4ef-7b11-490e-977c-66780bfd3eb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:03.576358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-35c008c8-b4a8-42f1-b3b8-f3c1015a025d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:03.576896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-02abd4ef-7b11-490e-977c-66780bfd3eb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:03.583049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35c008c8-b4a8-42f1-b3b8-f3c1015a025d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:03.583503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35c008c8-b4a8-42f1-b3b8-f3c1015a025d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:03.584064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02abd4ef-7b11-490e-977c-66780bfd3eb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:03.584283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35c008c8-b4a8-42f1-b3b8-f3c1015a025d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:03.584516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02abd4ef-7b11-490e-977c-66780bfd3eb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:03.584718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35c008c8-b4a8-42f1-b3b8-f3c1015a025d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:03.585313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02abd4ef-7b11-490e-977c-66780bfd3eb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:03.585745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02abd4ef-7b11-490e-977c-66780bfd3eb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:03.616419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-35c008c8-b4a8-42f1-b3b8-f3c1015a025d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045908 Apr 11 19:54:03.617283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 443/955] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:03.618068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-02abd4ef-7b11-490e-977c-66780bfd3eb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Apr 11 19:54:03.618649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 513/956] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:03.671935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9cbcd3e7-1be9-4b68-bfe0-b7791df73b36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:03.672929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9cbcd3e7-1be9-4b68-bfe0-b7791df73b36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:03.679175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cbcd3e7-1be9-4b68-bfe0-b7791df73b36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:03.679624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cbcd3e7-1be9-4b68-bfe0-b7791df73b36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:03.680386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cbcd3e7-1be9-4b68-bfe0-b7791df73b36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:03.680819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cbcd3e7-1be9-4b68-bfe0-b7791df73b36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:03.721954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9cbcd3e7-1be9-4b68-bfe0-b7791df73b36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054081 Apr 11 19:54:03.722526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 444/957] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:04.630354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37b573a7-bc43-4f6c-97d2-470480e61d94 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:04.631287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d3f06370-1a87-40b6-8c45-7b29eaed6982 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:04.631727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37b573a7-bc43-4f6c-97d2-470480e61d94 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:04.632409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d3f06370-1a87-40b6-8c45-7b29eaed6982 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:04.638579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37b573a7-bc43-4f6c-97d2-470480e61d94 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:04.639376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37b573a7-bc43-4f6c-97d2-470480e61d94 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:04.640237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37b573a7-bc43-4f6c-97d2-470480e61d94 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:04.640664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37b573a7-bc43-4f6c-97d2-470480e61d94 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:04.640800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3f06370-1a87-40b6-8c45-7b29eaed6982 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:04.641262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3f06370-1a87-40b6-8c45-7b29eaed6982 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:04.642339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3f06370-1a87-40b6-8c45-7b29eaed6982 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:04.642773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3f06370-1a87-40b6-8c45-7b29eaed6982 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:04.681572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d3f06370-1a87-40b6-8c45-7b29eaed6982 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055636 Apr 11 19:54:04.682495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 514/958] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:04.690519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37b573a7-bc43-4f6c-97d2-470480e61d94 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064111 Apr 11 19:54:04.697638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 445/959] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:04.733908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ddcf636c-fb8e-4e61-ae69-f07e813bde9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:04.734885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ddcf636c-fb8e-4e61-ae69-f07e813bde9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:04.741142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddcf636c-fb8e-4e61-ae69-f07e813bde9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:04.741590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddcf636c-fb8e-4e61-ae69-f07e813bde9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:04.742364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddcf636c-fb8e-4e61-ae69-f07e813bde9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:04.742799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddcf636c-fb8e-4e61-ae69-f07e813bde9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:04.771129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ddcf636c-fb8e-4e61-ae69-f07e813bde9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041327 Apr 11 19:54:04.771660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 515/960] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:05.693957 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-83eb1862-47c9-48a8-9c60-1df03051613c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:05.694877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-83eb1862-47c9-48a8-9c60-1df03051613c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:05.701820 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83eb1862-47c9-48a8-9c60-1df03051613c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:05.702400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83eb1862-47c9-48a8-9c60-1df03051613c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:05.703375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83eb1862-47c9-48a8-9c60-1df03051613c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:05.703863 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83eb1862-47c9-48a8-9c60-1df03051613c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:05.710310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0ecff30-8c83-4cbc-9e5a-d5a443b83d47 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:05.711420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0ecff30-8c83-4cbc-9e5a-d5a443b83d47 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:05.720692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ecff30-8c83-4cbc-9e5a-d5a443b83d47 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:05.721351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ecff30-8c83-4cbc-9e5a-d5a443b83d47 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:05.722478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ecff30-8c83-4cbc-9e5a-d5a443b83d47 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:05.722963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ecff30-8c83-4cbc-9e5a-d5a443b83d47 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:05.735625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-83eb1862-47c9-48a8-9c60-1df03051613c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045727 Apr 11 19:54:05.736666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 446/961] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:05.761456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0ecff30-8c83-4cbc-9e5a-d5a443b83d47 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056637 Apr 11 19:54:05.762180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 516/962] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:05.783860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1be5c5b2-61a4-4ae3-afd8-349ee007d06f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:05.784878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1be5c5b2-61a4-4ae3-afd8-349ee007d06f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:05.791816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be5c5b2-61a4-4ae3-afd8-349ee007d06f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:05.792260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be5c5b2-61a4-4ae3-afd8-349ee007d06f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:05.793059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be5c5b2-61a4-4ae3-afd8-349ee007d06f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:05.793496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be5c5b2-61a4-4ae3-afd8-349ee007d06f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:05.822102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1be5c5b2-61a4-4ae3-afd8-349ee007d06f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 Apr 11 19:54:05.822694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 447/963] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:06.748822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd14e308-8268-4f52-b2ab-aa381ea3e783 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:06.749786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd14e308-8268-4f52-b2ab-aa381ea3e783 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:06.757460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd14e308-8268-4f52-b2ab-aa381ea3e783 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:06.757911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd14e308-8268-4f52-b2ab-aa381ea3e783 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:06.758687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd14e308-8268-4f52-b2ab-aa381ea3e783 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:06.759091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd14e308-8268-4f52-b2ab-aa381ea3e783 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:06.774350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aee958bb-1fff-4073-86e7-818d64ecf15e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:06.775376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aee958bb-1fff-4073-86e7-818d64ecf15e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:06.782867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aee958bb-1fff-4073-86e7-818d64ecf15e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:06.783366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aee958bb-1fff-4073-86e7-818d64ecf15e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:06.784252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aee958bb-1fff-4073-86e7-818d64ecf15e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:06.784677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aee958bb-1fff-4073-86e7-818d64ecf15e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:06.790141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd14e308-8268-4f52-b2ab-aa381ea3e783 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045056 Apr 11 19:54:06.790689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 517/964] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:06.815977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aee958bb-1fff-4073-86e7-818d64ecf15e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046362 Apr 11 19:54:06.816556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 448/965] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:06.836332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91d09640-88f5-4987-b4cd-c08aa0aa8b05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:06.837369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91d09640-88f5-4987-b4cd-c08aa0aa8b05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:06.844517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d09640-88f5-4987-b4cd-c08aa0aa8b05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:06.844971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d09640-88f5-4987-b4cd-c08aa0aa8b05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:06.845809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d09640-88f5-4987-b4cd-c08aa0aa8b05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:06.846410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d09640-88f5-4987-b4cd-c08aa0aa8b05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:06.881749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91d09640-88f5-4987-b4cd-c08aa0aa8b05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051716 Apr 11 19:54:06.882794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 518/966] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:07.802860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ea5f310-3e60-48d1-bf43-75e8d8efe448 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:07.803855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ea5f310-3e60-48d1-bf43-75e8d8efe448 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:07.810978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ea5f310-3e60-48d1-bf43-75e8d8efe448 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:07.811427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ea5f310-3e60-48d1-bf43-75e8d8efe448 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:07.812198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ea5f310-3e60-48d1-bf43-75e8d8efe448 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:07.812631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ea5f310-3e60-48d1-bf43-75e8d8efe448 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:07.828130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cc770f1a-c74a-4152-ae22-a50d95c529c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:07.829279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cc770f1a-c74a-4152-ae22-a50d95c529c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:07.835981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc770f1a-c74a-4152-ae22-a50d95c529c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:07.836419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc770f1a-c74a-4152-ae22-a50d95c529c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:07.837219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc770f1a-c74a-4152-ae22-a50d95c529c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:07.837620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc770f1a-c74a-4152-ae22-a50d95c529c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:07.844062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ea5f310-3e60-48d1-bf43-75e8d8efe448 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045336 Apr 11 19:54:07.844809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 449/967] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:07.867369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cc770f1a-c74a-4152-ae22-a50d95c529c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043445 Apr 11 19:54:07.867975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 519/968] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:07.895358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1c6d8019-1fc9-40da-96ee-ae606f0f6f88 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:07.896452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1c6d8019-1fc9-40da-96ee-ae606f0f6f88 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:07.904155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c6d8019-1fc9-40da-96ee-ae606f0f6f88 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:07.904688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c6d8019-1fc9-40da-96ee-ae606f0f6f88 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:07.905723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c6d8019-1fc9-40da-96ee-ae606f0f6f88 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:07.906269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c6d8019-1fc9-40da-96ee-ae606f0f6f88 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:07.943458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1c6d8019-1fc9-40da-96ee-ae606f0f6f88 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051534 Apr 11 19:54:07.943458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 450/969] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:08.855996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6c669b76-87a3-4efd-b492-63ed007d6bc4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:08.856933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6c669b76-87a3-4efd-b492-63ed007d6bc4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:08.863792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c669b76-87a3-4efd-b492-63ed007d6bc4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:08.864245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c669b76-87a3-4efd-b492-63ed007d6bc4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:08.865045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c669b76-87a3-4efd-b492-63ed007d6bc4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:08.865474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c669b76-87a3-4efd-b492-63ed007d6bc4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:08.879707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94cd5904-9f38-4ef2-af8c-79121afd068f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:08.880646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94cd5904-9f38-4ef2-af8c-79121afd068f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:08.887319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94cd5904-9f38-4ef2-af8c-79121afd068f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:08.887773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94cd5904-9f38-4ef2-af8c-79121afd068f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:08.888567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94cd5904-9f38-4ef2-af8c-79121afd068f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:08.888992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94cd5904-9f38-4ef2-af8c-79121afd068f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:08.899177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6c669b76-87a3-4efd-b492-63ed007d6bc4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046881 Apr 11 19:54:08.900735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 520/970] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:08.920614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94cd5904-9f38-4ef2-af8c-79121afd068f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Apr 11 19:54:08.921160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 451/971] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:08.954147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-39663c8e-9f42-4f7e-bbc1-bfca40551944 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:08.955097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-39663c8e-9f42-4f7e-bbc1-bfca40551944 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:08.961635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39663c8e-9f42-4f7e-bbc1-bfca40551944 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:08.962092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39663c8e-9f42-4f7e-bbc1-bfca40551944 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:08.962885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39663c8e-9f42-4f7e-bbc1-bfca40551944 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:08.963321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39663c8e-9f42-4f7e-bbc1-bfca40551944 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:08.992465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-39663c8e-9f42-4f7e-bbc1-bfca40551944 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Apr 11 19:54:08.993042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 521/972] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:09.911817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db595803-c05f-4578-af0b-5c7ec5a796bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:09.912735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db595803-c05f-4578-af0b-5c7ec5a796bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:09.919432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db595803-c05f-4578-af0b-5c7ec5a796bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:09.919881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db595803-c05f-4578-af0b-5c7ec5a796bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:09.920761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db595803-c05f-4578-af0b-5c7ec5a796bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:09.921118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db595803-c05f-4578-af0b-5c7ec5a796bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:09.932766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2815ed66-2f64-410f-b680-ca11d1c2c3c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:09.933899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2815ed66-2f64-410f-b680-ca11d1c2c3c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:09.941297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2815ed66-2f64-410f-b680-ca11d1c2c3c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:09.942129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2815ed66-2f64-410f-b680-ca11d1c2c3c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:09.942889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2815ed66-2f64-410f-b680-ca11d1c2c3c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:09.943322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2815ed66-2f64-410f-b680-ca11d1c2c3c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:09.955314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db595803-c05f-4578-af0b-5c7ec5a796bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047697 Apr 11 19:54:09.956244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 452/973] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:09.976578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2815ed66-2f64-410f-b680-ca11d1c2c3c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048224 Apr 11 19:54:09.977602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 522/974] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:10.004563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-01a2bd8d-c415-4d7f-9935-d0c8389fcacc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:10.005546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-01a2bd8d-c415-4d7f-9935-d0c8389fcacc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:10.011858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01a2bd8d-c415-4d7f-9935-d0c8389fcacc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:10.012331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01a2bd8d-c415-4d7f-9935-d0c8389fcacc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:10.013409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01a2bd8d-c415-4d7f-9935-d0c8389fcacc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:10.014021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01a2bd8d-c415-4d7f-9935-d0c8389fcacc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:10.045268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-01a2bd8d-c415-4d7f-9935-d0c8389fcacc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Apr 11 19:54:10.045830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 453/975] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:10.968437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9790e2e1-db1c-4cb7-bc9a-1211aca06d1d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:10.969581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9790e2e1-db1c-4cb7-bc9a-1211aca06d1d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:10.977816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9790e2e1-db1c-4cb7-bc9a-1211aca06d1d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:10.978361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9790e2e1-db1c-4cb7-bc9a-1211aca06d1d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:10.979260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9790e2e1-db1c-4cb7-bc9a-1211aca06d1d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:10.979874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9790e2e1-db1c-4cb7-bc9a-1211aca06d1d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:10.990573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8414ec6d-f4b7-4f60-8ec7-8b21195c10f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:10.991508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8414ec6d-f4b7-4f60-8ec7-8b21195c10f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:10.998282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8414ec6d-f4b7-4f60-8ec7-8b21195c10f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:10.998763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8414ec6d-f4b7-4f60-8ec7-8b21195c10f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:10.999690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8414ec6d-f4b7-4f60-8ec7-8b21195c10f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:11.000466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8414ec6d-f4b7-4f60-8ec7-8b21195c10f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:11.019289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9790e2e1-db1c-4cb7-bc9a-1211aca06d1d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055445 Apr 11 19:54:11.020498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 523/976] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:11.040083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8414ec6d-f4b7-4f60-8ec7-8b21195c10f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053737 Apr 11 19:54:11.040659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 454/977] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:11.060059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-216d5bca-0899-481f-abe4-3633a8590da0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:11.061199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-216d5bca-0899-481f-abe4-3633a8590da0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:11.068207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216d5bca-0899-481f-abe4-3633a8590da0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:11.068741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216d5bca-0899-481f-abe4-3633a8590da0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:11.069783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216d5bca-0899-481f-abe4-3633a8590da0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:11.070318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216d5bca-0899-481f-abe4-3633a8590da0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:11.105887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-216d5bca-0899-481f-abe4-3633a8590da0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051647 Apr 11 19:54:11.106506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 524/978] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:12.032409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5fbde26c-1129-4e20-ae86-49f4466c7c20 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:12.033380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5fbde26c-1129-4e20-ae86-49f4466c7c20 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:12.040288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fbde26c-1129-4e20-ae86-49f4466c7c20 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:12.040821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fbde26c-1129-4e20-ae86-49f4466c7c20 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:12.041623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fbde26c-1129-4e20-ae86-49f4466c7c20 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:12.042057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fbde26c-1129-4e20-ae86-49f4466c7c20 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:12.051749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e987d733-e05c-4b0e-ae08-f996d2a95913 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:12.052734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e987d733-e05c-4b0e-ae08-f996d2a95913 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:12.059636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e987d733-e05c-4b0e-ae08-f996d2a95913 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:12.060068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e987d733-e05c-4b0e-ae08-f996d2a95913 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:12.060849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e987d733-e05c-4b0e-ae08-f996d2a95913 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:12.061338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e987d733-e05c-4b0e-ae08-f996d2a95913 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:12.077831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5fbde26c-1129-4e20-ae86-49f4466c7c20 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049443 Apr 11 19:54:12.078411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 455/979] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:12.091452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e987d733-e05c-4b0e-ae08-f996d2a95913 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 Apr 11 19:54:12.091856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 525/980] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:12.119215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-daafa4a5-fdb1-41ab-9661-fad6ad7ea336 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:12.120445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-daafa4a5-fdb1-41ab-9661-fad6ad7ea336 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:12.128644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-daafa4a5-fdb1-41ab-9661-fad6ad7ea336 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:12.129284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-daafa4a5-fdb1-41ab-9661-fad6ad7ea336 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:12.130326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-daafa4a5-fdb1-41ab-9661-fad6ad7ea336 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:12.130884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-daafa4a5-fdb1-41ab-9661-fad6ad7ea336 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:12.170040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-daafa4a5-fdb1-41ab-9661-fad6ad7ea336 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055094 Apr 11 19:54:12.170813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 456/981] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:13.090213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3919c29-2668-431b-b402-6e2645bf1949 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:13.091258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3919c29-2668-431b-b402-6e2645bf1949 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:13.098981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3919c29-2668-431b-b402-6e2645bf1949 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:13.099546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3919c29-2668-431b-b402-6e2645bf1949 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:13.100514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3919c29-2668-431b-b402-6e2645bf1949 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:13.101125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3919c29-2668-431b-b402-6e2645bf1949 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:13.105696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-80dfa30c-dd86-413f-ab9b-92a91e5e02a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:13.106637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-80dfa30c-dd86-413f-ab9b-92a91e5e02a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:13.115025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80dfa30c-dd86-413f-ab9b-92a91e5e02a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:13.115436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80dfa30c-dd86-413f-ab9b-92a91e5e02a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:13.116237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80dfa30c-dd86-413f-ab9b-92a91e5e02a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:13.116681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80dfa30c-dd86-413f-ab9b-92a91e5e02a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:13.132382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3919c29-2668-431b-b402-6e2645bf1949 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046792 Apr 11 19:54:13.133203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 526/982] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:13.156192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-80dfa30c-dd86-413f-ab9b-92a91e5e02a4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054527 Apr 11 19:54:13.156765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 457/983] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:13.182285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59ac855b-d30b-480b-8cb0-b4c6fb29db1c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:13.183137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59ac855b-d30b-480b-8cb0-b4c6fb29db1c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:13.189392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59ac855b-d30b-480b-8cb0-b4c6fb29db1c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:13.189832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59ac855b-d30b-480b-8cb0-b4c6fb29db1c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:13.190551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59ac855b-d30b-480b-8cb0-b4c6fb29db1c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:13.191001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59ac855b-d30b-480b-8cb0-b4c6fb29db1c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:13.219739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59ac855b-d30b-480b-8cb0-b4c6fb29db1c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041514 Apr 11 19:54:13.220320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 527/984] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:14.144753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d7da6b02-e0b5-48f5-b220-4b8ade299c1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:14.145684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d7da6b02-e0b5-48f5-b220-4b8ade299c1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:14.152521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7da6b02-e0b5-48f5-b220-4b8ade299c1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:14.153089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7da6b02-e0b5-48f5-b220-4b8ade299c1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:14.153913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7da6b02-e0b5-48f5-b220-4b8ade299c1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:14.154386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7da6b02-e0b5-48f5-b220-4b8ade299c1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:14.168742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4917c9d-a974-4ffe-b747-2f83dfdeab3a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:14.169684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4917c9d-a974-4ffe-b747-2f83dfdeab3a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:14.176934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4917c9d-a974-4ffe-b747-2f83dfdeab3a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:14.177364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4917c9d-a974-4ffe-b747-2f83dfdeab3a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:14.178104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4917c9d-a974-4ffe-b747-2f83dfdeab3a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:14.178563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4917c9d-a974-4ffe-b747-2f83dfdeab3a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:14.197197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d7da6b02-e0b5-48f5-b220-4b8ade299c1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056321 Apr 11 19:54:14.201824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 458/985] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:14.216253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4917c9d-a974-4ffe-b747-2f83dfdeab3a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052427 Apr 11 19:54:14.216936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 528/986] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:14.231593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16d7086c-13ec-4204-a6cd-b17e5434ffe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:14.232617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16d7086c-13ec-4204-a6cd-b17e5434ffe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:14.239610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16d7086c-13ec-4204-a6cd-b17e5434ffe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:14.240296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16d7086c-13ec-4204-a6cd-b17e5434ffe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:14.241686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16d7086c-13ec-4204-a6cd-b17e5434ffe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:14.242353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16d7086c-13ec-4204-a6cd-b17e5434ffe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:14.274661 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16d7086c-13ec-4204-a6cd-b17e5434ffe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Apr 11 19:54:14.275225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 459/987] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:15.210999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-71e9842c-8e31-4a95-9eed-e62c03fd668d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:15.211931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-71e9842c-8e31-4a95-9eed-e62c03fd668d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:15.219101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71e9842c-8e31-4a95-9eed-e62c03fd668d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:15.219551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71e9842c-8e31-4a95-9eed-e62c03fd668d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:15.220324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71e9842c-8e31-4a95-9eed-e62c03fd668d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:15.220767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71e9842c-8e31-4a95-9eed-e62c03fd668d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:15.229358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d4a97283-9ae4-4e76-86b5-89735b26bf3b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:15.230598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d4a97283-9ae4-4e76-86b5-89735b26bf3b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:15.237641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4a97283-9ae4-4e76-86b5-89735b26bf3b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:15.238183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4a97283-9ae4-4e76-86b5-89735b26bf3b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:15.239197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4a97283-9ae4-4e76-86b5-89735b26bf3b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:15.239610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4a97283-9ae4-4e76-86b5-89735b26bf3b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:15.267052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-71e9842c-8e31-4a95-9eed-e62c03fd668d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060899 Apr 11 19:54:15.268503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 529/988] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:15.275552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d4a97283-9ae4-4e76-86b5-89735b26bf3b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051221 Apr 11 19:54:15.276173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 460/989] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:15.293675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-415963cc-2312-427b-a210-856d5b5b1c2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:15.295427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-415963cc-2312-427b-a210-856d5b5b1c2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:15.303021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415963cc-2312-427b-a210-856d5b5b1c2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:15.303491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415963cc-2312-427b-a210-856d5b5b1c2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:15.304359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415963cc-2312-427b-a210-856d5b5b1c2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:15.304830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415963cc-2312-427b-a210-856d5b5b1c2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:15.333692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-415963cc-2312-427b-a210-856d5b5b1c2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048602 Apr 11 19:54:15.334263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 530/990] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:16.283529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e4b4e82-2e04-49c7-a587-7891743bd0d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:16.284641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9e4b4e82-2e04-49c7-a587-7891743bd0d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:16.289409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6c39d7a6-69d2-44f8-9d3a-33bd1a55c83f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:16.290366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6c39d7a6-69d2-44f8-9d3a-33bd1a55c83f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:16.291758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4b4e82-2e04-49c7-a587-7891743bd0d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:16.292211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4b4e82-2e04-49c7-a587-7891743bd0d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:16.293057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4b4e82-2e04-49c7-a587-7891743bd0d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:16.293481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4b4e82-2e04-49c7-a587-7891743bd0d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:16.296648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c39d7a6-69d2-44f8-9d3a-33bd1a55c83f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:16.297110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c39d7a6-69d2-44f8-9d3a-33bd1a55c83f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:16.297907 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c39d7a6-69d2-44f8-9d3a-33bd1a55c83f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:16.298319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c39d7a6-69d2-44f8-9d3a-33bd1a55c83f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:16.323713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e4b4e82-2e04-49c7-a587-7891743bd0d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044822 Apr 11 19:54:16.324525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 461/991] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:16.328433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6c39d7a6-69d2-44f8-9d3a-33bd1a55c83f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Apr 11 19:54:16.329019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 531/992] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:16.345728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d5d5083f-190a-4703-b572-baf64596e61d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:16.346686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d5d5083f-190a-4703-b572-baf64596e61d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:16.352709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5d5083f-190a-4703-b572-baf64596e61d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:16.353185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5d5083f-190a-4703-b572-baf64596e61d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:16.353952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5d5083f-190a-4703-b572-baf64596e61d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:16.354386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5d5083f-190a-4703-b572-baf64596e61d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:16.384245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d5d5083f-190a-4703-b572-baf64596e61d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Apr 11 19:54:16.384802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 462/993] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:17.336812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d965cfb-c5cb-44a1-b91d-04f99691b270 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:17.337633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d965cfb-c5cb-44a1-b91d-04f99691b270 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:17.340110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-80e92991-cf91-49f8-9f43-2376da3e9d7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:17.341062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-80e92991-cf91-49f8-9f43-2376da3e9d7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:17.344137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d965cfb-c5cb-44a1-b91d-04f99691b270 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.344615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d965cfb-c5cb-44a1-b91d-04f99691b270 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.345406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d965cfb-c5cb-44a1-b91d-04f99691b270 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.345832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d965cfb-c5cb-44a1-b91d-04f99691b270 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.347573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80e92991-cf91-49f8-9f43-2376da3e9d7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.348023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80e92991-cf91-49f8-9f43-2376da3e9d7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.348787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80e92991-cf91-49f8-9f43-2376da3e9d7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.349244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80e92991-cf91-49f8-9f43-2376da3e9d7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.375829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d965cfb-c5cb-44a1-b91d-04f99691b270 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043256 Apr 11 19:54:17.376732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 532/994] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:17.385888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-80e92991-cf91-49f8-9f43-2376da3e9d7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049585 Apr 11 19:54:17.386450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 463/995] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:17.396022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dee4694e-8af8-4d27-98da-c2ef970a494c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:17.396974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dee4694e-8af8-4d27-98da-c2ef970a494c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:17.403296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dee4694e-8af8-4d27-98da-c2ef970a494c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.403742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dee4694e-8af8-4d27-98da-c2ef970a494c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.404509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dee4694e-8af8-4d27-98da-c2ef970a494c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.404968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dee4694e-8af8-4d27-98da-c2ef970a494c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.432728 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dee4694e-8af8-4d27-98da-c2ef970a494c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040548 Apr 11 19:54:17.433324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 533/996] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:17.810977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-885b3ee5-5041-4c3c-83e2-2919d1538509 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:17.811620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-885b3ee5-5041-4c3c-83e2-2919d1538509 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:17.818443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-885b3ee5-5041-4c3c-83e2-2919d1538509 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.818891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-885b3ee5-5041-4c3c-83e2-2919d1538509 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.820185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-885b3ee5-5041-4c3c-83e2-2919d1538509 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.820185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-885b3ee5-5041-4c3c-83e2-2919d1538509 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.845448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-885b3ee5-5041-4c3c-83e2-2919d1538509 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 19:54:17.923342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-885b3ee5-5041-4c3c-83e2-2919d1538509 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 204 len: 0 microversion: 2.1 time: 0.116410 Apr 11 19:54:17.923965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 464/997] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 19:54:17 2022] DELETE /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:54:17.932594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ac5750b-173a-4738-9e46-9cc55fd1bff2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:17.933232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ac5750b-173a-4738-9e46-9cc55fd1bff2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:17.939033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ac5750b-173a-4738-9e46-9cc55fd1bff2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.939489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ac5750b-173a-4738-9e46-9cc55fd1bff2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:17.940256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ac5750b-173a-4738-9e46-9cc55fd1bff2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:17.940666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ac5750b-173a-4738-9e46-9cc55fd1bff2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:18.075642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ac5750b-173a-4738-9e46-9cc55fd1bff2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:18.083269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ac5750b-173a-4738-9e46-9cc55fd1bff2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1575 microversion: 2.1 time: 0.154649 Apr 11 19:54:18.083824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 534/998] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:17 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:18.389620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-90e4dbd2-1727-4fa1-bbf8-1dba6676901b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:18.390859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-90e4dbd2-1727-4fa1-bbf8-1dba6676901b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:18.398710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-440c6ee1-6d47-4a6e-93fc-193b642bde80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:18.400410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-440c6ee1-6d47-4a6e-93fc-193b642bde80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:18.401377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90e4dbd2-1727-4fa1-bbf8-1dba6676901b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:18.401798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90e4dbd2-1727-4fa1-bbf8-1dba6676901b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:18.402648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90e4dbd2-1727-4fa1-bbf8-1dba6676901b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:18.403088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90e4dbd2-1727-4fa1-bbf8-1dba6676901b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:18.408186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-440c6ee1-6d47-4a6e-93fc-193b642bde80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:18.408851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-440c6ee1-6d47-4a6e-93fc-193b642bde80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:18.409678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-440c6ee1-6d47-4a6e-93fc-193b642bde80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:18.410147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-440c6ee1-6d47-4a6e-93fc-193b642bde80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:18.438520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-90e4dbd2-1727-4fa1-bbf8-1dba6676901b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051804 Apr 11 19:54:18.438520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 465/999] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:18.444045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-440c6ee1-6d47-4a6e-93fc-193b642bde80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049979 Apr 11 19:54:18.444881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 535/1000] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:18.448240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-71d3cd66-51e2-4989-a40e-85fe8e570f4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:18.449664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-71d3cd66-51e2-4989-a40e-85fe8e570f4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:18.456444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71d3cd66-51e2-4989-a40e-85fe8e570f4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:18.457027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71d3cd66-51e2-4989-a40e-85fe8e570f4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:18.457942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71d3cd66-51e2-4989-a40e-85fe8e570f4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:18.458471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71d3cd66-51e2-4989-a40e-85fe8e570f4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:18.492738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-71d3cd66-51e2-4989-a40e-85fe8e570f4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049211 Apr 11 19:54:18.493411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 466/1001] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:19.101999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab33ef22-643e-4af4-bb06-48c62d3f257f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:19.102600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab33ef22-643e-4af4-bb06-48c62d3f257f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:19.108719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab33ef22-643e-4af4-bb06-48c62d3f257f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:19.109199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab33ef22-643e-4af4-bb06-48c62d3f257f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:19.110014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab33ef22-643e-4af4-bb06-48c62d3f257f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:19.110498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab33ef22-643e-4af4-bb06-48c62d3f257f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:19.246034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab33ef22-643e-4af4-bb06-48c62d3f257f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:19.254224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab33ef22-643e-4af4-bb06-48c62d3f257f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1575 microversion: 2.1 time: 0.156211 Apr 11 19:54:19.254792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 536/1002] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:19 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:19.450777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-182802af-c903-46f7-90c9-e9113b4ed53e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:19.452479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-182802af-c903-46f7-90c9-e9113b4ed53e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:19.455956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d73e30e5-e16e-401a-a9a3-04dc4d9c4f20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:19.456883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d73e30e5-e16e-401a-a9a3-04dc4d9c4f20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:19.459656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-182802af-c903-46f7-90c9-e9113b4ed53e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:19.460259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-182802af-c903-46f7-90c9-e9113b4ed53e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:19.461237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-182802af-c903-46f7-90c9-e9113b4ed53e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:19.461684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-182802af-c903-46f7-90c9-e9113b4ed53e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:19.464083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d73e30e5-e16e-401a-a9a3-04dc4d9c4f20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:19.465012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d73e30e5-e16e-401a-a9a3-04dc4d9c4f20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:19.466033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d73e30e5-e16e-401a-a9a3-04dc4d9c4f20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:19.467094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d73e30e5-e16e-401a-a9a3-04dc4d9c4f20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:19.498040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-182802af-c903-46f7-90c9-e9113b4ed53e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051661 Apr 11 19:54:19.499353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 467/1003] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:19.503061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d73e30e5-e16e-401a-a9a3-04dc4d9c4f20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050908 Apr 11 19:54:19.505616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8fcb9b3-d415-4d5f-85c3-85927decbf80 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:19.506961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8fcb9b3-d415-4d5f-85c3-85927decbf80 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:19.507186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 537/1004] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:19.514313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8fcb9b3-d415-4d5f-85c3-85927decbf80 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:19.514803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8fcb9b3-d415-4d5f-85c3-85927decbf80 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:19.515747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8fcb9b3-d415-4d5f-85c3-85927decbf80 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:19.516285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8fcb9b3-d415-4d5f-85c3-85927decbf80 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:19.547633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8fcb9b3-d415-4d5f-85c3-85927decbf80 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Apr 11 19:54:19.548201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 468/1005] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:20.275450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ec755ae-d656-4fc0-b3be-80ad1fa3800d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:20.276078 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ec755ae-d656-4fc0-b3be-80ad1fa3800d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:20.282675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ec755ae-d656-4fc0-b3be-80ad1fa3800d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.285263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ec755ae-d656-4fc0-b3be-80ad1fa3800d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.286114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ec755ae-d656-4fc0-b3be-80ad1fa3800d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.286551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ec755ae-d656-4fc0-b3be-80ad1fa3800d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.359010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ec755ae-d656-4fc0-b3be-80ad1fa3800d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:20.368123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ec755ae-d656-4fc0-b3be-80ad1fa3800d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1508 microversion: 2.1 time: 0.100038 Apr 11 19:54:20.378845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 538/1006] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:20 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1508 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:20.406125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-43f1171e-f0f4-4a76-a3b3-b6656773b89a req-ef111ec5-8830-468d-aa72-0b799cf8b8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2485fb-c412-422f-84b0-26e9200f5940", "name": "network-vif-deleted", "tag": "38b4cc6e-f072-46cf-a68a-a3af8cc3637a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:54:20.416372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-43f1171e-f0f4-4a76-a3b3-b6656773b89a req-ef111ec5-8830-468d-aa72-0b799cf8b8f6 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.417110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-43f1171e-f0f4-4a76-a3b3-b6656773b89a req-ef111ec5-8830-468d-aa72-0b799cf8b8f6 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.431460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-43f1171e-f0f4-4a76-a3b3-b6656773b89a req-ef111ec5-8830-468d-aa72-0b799cf8b8f6 service nova] Creating event network-vif-deleted:38b4cc6e-f072-46cf-a68a-a3af8cc3637a for instance 2b2485fb-c412-422f-84b0-26e9200f5940 on hv-cinder-83078 Apr 11 19:54:20.437208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-43f1171e-f0f4-4a76-a3b3-b6656773b89a req-ef111ec5-8830-468d-aa72-0b799cf8b8f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121591 Apr 11 19:54:20.438134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 469/1007] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:20.511408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6caee41e-cc5e-454a-82c5-4436b20cd579 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:20.512861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6caee41e-cc5e-454a-82c5-4436b20cd579 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:20.516183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b64d2918-ba1e-4bf9-9754-3b31848d59d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:20.517236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b64d2918-ba1e-4bf9-9754-3b31848d59d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:20.522376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6caee41e-cc5e-454a-82c5-4436b20cd579 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.523080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6caee41e-cc5e-454a-82c5-4436b20cd579 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.524017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6caee41e-cc5e-454a-82c5-4436b20cd579 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.524610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b64d2918-ba1e-4bf9-9754-3b31848d59d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.524749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6caee41e-cc5e-454a-82c5-4436b20cd579 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.525090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b64d2918-ba1e-4bf9-9754-3b31848d59d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.526074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b64d2918-ba1e-4bf9-9754-3b31848d59d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.526682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b64d2918-ba1e-4bf9-9754-3b31848d59d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.559067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6caee41e-cc5e-454a-82c5-4436b20cd579 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051832 Apr 11 19:54:20.561070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 539/1008] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:20.561217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b64d2918-ba1e-4bf9-9754-3b31848d59d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049250 Apr 11 19:54:20.562107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 470/1009] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:20.565171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5402d417-524c-4a15-a3aa-848c9df9a34d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:20.566090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5402d417-524c-4a15-a3aa-848c9df9a34d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:20.572136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5402d417-524c-4a15-a3aa-848c9df9a34d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.572805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5402d417-524c-4a15-a3aa-848c9df9a34d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.573593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5402d417-524c-4a15-a3aa-848c9df9a34d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:20.574014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5402d417-524c-4a15-a3aa-848c9df9a34d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:20.604028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5402d417-524c-4a15-a3aa-848c9df9a34d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042463 Apr 11 19:54:20.604476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 540/1010] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:21.387164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c7c1963-c1de-4626-8f0d-5040922da4d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:21.387906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c7c1963-c1de-4626-8f0d-5040922da4d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:21.394876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c7c1963-c1de-4626-8f0d-5040922da4d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:21.395545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c7c1963-c1de-4626-8f0d-5040922da4d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:21.396531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c7c1963-c1de-4626-8f0d-5040922da4d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:21.397135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c7c1963-c1de-4626-8f0d-5040922da4d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:21.466589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c7c1963-c1de-4626-8f0d-5040922da4d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:21.476237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c7c1963-c1de-4626-8f0d-5040922da4d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093323 Apr 11 19:54:21.476949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 471/1011] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:21 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:21.573220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e0f7ac5-0df7-415a-aaf4-02a7234b1fe6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:21.573886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-488096e5-8279-490b-80d2-d26d4dedc0e4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:21.574419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e0f7ac5-0df7-415a-aaf4-02a7234b1fe6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:21.574759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-488096e5-8279-490b-80d2-d26d4dedc0e4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:21.580976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e0f7ac5-0df7-415a-aaf4-02a7234b1fe6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:21.581367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-488096e5-8279-490b-80d2-d26d4dedc0e4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:21.581583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e0f7ac5-0df7-415a-aaf4-02a7234b1fe6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:21.581843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-488096e5-8279-490b-80d2-d26d4dedc0e4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:21.582210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e0f7ac5-0df7-415a-aaf4-02a7234b1fe6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:21.582601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-488096e5-8279-490b-80d2-d26d4dedc0e4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:21.582746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e0f7ac5-0df7-415a-aaf4-02a7234b1fe6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:21.583026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-488096e5-8279-490b-80d2-d26d4dedc0e4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:21.612520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e0f7ac5-0df7-415a-aaf4-02a7234b1fe6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Apr 11 19:54:21.613131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 541/1012] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:21.613730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-488096e5-8279-490b-80d2-d26d4dedc0e4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043699 Apr 11 19:54:21.617882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 472/1013] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:21.618050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73905906-9ac0-463d-8112-3a29eb3c3365 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:21.619015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73905906-9ac0-463d-8112-3a29eb3c3365 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:21.625575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73905906-9ac0-463d-8112-3a29eb3c3365 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:21.626020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73905906-9ac0-463d-8112-3a29eb3c3365 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:21.626784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73905906-9ac0-463d-8112-3a29eb3c3365 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:21.627212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73905906-9ac0-463d-8112-3a29eb3c3365 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:21.654718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73905906-9ac0-463d-8112-3a29eb3c3365 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040577 Apr 11 19:54:21.655265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 542/1014] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:22.493593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16374edd-1be0-418e-8d2b-3c5acaaeee0a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:22.494364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16374edd-1be0-418e-8d2b-3c5acaaeee0a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:22.501780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16374edd-1be0-418e-8d2b-3c5acaaeee0a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:22.502230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16374edd-1be0-418e-8d2b-3c5acaaeee0a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:22.503193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16374edd-1be0-418e-8d2b-3c5acaaeee0a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:22.503630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16374edd-1be0-418e-8d2b-3c5acaaeee0a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:22.571337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16374edd-1be0-418e-8d2b-3c5acaaeee0a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:22.581334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16374edd-1be0-418e-8d2b-3c5acaaeee0a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.091536 Apr 11 19:54:22.582029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 473/1015] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:22 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:22.627048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f650a26b-cee2-43fd-8252-5153668d4cac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:22.627507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ea4cea05-d1bc-4704-bf5c-9794f0dd847b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:22.628060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f650a26b-cee2-43fd-8252-5153668d4cac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:22.628451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ea4cea05-d1bc-4704-bf5c-9794f0dd847b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:22.634418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f650a26b-cee2-43fd-8252-5153668d4cac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:22.634869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f650a26b-cee2-43fd-8252-5153668d4cac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:22.635080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea4cea05-d1bc-4704-bf5c-9794f0dd847b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:22.635820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea4cea05-d1bc-4704-bf5c-9794f0dd847b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:22.636092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f650a26b-cee2-43fd-8252-5153668d4cac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:22.636092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f650a26b-cee2-43fd-8252-5153668d4cac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:22.637272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea4cea05-d1bc-4704-bf5c-9794f0dd847b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:22.638031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea4cea05-d1bc-4704-bf5c-9794f0dd847b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:22.667231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f650a26b-cee2-43fd-8252-5153668d4cac tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Apr 11 19:54:22.667801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 474/1016] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:22.672720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f1da997-5214-47f3-ab4f-dfde54465838 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:22.673672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f1da997-5214-47f3-ab4f-dfde54465838 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:22.674127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ea4cea05-d1bc-4704-bf5c-9794f0dd847b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051845 Apr 11 19:54:22.674697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 543/1017] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:22.679702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f1da997-5214-47f3-ab4f-dfde54465838 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:22.680149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f1da997-5214-47f3-ab4f-dfde54465838 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:22.680931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f1da997-5214-47f3-ab4f-dfde54465838 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:22.681377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f1da997-5214-47f3-ab4f-dfde54465838 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:22.709424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f1da997-5214-47f3-ab4f-dfde54465838 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040576 Apr 11 19:54:22.710043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 475/1018] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:23.599884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-905bc015-2bd8-4526-907a-e1e072f971d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:23.600647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-905bc015-2bd8-4526-907a-e1e072f971d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:23.607306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-905bc015-2bd8-4526-907a-e1e072f971d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:23.607745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-905bc015-2bd8-4526-907a-e1e072f971d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:23.608499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-905bc015-2bd8-4526-907a-e1e072f971d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:23.608938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-905bc015-2bd8-4526-907a-e1e072f971d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:23.675849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-905bc015-2bd8-4526-907a-e1e072f971d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:23.679960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8da92382-ff71-442e-8e6b-5f3a62b60a58 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:23.681124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8da92382-ff71-442e-8e6b-5f3a62b60a58 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:23.683904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-905bc015-2bd8-4526-907a-e1e072f971d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087984 Apr 11 19:54:23.684537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 544/1019] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:23 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:23.688358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8da92382-ff71-442e-8e6b-5f3a62b60a58 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:23.689302 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8da92382-ff71-442e-8e6b-5f3a62b60a58 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:23.689481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-108d1645-1267-4390-abe1-080f7a5aae4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:23.690174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8da92382-ff71-442e-8e6b-5f3a62b60a58 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:23.690320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-108d1645-1267-4390-abe1-080f7a5aae4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:23.690645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8da92382-ff71-442e-8e6b-5f3a62b60a58 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:23.696636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-108d1645-1267-4390-abe1-080f7a5aae4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:23.697115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-108d1645-1267-4390-abe1-080f7a5aae4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:23.697851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-108d1645-1267-4390-abe1-080f7a5aae4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:23.698273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-108d1645-1267-4390-abe1-080f7a5aae4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:23.724541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8da92382-ff71-442e-8e6b-5f3a62b60a58 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049022 Apr 11 19:54:23.725025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 476/1020] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:23.728299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-108d1645-1267-4390-abe1-080f7a5aae4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042663 Apr 11 19:54:23.729095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 545/1021] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:23.729886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-285f917f-3206-4d6c-aa90-2279c5c8aca6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:23.730801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-285f917f-3206-4d6c-aa90-2279c5c8aca6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:23.736829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-285f917f-3206-4d6c-aa90-2279c5c8aca6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:23.737313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-285f917f-3206-4d6c-aa90-2279c5c8aca6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:23.738116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-285f917f-3206-4d6c-aa90-2279c5c8aca6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:23.738551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-285f917f-3206-4d6c-aa90-2279c5c8aca6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:23.768125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-285f917f-3206-4d6c-aa90-2279c5c8aca6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Apr 11 19:54:23.768692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 477/1022] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:24.701628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b3457f07-2c50-41b9-9f56-72d80a41fc86 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:24.702295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b3457f07-2c50-41b9-9f56-72d80a41fc86 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:24.709128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3457f07-2c50-41b9-9f56-72d80a41fc86 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:24.709590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3457f07-2c50-41b9-9f56-72d80a41fc86 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:24.710427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3457f07-2c50-41b9-9f56-72d80a41fc86 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:24.710859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3457f07-2c50-41b9-9f56-72d80a41fc86 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:24.736082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fac468f2-f6b7-436e-9182-0e415eb8244f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:24.737369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fac468f2-f6b7-436e-9182-0e415eb8244f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:24.744222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fac468f2-f6b7-436e-9182-0e415eb8244f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:24.744582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fac468f2-f6b7-436e-9182-0e415eb8244f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:24.745498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fac468f2-f6b7-436e-9182-0e415eb8244f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:24.745936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fac468f2-f6b7-436e-9182-0e415eb8244f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:24.776530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fac468f2-f6b7-436e-9182-0e415eb8244f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044583 Apr 11 19:54:24.777166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 478/1023] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:24.778284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b3457f07-2c50-41b9-9f56-72d80a41fc86 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:24.781788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-98447421-0ed7-4da8-9fd2-c0cdd8570ce3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:24.782724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-98447421-0ed7-4da8-9fd2-c0cdd8570ce3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:24.786636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b3457f07-2c50-41b9-9f56-72d80a41fc86 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088952 Apr 11 19:54:24.787200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 546/1024] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:24 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:24.788669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98447421-0ed7-4da8-9fd2-c0cdd8570ce3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:24.789151 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98447421-0ed7-4da8-9fd2-c0cdd8570ce3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:24.790017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98447421-0ed7-4da8-9fd2-c0cdd8570ce3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:24.790360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98447421-0ed7-4da8-9fd2-c0cdd8570ce3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:24.792152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9e3f47f-9556-455d-86de-d5115ffb8677 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:24.793339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9e3f47f-9556-455d-86de-d5115ffb8677 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:24.800687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e3f47f-9556-455d-86de-d5115ffb8677 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:24.801164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e3f47f-9556-455d-86de-d5115ffb8677 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:24.801940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e3f47f-9556-455d-86de-d5115ffb8677 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:24.802370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e3f47f-9556-455d-86de-d5115ffb8677 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:24.819427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-98447421-0ed7-4da8-9fd2-c0cdd8570ce3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041203 Apr 11 19:54:24.820003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 479/1025] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:24.833834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9e3f47f-9556-455d-86de-d5115ffb8677 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045478 Apr 11 19:54:24.834505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 547/1026] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:25.789201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20af0baa-4b04-4b7a-bf72-a90ff5d9010e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:25.790130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-20af0baa-4b04-4b7a-bf72-a90ff5d9010e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:25.796858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20af0baa-4b04-4b7a-bf72-a90ff5d9010e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:25.797332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20af0baa-4b04-4b7a-bf72-a90ff5d9010e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:25.798100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20af0baa-4b04-4b7a-bf72-a90ff5d9010e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:25.798531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20af0baa-4b04-4b7a-bf72-a90ff5d9010e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:25.806490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-705e6359-17fa-4d8d-a37f-34246f20548a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:25.807202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-705e6359-17fa-4d8d-a37f-34246f20548a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:25.814106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-705e6359-17fa-4d8d-a37f-34246f20548a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:25.814559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-705e6359-17fa-4d8d-a37f-34246f20548a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:25.815352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-705e6359-17fa-4d8d-a37f-34246f20548a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:25.815790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-705e6359-17fa-4d8d-a37f-34246f20548a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:25.829916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20af0baa-4b04-4b7a-bf72-a90ff5d9010e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044823 Apr 11 19:54:25.830855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 480/1027] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:25.835249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aec668c2-555c-4fbe-adb6-1cedef032ff3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:25.836182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aec668c2-555c-4fbe-adb6-1cedef032ff3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:25.842744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aec668c2-555c-4fbe-adb6-1cedef032ff3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:25.843222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aec668c2-555c-4fbe-adb6-1cedef032ff3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:25.844102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aec668c2-555c-4fbe-adb6-1cedef032ff3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:25.844599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aec668c2-555c-4fbe-adb6-1cedef032ff3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:25.879822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-705e6359-17fa-4d8d-a37f-34246f20548a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:25.884486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aec668c2-555c-4fbe-adb6-1cedef032ff3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052120 Apr 11 19:54:25.889271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 481/1028] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:25.889452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-705e6359-17fa-4d8d-a37f-34246f20548a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085035 Apr 11 19:54:25.893931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cd65c406-0126-4e4c-9f6a-d8ec3f2136d7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:25.894352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 548/1029] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:25 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:25.894938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cd65c406-0126-4e4c-9f6a-d8ec3f2136d7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:25.901865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd65c406-0126-4e4c-9f6a-d8ec3f2136d7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:25.902308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd65c406-0126-4e4c-9f6a-d8ec3f2136d7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:25.903064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd65c406-0126-4e4c-9f6a-d8ec3f2136d7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:25.903489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd65c406-0126-4e4c-9f6a-d8ec3f2136d7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:25.933733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cd65c406-0126-4e4c-9f6a-d8ec3f2136d7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Apr 11 19:54:25.934292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 482/1030] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:26.842882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b40fcfd7-2c2d-4d19-98d0-77fc31718a80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:26.843853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b40fcfd7-2c2d-4d19-98d0-77fc31718a80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:26.851353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b40fcfd7-2c2d-4d19-98d0-77fc31718a80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:26.851855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b40fcfd7-2c2d-4d19-98d0-77fc31718a80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:26.852685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b40fcfd7-2c2d-4d19-98d0-77fc31718a80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:26.853277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b40fcfd7-2c2d-4d19-98d0-77fc31718a80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:26.888234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b40fcfd7-2c2d-4d19-98d0-77fc31718a80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049992 Apr 11 19:54:26.888915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 549/1031] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:26.897672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-113018b3-8846-41f7-bb79-1a4b6bb7827a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:26.898579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-113018b3-8846-41f7-bb79-1a4b6bb7827a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:26.905264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e49ed03d-286c-40e5-81a4-4651ceef759c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:26.905482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-113018b3-8846-41f7-bb79-1a4b6bb7827a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:26.905917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-113018b3-8846-41f7-bb79-1a4b6bb7827a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:26.906059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e49ed03d-286c-40e5-81a4-4651ceef759c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:26.906695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-113018b3-8846-41f7-bb79-1a4b6bb7827a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:26.907132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-113018b3-8846-41f7-bb79-1a4b6bb7827a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:26.912715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e49ed03d-286c-40e5-81a4-4651ceef759c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:26.913377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e49ed03d-286c-40e5-81a4-4651ceef759c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:26.914214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e49ed03d-286c-40e5-81a4-4651ceef759c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:26.914723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e49ed03d-286c-40e5-81a4-4651ceef759c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:26.937032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-113018b3-8846-41f7-bb79-1a4b6bb7827a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043409 Apr 11 19:54:26.937597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 483/1032] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:26.975997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e49ed03d-286c-40e5-81a4-4651ceef759c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:26.983329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e49ed03d-286c-40e5-81a4-4651ceef759c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082260 Apr 11 19:54:26.983898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 550/1033] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:26 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:54:27.045862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bfea1cab-bb01-46ff-8d87-bb5d8498eb9b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:27.046809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bfea1cab-bb01-46ff-8d87-bb5d8498eb9b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:27.053106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfea1cab-bb01-46ff-8d87-bb5d8498eb9b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:27.053573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfea1cab-bb01-46ff-8d87-bb5d8498eb9b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:27.054366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfea1cab-bb01-46ff-8d87-bb5d8498eb9b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:27.054799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfea1cab-bb01-46ff-8d87-bb5d8498eb9b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:27.082888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bfea1cab-bb01-46ff-8d87-bb5d8498eb9b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141557 Apr 11 19:54:27.083464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 484/1034] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:27.900518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92a9cd4b-eca5-413e-b507-693e59a4628f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:27.901487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92a9cd4b-eca5-413e-b507-693e59a4628f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:27.908528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a9cd4b-eca5-413e-b507-693e59a4628f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:27.909000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a9cd4b-eca5-413e-b507-693e59a4628f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:27.909794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a9cd4b-eca5-413e-b507-693e59a4628f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:27.910232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a9cd4b-eca5-413e-b507-693e59a4628f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:27.941555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92a9cd4b-eca5-413e-b507-693e59a4628f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Apr 11 19:54:27.942088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 551/1035] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:27.950505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-91a5be16-6f6c-4218-b6eb-b214bb771049 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:27.951427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-91a5be16-6f6c-4218-b6eb-b214bb771049 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:27.957955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a5be16-6f6c-4218-b6eb-b214bb771049 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:27.958413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a5be16-6f6c-4218-b6eb-b214bb771049 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:27.959178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a5be16-6f6c-4218-b6eb-b214bb771049 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:27.959615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a5be16-6f6c-4218-b6eb-b214bb771049 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:27.988597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-91a5be16-6f6c-4218-b6eb-b214bb771049 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042116 Apr 11 19:54:27.989180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 485/1036] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:28.000109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-876ddbc0-5ba4-4391-8715-f7e3b3cd4f68 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:28.000782 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-876ddbc0-5ba4-4391-8715-f7e3b3cd4f68 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:28.007276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-876ddbc0-5ba4-4391-8715-f7e3b3cd4f68 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:28.007749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-876ddbc0-5ba4-4391-8715-f7e3b3cd4f68 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:28.008500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-876ddbc0-5ba4-4391-8715-f7e3b3cd4f68 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:28.008896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-876ddbc0-5ba4-4391-8715-f7e3b3cd4f68 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:28.071677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-876ddbc0-5ba4-4391-8715-f7e3b3cd4f68 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:28.080035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-876ddbc0-5ba4-4391-8715-f7e3b3cd4f68 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084071 Apr 11 19:54:28.080576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 552/1037] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:27 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:28.094533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d7949ef3-0c29-4796-9f07-826d77420328 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:28.095521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d7949ef3-0c29-4796-9f07-826d77420328 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:28.102085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7949ef3-0c29-4796-9f07-826d77420328 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:28.102521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7949ef3-0c29-4796-9f07-826d77420328 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:28.103297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7949ef3-0c29-4796-9f07-826d77420328 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:28.103715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7949ef3-0c29-4796-9f07-826d77420328 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:28.133518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d7949ef3-0c29-4796-9f07-826d77420328 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043029 Apr 11 19:54:28.134079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 486/1038] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:28.954156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b08d23ed-e89a-4227-8638-4d28a3332aa2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:28.955285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b08d23ed-e89a-4227-8638-4d28a3332aa2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:28.962847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08d23ed-e89a-4227-8638-4d28a3332aa2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:28.963282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08d23ed-e89a-4227-8638-4d28a3332aa2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:28.964138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08d23ed-e89a-4227-8638-4d28a3332aa2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:28.964831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08d23ed-e89a-4227-8638-4d28a3332aa2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:29.004314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b08d23ed-e89a-4227-8638-4d28a3332aa2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054361 Apr 11 19:54:29.005273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 553/1039] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:29.005787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6fc200b3-486b-4de5-81d6-c59b37327b73 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:29.006963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6fc200b3-486b-4de5-81d6-c59b37327b73 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:29.013625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc200b3-486b-4de5-81d6-c59b37327b73 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:29.014079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc200b3-486b-4de5-81d6-c59b37327b73 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:29.014858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc200b3-486b-4de5-81d6-c59b37327b73 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:29.015297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc200b3-486b-4de5-81d6-c59b37327b73 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:29.044932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6fc200b3-486b-4de5-81d6-c59b37327b73 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046852 Apr 11 19:54:29.045618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 487/1040] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:29.097493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dbc9ae2c-4135-48bf-b4b7-12a9aedd978a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:29.098209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dbc9ae2c-4135-48bf-b4b7-12a9aedd978a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:29.105040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbc9ae2c-4135-48bf-b4b7-12a9aedd978a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:29.105547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbc9ae2c-4135-48bf-b4b7-12a9aedd978a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:29.106305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbc9ae2c-4135-48bf-b4b7-12a9aedd978a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:29.106734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbc9ae2c-4135-48bf-b4b7-12a9aedd978a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:29.146412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0ec75ca1-ff0e-4128-87a7-c4b3781c224a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:29.147437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0ec75ca1-ff0e-4128-87a7-c4b3781c224a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:29.154343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ec75ca1-ff0e-4128-87a7-c4b3781c224a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:29.154941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ec75ca1-ff0e-4128-87a7-c4b3781c224a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:29.155922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ec75ca1-ff0e-4128-87a7-c4b3781c224a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:29.156489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ec75ca1-ff0e-4128-87a7-c4b3781c224a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:29.171151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dbc9ae2c-4135-48bf-b4b7-12a9aedd978a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:29.178949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dbc9ae2c-4135-48bf-b4b7-12a9aedd978a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086014 Apr 11 19:54:29.179495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 554/1041] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:29 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:29.189222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0ec75ca1-ff0e-4128-87a7-c4b3781c224a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Apr 11 19:54:29.190054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 488/1042] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:30.018172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6391e483-a8d1-4df8-b21e-da26341716c6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:30.019205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6391e483-a8d1-4df8-b21e-da26341716c6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:30.025784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6391e483-a8d1-4df8-b21e-da26341716c6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:30.026220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6391e483-a8d1-4df8-b21e-da26341716c6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:30.026967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6391e483-a8d1-4df8-b21e-da26341716c6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:30.027388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6391e483-a8d1-4df8-b21e-da26341716c6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:30.057526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16ad9c00-ea9f-4dd4-8b50-91e1d4ebf5d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:30.058870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16ad9c00-ea9f-4dd4-8b50-91e1d4ebf5d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:30.061007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6391e483-a8d1-4df8-b21e-da26341716c6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046952 Apr 11 19:54:30.061604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 555/1043] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:30.068575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16ad9c00-ea9f-4dd4-8b50-91e1d4ebf5d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:30.069017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16ad9c00-ea9f-4dd4-8b50-91e1d4ebf5d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:30.069815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16ad9c00-ea9f-4dd4-8b50-91e1d4ebf5d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:30.070249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16ad9c00-ea9f-4dd4-8b50-91e1d4ebf5d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:30.100326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16ad9c00-ea9f-4dd4-8b50-91e1d4ebf5d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047137 Apr 11 19:54:30.101145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 489/1044] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:30.197315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ca1d5c79-b979-427b-9484-59c8b4bcbde7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:30.198021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ca1d5c79-b979-427b-9484-59c8b4bcbde7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:30.200449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fa66fade-8f92-4b0a-ac6c-ae15033972a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:30.201504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fa66fade-8f92-4b0a-ac6c-ae15033972a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:30.204426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca1d5c79-b979-427b-9484-59c8b4bcbde7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:30.204876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca1d5c79-b979-427b-9484-59c8b4bcbde7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:30.205675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca1d5c79-b979-427b-9484-59c8b4bcbde7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:30.206103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca1d5c79-b979-427b-9484-59c8b4bcbde7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:30.209110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa66fade-8f92-4b0a-ac6c-ae15033972a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:30.209577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa66fade-8f92-4b0a-ac6c-ae15033972a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:30.210473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa66fade-8f92-4b0a-ac6c-ae15033972a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:30.210904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa66fade-8f92-4b0a-ac6c-ae15033972a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:30.239724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fa66fade-8f92-4b0a-ac6c-ae15033972a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Apr 11 19:54:30.240562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 490/1045] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:30.270163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ca1d5c79-b979-427b-9484-59c8b4bcbde7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:30.277707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ca1d5c79-b979-427b-9484-59c8b4bcbde7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084963 Apr 11 19:54:30.278270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 556/1046] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:30 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:31.073550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-213dcf60-fed2-4d75-a390-042c8cb6a802 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:31.074583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-213dcf60-fed2-4d75-a390-042c8cb6a802 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:31.082093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-213dcf60-fed2-4d75-a390-042c8cb6a802 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:31.082618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-213dcf60-fed2-4d75-a390-042c8cb6a802 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:31.083600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-213dcf60-fed2-4d75-a390-042c8cb6a802 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:31.084042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-213dcf60-fed2-4d75-a390-042c8cb6a802 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:31.113687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0af3e5dd-c37c-4154-ac9c-e80cc885bc2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:31.114654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0af3e5dd-c37c-4154-ac9c-e80cc885bc2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:31.114912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-213dcf60-fed2-4d75-a390-042c8cb6a802 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045822 Apr 11 19:54:31.115496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 491/1047] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:31.121510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af3e5dd-c37c-4154-ac9c-e80cc885bc2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:31.121960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af3e5dd-c37c-4154-ac9c-e80cc885bc2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:31.122731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af3e5dd-c37c-4154-ac9c-e80cc885bc2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:31.123164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af3e5dd-c37c-4154-ac9c-e80cc885bc2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:31.152708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0af3e5dd-c37c-4154-ac9c-e80cc885bc2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044287 Apr 11 19:54:31.153300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 557/1048] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:31.252941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9220be6f-c543-4815-a8aa-de76b789596b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:31.253889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9220be6f-c543-4815-a8aa-de76b789596b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:31.260322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9220be6f-c543-4815-a8aa-de76b789596b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:31.260774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9220be6f-c543-4815-a8aa-de76b789596b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:31.261570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9220be6f-c543-4815-a8aa-de76b789596b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:31.262003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9220be6f-c543-4815-a8aa-de76b789596b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:31.290979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9220be6f-c543-4815-a8aa-de76b789596b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042357 Apr 11 19:54:31.291518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 492/1049] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:31.297503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d17d0f38-35ab-40d0-8792-705e81b0a874 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:31.298116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d17d0f38-35ab-40d0-8792-705e81b0a874 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:31.304628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d17d0f38-35ab-40d0-8792-705e81b0a874 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:31.305133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d17d0f38-35ab-40d0-8792-705e81b0a874 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:31.305897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d17d0f38-35ab-40d0-8792-705e81b0a874 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:31.306329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d17d0f38-35ab-40d0-8792-705e81b0a874 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:31.369109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d17d0f38-35ab-40d0-8792-705e81b0a874 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:31.377055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d17d0f38-35ab-40d0-8792-705e81b0a874 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083318 Apr 11 19:54:31.377621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 558/1050] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:31 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:32.127155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0731c1fc-b147-4f8c-adb6-a751d6e42ff7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:32.128073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0731c1fc-b147-4f8c-adb6-a751d6e42ff7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:32.134818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0731c1fc-b147-4f8c-adb6-a751d6e42ff7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:32.135264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0731c1fc-b147-4f8c-adb6-a751d6e42ff7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:32.136025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0731c1fc-b147-4f8c-adb6-a751d6e42ff7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:32.136447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0731c1fc-b147-4f8c-adb6-a751d6e42ff7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:32.164047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4382ae16-b2c9-4796-9dc5-508516ac3a06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:32.165163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4382ae16-b2c9-4796-9dc5-508516ac3a06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:32.173225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0731c1fc-b147-4f8c-adb6-a751d6e42ff7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Apr 11 19:54:32.173225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 493/1051] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:32.173485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4382ae16-b2c9-4796-9dc5-508516ac3a06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:32.173485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4382ae16-b2c9-4796-9dc5-508516ac3a06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:32.173797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4382ae16-b2c9-4796-9dc5-508516ac3a06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:32.174114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4382ae16-b2c9-4796-9dc5-508516ac3a06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:32.204387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4382ae16-b2c9-4796-9dc5-508516ac3a06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044286 Apr 11 19:54:32.204971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 559/1052] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:32.303328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77dbe857-6620-4571-b7c8-568fa6a2438c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:32.304348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77dbe857-6620-4571-b7c8-568fa6a2438c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:32.310910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77dbe857-6620-4571-b7c8-568fa6a2438c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:32.311352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77dbe857-6620-4571-b7c8-568fa6a2438c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:32.312111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77dbe857-6620-4571-b7c8-568fa6a2438c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:32.312534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77dbe857-6620-4571-b7c8-568fa6a2438c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:32.341656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77dbe857-6620-4571-b7c8-568fa6a2438c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042481 Apr 11 19:54:32.342219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 494/1053] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:32.394411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6b9af691-097f-46fb-9f3e-9824c5ab00e2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:32.394930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6b9af691-097f-46fb-9f3e-9824c5ab00e2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:32.401223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b9af691-097f-46fb-9f3e-9824c5ab00e2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:32.401675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b9af691-097f-46fb-9f3e-9824c5ab00e2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:32.402430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b9af691-097f-46fb-9f3e-9824c5ab00e2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:32.402866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b9af691-097f-46fb-9f3e-9824c5ab00e2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:32.466861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6b9af691-097f-46fb-9f3e-9824c5ab00e2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:32.474852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6b9af691-097f-46fb-9f3e-9824c5ab00e2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084529 Apr 11 19:54:32.475465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 560/1054] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:32 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:33.183670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4bb10c3-775c-437a-a867-8cbce15dc1eb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:33.184591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4bb10c3-775c-437a-a867-8cbce15dc1eb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:33.192277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4bb10c3-775c-437a-a867-8cbce15dc1eb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:33.192722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4bb10c3-775c-437a-a867-8cbce15dc1eb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:33.193791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4bb10c3-775c-437a-a867-8cbce15dc1eb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:33.194259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4bb10c3-775c-437a-a867-8cbce15dc1eb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:33.216008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5a579540-6b30-400e-b767-14d0dde389bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:33.216919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5a579540-6b30-400e-b767-14d0dde389bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:33.223655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a579540-6b30-400e-b767-14d0dde389bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:33.224102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a579540-6b30-400e-b767-14d0dde389bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:33.224858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a579540-6b30-400e-b767-14d0dde389bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:33.225343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4bb10c3-775c-437a-a867-8cbce15dc1eb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045497 Apr 11 19:54:33.225515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a579540-6b30-400e-b767-14d0dde389bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:33.225898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 495/1055] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:33.255117 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5a579540-6b30-400e-b767-14d0dde389bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042984 Apr 11 19:54:33.255681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 561/1056] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:33.353770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5bac1d2b-cd82-483c-b46a-a019a084ffa6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:33.354694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5bac1d2b-cd82-483c-b46a-a019a084ffa6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:33.361316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bac1d2b-cd82-483c-b46a-a019a084ffa6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:33.361784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bac1d2b-cd82-483c-b46a-a019a084ffa6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:33.362547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bac1d2b-cd82-483c-b46a-a019a084ffa6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:33.363143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bac1d2b-cd82-483c-b46a-a019a084ffa6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:33.392894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5bac1d2b-cd82-483c-b46a-a019a084ffa6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 Apr 11 19:54:33.393466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 496/1057] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:33.492371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-80aa3a8c-bee4-4e6c-9990-0dfc41dea098 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:33.492881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-80aa3a8c-bee4-4e6c-9990-0dfc41dea098 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:33.499356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80aa3a8c-bee4-4e6c-9990-0dfc41dea098 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:33.500118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80aa3a8c-bee4-4e6c-9990-0dfc41dea098 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:33.500930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80aa3a8c-bee4-4e6c-9990-0dfc41dea098 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:33.501378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80aa3a8c-bee4-4e6c-9990-0dfc41dea098 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:33.567858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-80aa3a8c-bee4-4e6c-9990-0dfc41dea098 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:33.575631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-80aa3a8c-bee4-4e6c-9990-0dfc41dea098 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087489 Apr 11 19:54:33.576177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 562/1058] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:33 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:34.237759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-63f5224d-74b5-4a34-8b4b-356d4c979d34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:34.238692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-63f5224d-74b5-4a34-8b4b-356d4c979d34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:34.245523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f5224d-74b5-4a34-8b4b-356d4c979d34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:34.245970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f5224d-74b5-4a34-8b4b-356d4c979d34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:34.246732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f5224d-74b5-4a34-8b4b-356d4c979d34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:34.247169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f5224d-74b5-4a34-8b4b-356d4c979d34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:34.266685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c02b0617-a67b-4992-b9f6-17a1ca344a92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:34.267594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c02b0617-a67b-4992-b9f6-17a1ca344a92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:34.274130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c02b0617-a67b-4992-b9f6-17a1ca344a92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:34.274595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c02b0617-a67b-4992-b9f6-17a1ca344a92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:34.275362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c02b0617-a67b-4992-b9f6-17a1ca344a92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:34.275761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c02b0617-a67b-4992-b9f6-17a1ca344a92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:34.277410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-63f5224d-74b5-4a34-8b4b-356d4c979d34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Apr 11 19:54:34.278319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 497/1059] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:34.309662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c02b0617-a67b-4992-b9f6-17a1ca344a92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046796 Apr 11 19:54:34.310251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 563/1060] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:34.405253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7502d450-5a71-4649-b78e-82dd4ac3ebe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:34.407336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7502d450-5a71-4649-b78e-82dd4ac3ebe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:34.417843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7502d450-5a71-4649-b78e-82dd4ac3ebe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:34.418339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7502d450-5a71-4649-b78e-82dd4ac3ebe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:34.419295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7502d450-5a71-4649-b78e-82dd4ac3ebe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:34.419749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7502d450-5a71-4649-b78e-82dd4ac3ebe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:34.449487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7502d450-5a71-4649-b78e-82dd4ac3ebe0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048314 Apr 11 19:54:34.449947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 498/1061] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:34.593242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d65683f-400a-417d-9fbd-725ec4484ac8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:34.593871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d65683f-400a-417d-9fbd-725ec4484ac8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:34.600392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d65683f-400a-417d-9fbd-725ec4484ac8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:34.600851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d65683f-400a-417d-9fbd-725ec4484ac8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:34.601660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d65683f-400a-417d-9fbd-725ec4484ac8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:34.602090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d65683f-400a-417d-9fbd-725ec4484ac8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:34.662802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d65683f-400a-417d-9fbd-725ec4484ac8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:34.670450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d65683f-400a-417d-9fbd-725ec4484ac8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081503 Apr 11 19:54:34.671034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 564/1062] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:34 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:35.289755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1d953fd-4c21-4f2a-bbb6-25c2213c9ddf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:35.290663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1d953fd-4c21-4f2a-bbb6-25c2213c9ddf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:35.297399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d953fd-4c21-4f2a-bbb6-25c2213c9ddf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:35.297830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d953fd-4c21-4f2a-bbb6-25c2213c9ddf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:35.298594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d953fd-4c21-4f2a-bbb6-25c2213c9ddf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:35.299021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d953fd-4c21-4f2a-bbb6-25c2213c9ddf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:35.321732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0b4f308-03a7-41e5-99cb-cf7a61fb11ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:35.322660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0b4f308-03a7-41e5-99cb-cf7a61fb11ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:35.329459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0b4f308-03a7-41e5-99cb-cf7a61fb11ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:35.329913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0b4f308-03a7-41e5-99cb-cf7a61fb11ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:35.330437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1d953fd-4c21-4f2a-bbb6-25c2213c9ddf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Apr 11 19:54:35.330694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0b4f308-03a7-41e5-99cb-cf7a61fb11ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:35.330995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 499/1063] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:35.331193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0b4f308-03a7-41e5-99cb-cf7a61fb11ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:35.361173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0b4f308-03a7-41e5-99cb-cf7a61fb11ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043312 Apr 11 19:54:35.361998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 565/1064] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:35.462290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-18b3e86e-0b36-4c49-8e18-2ac063148924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:35.462747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-18b3e86e-0b36-4c49-8e18-2ac063148924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:35.469021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18b3e86e-0b36-4c49-8e18-2ac063148924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:35.469477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18b3e86e-0b36-4c49-8e18-2ac063148924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:35.470271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18b3e86e-0b36-4c49-8e18-2ac063148924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:35.470709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18b3e86e-0b36-4c49-8e18-2ac063148924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:35.499577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-18b3e86e-0b36-4c49-8e18-2ac063148924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Apr 11 19:54:35.501132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 500/1065] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:35.687052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-67743273-1a1a-4cfb-88f6-411c3a8d89fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:35.687656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-67743273-1a1a-4cfb-88f6-411c3a8d89fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:35.694450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67743273-1a1a-4cfb-88f6-411c3a8d89fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:35.694906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67743273-1a1a-4cfb-88f6-411c3a8d89fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:35.695674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67743273-1a1a-4cfb-88f6-411c3a8d89fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:35.696108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67743273-1a1a-4cfb-88f6-411c3a8d89fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:35.756991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-67743273-1a1a-4cfb-88f6-411c3a8d89fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:35.765047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-67743273-1a1a-4cfb-88f6-411c3a8d89fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081935 Apr 11 19:54:35.765645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 566/1066] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:35 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:36.343554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-373af4a9-e632-44d2-b555-329d0ff1b5ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:36.344548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-373af4a9-e632-44d2-b555-329d0ff1b5ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:36.351585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-373af4a9-e632-44d2-b555-329d0ff1b5ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:36.352044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-373af4a9-e632-44d2-b555-329d0ff1b5ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:36.352792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-373af4a9-e632-44d2-b555-329d0ff1b5ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:36.353279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-373af4a9-e632-44d2-b555-329d0ff1b5ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:36.374294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-403b4ae1-1c95-4868-9c32-837878e3ed32 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:36.375605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-403b4ae1-1c95-4868-9c32-837878e3ed32 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:36.383010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-403b4ae1-1c95-4868-9c32-837878e3ed32 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:36.383499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-403b4ae1-1c95-4868-9c32-837878e3ed32 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:36.384334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-403b4ae1-1c95-4868-9c32-837878e3ed32 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:36.384493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-373af4a9-e632-44d2-b555-329d0ff1b5ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Apr 11 19:54:36.384793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-403b4ae1-1c95-4868-9c32-837878e3ed32 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:36.390233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 501/1067] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:36.418953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-403b4ae1-1c95-4868-9c32-837878e3ed32 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049098 Apr 11 19:54:36.419618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 567/1068] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:36.512213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dae171d3-3eaa-4b3d-bb6c-52a05ca0ea7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:36.513204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dae171d3-3eaa-4b3d-bb6c-52a05ca0ea7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:36.519888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dae171d3-3eaa-4b3d-bb6c-52a05ca0ea7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:36.520333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dae171d3-3eaa-4b3d-bb6c-52a05ca0ea7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:36.521120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dae171d3-3eaa-4b3d-bb6c-52a05ca0ea7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:36.521548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dae171d3-3eaa-4b3d-bb6c-52a05ca0ea7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:36.550818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dae171d3-3eaa-4b3d-bb6c-52a05ca0ea7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042744 Apr 11 19:54:36.551375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 502/1069] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:36.782753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0325a2de-7606-4248-8413-f37514bffa6c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:36.783331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0325a2de-7606-4248-8413-f37514bffa6c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:36.790113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0325a2de-7606-4248-8413-f37514bffa6c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:36.790567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0325a2de-7606-4248-8413-f37514bffa6c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:36.791332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0325a2de-7606-4248-8413-f37514bffa6c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:36.791768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0325a2de-7606-4248-8413-f37514bffa6c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:36.855583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0325a2de-7606-4248-8413-f37514bffa6c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:36.863758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0325a2de-7606-4248-8413-f37514bffa6c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085319 Apr 11 19:54:36.864301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 568/1070] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:36 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:37.398509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1dbb107-6b2f-4cd4-82cf-b382c5a16da5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:37.399461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1dbb107-6b2f-4cd4-82cf-b382c5a16da5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:37.406305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1dbb107-6b2f-4cd4-82cf-b382c5a16da5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:37.406758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1dbb107-6b2f-4cd4-82cf-b382c5a16da5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:37.407518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1dbb107-6b2f-4cd4-82cf-b382c5a16da5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:37.407967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1dbb107-6b2f-4cd4-82cf-b382c5a16da5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:37.432355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ba96c897-3989-4057-b125-b85decac9b84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:37.433630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ba96c897-3989-4057-b125-b85decac9b84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:37.437697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1dbb107-6b2f-4cd4-82cf-b382c5a16da5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Apr 11 19:54:37.438265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 503/1071] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:37.441179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba96c897-3989-4057-b125-b85decac9b84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:37.441727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba96c897-3989-4057-b125-b85decac9b84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:37.442634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba96c897-3989-4057-b125-b85decac9b84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:37.443178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba96c897-3989-4057-b125-b85decac9b84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:37.472325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ba96c897-3989-4057-b125-b85decac9b84 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044384 Apr 11 19:54:37.472856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 569/1072] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:37.563704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e607e3c4-a727-496f-a6de-3f0410a5a045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:37.564675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e607e3c4-a727-496f-a6de-3f0410a5a045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:37.571267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e607e3c4-a727-496f-a6de-3f0410a5a045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:37.571716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e607e3c4-a727-496f-a6de-3f0410a5a045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:37.572482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e607e3c4-a727-496f-a6de-3f0410a5a045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:37.572939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e607e3c4-a727-496f-a6de-3f0410a5a045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:37.601635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e607e3c4-a727-496f-a6de-3f0410a5a045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 Apr 11 19:54:37.602168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 504/1073] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:37 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:37.881668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-abd9157d-a2f3-4b8e-835c-4e1ce7a49420 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:37.882202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-abd9157d-a2f3-4b8e-835c-4e1ce7a49420 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:37.888439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abd9157d-a2f3-4b8e-835c-4e1ce7a49420 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:37.889096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abd9157d-a2f3-4b8e-835c-4e1ce7a49420 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:37.889936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abd9157d-a2f3-4b8e-835c-4e1ce7a49420 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:37.890378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abd9157d-a2f3-4b8e-835c-4e1ce7a49420 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:37.949908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-abd9157d-a2f3-4b8e-835c-4e1ce7a49420 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:37.957678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-abd9157d-a2f3-4b8e-835c-4e1ce7a49420 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080243 Apr 11 19:54:37.958256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 570/1074] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:37 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:38.450478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09130665-3fe0-4dab-ac35-987309cd68b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:38.451352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09130665-3fe0-4dab-ac35-987309cd68b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:38.458144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09130665-3fe0-4dab-ac35-987309cd68b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:38.458598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09130665-3fe0-4dab-ac35-987309cd68b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:38.459371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09130665-3fe0-4dab-ac35-987309cd68b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:38.459911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09130665-3fe0-4dab-ac35-987309cd68b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:38.486077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-29d157a8-a72f-43e3-bc99-db33916f8935 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:38.486993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-29d157a8-a72f-43e3-bc99-db33916f8935 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:38.490127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09130665-3fe0-4dab-ac35-987309cd68b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Apr 11 19:54:38.490706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 505/1075] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:38.493755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29d157a8-a72f-43e3-bc99-db33916f8935 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:38.494352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29d157a8-a72f-43e3-bc99-db33916f8935 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:38.495126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29d157a8-a72f-43e3-bc99-db33916f8935 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:38.495526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29d157a8-a72f-43e3-bc99-db33916f8935 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:38.529157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-29d157a8-a72f-43e3-bc99-db33916f8935 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047100 Apr 11 19:54:38.529743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 571/1076] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:38.616513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d8d7531-76ef-49d3-8c87-31dd6d185288 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:38.618094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d8d7531-76ef-49d3-8c87-31dd6d185288 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:38.627765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d8d7531-76ef-49d3-8c87-31dd6d185288 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:38.628263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d8d7531-76ef-49d3-8c87-31dd6d185288 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:38.629130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d8d7531-76ef-49d3-8c87-31dd6d185288 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:38.629625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d8d7531-76ef-49d3-8c87-31dd6d185288 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:38.659221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d8d7531-76ef-49d3-8c87-31dd6d185288 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049954 Apr 11 19:54:38.660035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 506/1077] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:38.975340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a908715d-3cb7-46a8-b0ad-4e700546e7c1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:38.975977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a908715d-3cb7-46a8-b0ad-4e700546e7c1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:38.982154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a908715d-3cb7-46a8-b0ad-4e700546e7c1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:38.982607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a908715d-3cb7-46a8-b0ad-4e700546e7c1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:38.983373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a908715d-3cb7-46a8-b0ad-4e700546e7c1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:38.983807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a908715d-3cb7-46a8-b0ad-4e700546e7c1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:39.044048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a908715d-3cb7-46a8-b0ad-4e700546e7c1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:39.052016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a908715d-3cb7-46a8-b0ad-4e700546e7c1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080985 Apr 11 19:54:39.052573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 572/1078] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:38 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:39.502619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-be0e5c1e-0ed6-450f-81ab-2141df3c0ff5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:39.503574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-be0e5c1e-0ed6-450f-81ab-2141df3c0ff5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:39.510313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be0e5c1e-0ed6-450f-81ab-2141df3c0ff5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:39.510905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be0e5c1e-0ed6-450f-81ab-2141df3c0ff5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:39.511666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be0e5c1e-0ed6-450f-81ab-2141df3c0ff5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:39.512129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be0e5c1e-0ed6-450f-81ab-2141df3c0ff5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:39.544398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0cad102-e70c-4db5-8041-6a14469657c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:39.546053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0cad102-e70c-4db5-8041-6a14469657c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:39.548019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-be0e5c1e-0ed6-450f-81ab-2141df3c0ff5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049877 Apr 11 19:54:39.548813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 507/1079] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:39.555997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0cad102-e70c-4db5-8041-6a14469657c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:39.556452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0cad102-e70c-4db5-8041-6a14469657c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:39.557304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0cad102-e70c-4db5-8041-6a14469657c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:39.557732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0cad102-e70c-4db5-8041-6a14469657c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:39.588048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0cad102-e70c-4db5-8041-6a14469657c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050264 Apr 11 19:54:39.588633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 573/1080] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:39.671338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-569025ed-0dd8-4f1e-86b1-91012e958595 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:39.672457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-569025ed-0dd8-4f1e-86b1-91012e958595 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:39.679256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-569025ed-0dd8-4f1e-86b1-91012e958595 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:39.679595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-569025ed-0dd8-4f1e-86b1-91012e958595 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:39.680358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-569025ed-0dd8-4f1e-86b1-91012e958595 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:39.680758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-569025ed-0dd8-4f1e-86b1-91012e958595 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:39.710539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-569025ed-0dd8-4f1e-86b1-91012e958595 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 Apr 11 19:54:39.711107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 508/1081] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:40.069803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58a0d69e-2b5b-4f0c-95cb-978f1c573b6b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:40.070325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58a0d69e-2b5b-4f0c-95cb-978f1c573b6b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:40.076744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58a0d69e-2b5b-4f0c-95cb-978f1c573b6b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:40.077228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58a0d69e-2b5b-4f0c-95cb-978f1c573b6b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:40.078007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58a0d69e-2b5b-4f0c-95cb-978f1c573b6b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:40.078447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58a0d69e-2b5b-4f0c-95cb-978f1c573b6b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:40.141258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58a0d69e-2b5b-4f0c-95cb-978f1c573b6b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:40.149470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58a0d69e-2b5b-4f0c-95cb-978f1c573b6b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083861 Apr 11 19:54:40.150052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 574/1082] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:40 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:40.560313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4a09e6ad-24cc-4a59-bd22-0936d49661a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:40.561308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4a09e6ad-24cc-4a59-bd22-0936d49661a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:40.568239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a09e6ad-24cc-4a59-bd22-0936d49661a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:40.568684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a09e6ad-24cc-4a59-bd22-0936d49661a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:40.569505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a09e6ad-24cc-4a59-bd22-0936d49661a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:40.569943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a09e6ad-24cc-4a59-bd22-0936d49661a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:40.601250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1a9724c5-3ca3-41a6-8e04-274ff354e8ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:40.601855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4a09e6ad-24cc-4a59-bd22-0936d49661a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Apr 11 19:54:40.602299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1a9724c5-3ca3-41a6-8e04-274ff354e8ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:40.602540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 509/1083] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:40.610864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a9724c5-3ca3-41a6-8e04-274ff354e8ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:40.611365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a9724c5-3ca3-41a6-8e04-274ff354e8ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:40.612211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a9724c5-3ca3-41a6-8e04-274ff354e8ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:40.612677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a9724c5-3ca3-41a6-8e04-274ff354e8ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:40.642977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1a9724c5-3ca3-41a6-8e04-274ff354e8ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046751 Apr 11 19:54:40.643539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 575/1084] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:40.723047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-adaaf8f4-779d-401e-be03-72c50e5944ca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:40.723976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-adaaf8f4-779d-401e-be03-72c50e5944ca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:40.730646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adaaf8f4-779d-401e-be03-72c50e5944ca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:40.731103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adaaf8f4-779d-401e-be03-72c50e5944ca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:40.731928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adaaf8f4-779d-401e-be03-72c50e5944ca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:40.732545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adaaf8f4-779d-401e-be03-72c50e5944ca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:40.763352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-adaaf8f4-779d-401e-be03-72c50e5944ca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Apr 11 19:54:40.763849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 510/1085] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:41.166883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ab453ec-c073-45d0-bc0b-6dbbb719fe74 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:41.167400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ab453ec-c073-45d0-bc0b-6dbbb719fe74 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:41.174101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ab453ec-c073-45d0-bc0b-6dbbb719fe74 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:41.174546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ab453ec-c073-45d0-bc0b-6dbbb719fe74 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:41.175320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ab453ec-c073-45d0-bc0b-6dbbb719fe74 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:41.175749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ab453ec-c073-45d0-bc0b-6dbbb719fe74 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:41.238284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8ab453ec-c073-45d0-bc0b-6dbbb719fe74 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:41.247854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ab453ec-c073-45d0-bc0b-6dbbb719fe74 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084974 Apr 11 19:54:41.248429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 576/1086] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:41 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:41.615238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e129267-d6f3-43b1-bd9b-b091c1cc573c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:41.616258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e129267-d6f3-43b1-bd9b-b091c1cc573c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:41.623089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e129267-d6f3-43b1-bd9b-b091c1cc573c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:41.623532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e129267-d6f3-43b1-bd9b-b091c1cc573c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:41.624296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e129267-d6f3-43b1-bd9b-b091c1cc573c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:41.624724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e129267-d6f3-43b1-bd9b-b091c1cc573c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:41.655617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e129267-d6f3-43b1-bd9b-b091c1cc573c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Apr 11 19:54:41.655904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b541879c-f75b-407e-a589-77120491c218 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:41.656513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 511/1087] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:41.656813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b541879c-f75b-407e-a589-77120491c218 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:41.663340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b541879c-f75b-407e-a589-77120491c218 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:41.663810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b541879c-f75b-407e-a589-77120491c218 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:41.664577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b541879c-f75b-407e-a589-77120491c218 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:41.665040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b541879c-f75b-407e-a589-77120491c218 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:41.695773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b541879c-f75b-407e-a589-77120491c218 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044502 Apr 11 19:54:41.696611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 577/1088] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:41.775640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89bc1a93-9836-44ce-817c-ece78c989da5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:41.776567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89bc1a93-9836-44ce-817c-ece78c989da5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:41.783286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89bc1a93-9836-44ce-817c-ece78c989da5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:41.783739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89bc1a93-9836-44ce-817c-ece78c989da5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:41.784556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89bc1a93-9836-44ce-817c-ece78c989da5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:41.785023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89bc1a93-9836-44ce-817c-ece78c989da5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:41.815265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89bc1a93-9836-44ce-817c-ece78c989da5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Apr 11 19:54:41.815820 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 512/1089] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:42.265246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-df6c4b3b-e11d-4c6e-b461-58918e50a09c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:42.265885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-df6c4b3b-e11d-4c6e-b461-58918e50a09c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:42.272415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df6c4b3b-e11d-4c6e-b461-58918e50a09c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:42.272866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df6c4b3b-e11d-4c6e-b461-58918e50a09c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:42.273660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df6c4b3b-e11d-4c6e-b461-58918e50a09c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:42.274124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df6c4b3b-e11d-4c6e-b461-58918e50a09c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:42.338335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-df6c4b3b-e11d-4c6e-b461-58918e50a09c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:42.346640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-df6c4b3b-e11d-4c6e-b461-58918e50a09c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085300 Apr 11 19:54:42.347204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 578/1090] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:42 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:42.668115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-91be7924-e5e9-4f24-bc66-9869868df2b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:42.669066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-91be7924-e5e9-4f24-bc66-9869868df2b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:42.675925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91be7924-e5e9-4f24-bc66-9869868df2b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:42.676398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91be7924-e5e9-4f24-bc66-9869868df2b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:42.677185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91be7924-e5e9-4f24-bc66-9869868df2b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:42.677608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91be7924-e5e9-4f24-bc66-9869868df2b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:42.707229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-91be7924-e5e9-4f24-bc66-9869868df2b1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 Apr 11 19:54:42.707773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 513/1091] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:42.708159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0e676095-44c8-4c37-bfc8-33e971533e7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:42.709310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0e676095-44c8-4c37-bfc8-33e971533e7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:42.715872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e676095-44c8-4c37-bfc8-33e971533e7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:42.716313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e676095-44c8-4c37-bfc8-33e971533e7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:42.717101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e676095-44c8-4c37-bfc8-33e971533e7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:42.717536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e676095-44c8-4c37-bfc8-33e971533e7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:42.746881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0e676095-44c8-4c37-bfc8-33e971533e7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042873 Apr 11 19:54:42.747439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 579/1092] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:42.827584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f5fc3db-e4df-4d9e-80fc-eeaa879ae056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:42.828558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0f5fc3db-e4df-4d9e-80fc-eeaa879ae056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:42.835369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f5fc3db-e4df-4d9e-80fc-eeaa879ae056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:42.835815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f5fc3db-e4df-4d9e-80fc-eeaa879ae056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:42.836575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f5fc3db-e4df-4d9e-80fc-eeaa879ae056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:42.837041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f5fc3db-e4df-4d9e-80fc-eeaa879ae056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:42.866890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0f5fc3db-e4df-4d9e-80fc-eeaa879ae056 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 Apr 11 19:54:42.867466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 514/1093] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:43.363914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7172fa3f-c12e-4bd4-b383-a26aa03d9ff9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:43.364525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7172fa3f-c12e-4bd4-b383-a26aa03d9ff9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:43.371353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7172fa3f-c12e-4bd4-b383-a26aa03d9ff9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:43.371805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7172fa3f-c12e-4bd4-b383-a26aa03d9ff9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:43.372576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7172fa3f-c12e-4bd4-b383-a26aa03d9ff9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:43.373049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7172fa3f-c12e-4bd4-b383-a26aa03d9ff9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:43.434869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7172fa3f-c12e-4bd4-b383-a26aa03d9ff9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:43.442979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7172fa3f-c12e-4bd4-b383-a26aa03d9ff9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082878 Apr 11 19:54:43.443497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 580/1094] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:43 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:43.719917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fb4c3b42-3595-4770-9234-13c307113430 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:43.720720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fb4c3b42-3595-4770-9234-13c307113430 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:43.727998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb4c3b42-3595-4770-9234-13c307113430 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:43.728440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb4c3b42-3595-4770-9234-13c307113430 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:43.729240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb4c3b42-3595-4770-9234-13c307113430 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:43.729670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb4c3b42-3595-4770-9234-13c307113430 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:43.760838 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd756379-73ea-49c9-85f0-decd95814cac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:43.761510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fb4c3b42-3595-4770-9234-13c307113430 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045507 Apr 11 19:54:43.761808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd756379-73ea-49c9-85f0-decd95814cac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:43.761981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 515/1095] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:43.768602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd756379-73ea-49c9-85f0-decd95814cac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:43.769086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd756379-73ea-49c9-85f0-decd95814cac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:43.769893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd756379-73ea-49c9-85f0-decd95814cac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:43.770338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd756379-73ea-49c9-85f0-decd95814cac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:43.801035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd756379-73ea-49c9-85f0-decd95814cac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045357 Apr 11 19:54:43.801821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 581/1096] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:43.879794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b007ceec-411a-432c-a3b5-afbf27d0925c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:43.880746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b007ceec-411a-432c-a3b5-afbf27d0925c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:43.887579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b007ceec-411a-432c-a3b5-afbf27d0925c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:43.888031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b007ceec-411a-432c-a3b5-afbf27d0925c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:43.888814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b007ceec-411a-432c-a3b5-afbf27d0925c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:43.889287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b007ceec-411a-432c-a3b5-afbf27d0925c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:43.919484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b007ceec-411a-432c-a3b5-afbf27d0925c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Apr 11 19:54:43.920065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 516/1097] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:44.459697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-04ec73b8-f1d0-43db-89c7-0b2d909731da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:44.461086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-04ec73b8-f1d0-43db-89c7-0b2d909731da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:44.467351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04ec73b8-f1d0-43db-89c7-0b2d909731da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:44.467798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04ec73b8-f1d0-43db-89c7-0b2d909731da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:44.468548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04ec73b8-f1d0-43db-89c7-0b2d909731da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:44.469003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04ec73b8-f1d0-43db-89c7-0b2d909731da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:44.529687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-04ec73b8-f1d0-43db-89c7-0b2d909731da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:44.537495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-04ec73b8-f1d0-43db-89c7-0b2d909731da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082249 Apr 11 19:54:44.538092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 582/1098] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:44 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:44.773741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a1626627-618b-4fdb-b095-6e8e49cb7355 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:44.774606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a1626627-618b-4fdb-b095-6e8e49cb7355 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:44.781504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1626627-618b-4fdb-b095-6e8e49cb7355 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:44.781954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1626627-618b-4fdb-b095-6e8e49cb7355 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:44.782729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1626627-618b-4fdb-b095-6e8e49cb7355 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:44.783178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1626627-618b-4fdb-b095-6e8e49cb7355 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:44.813329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a1626627-618b-4fdb-b095-6e8e49cb7355 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Apr 11 19:54:44.813891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 517/1099] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:44.814848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-74b9dd9a-fd07-47bb-ad0c-cdd1f0de1cf6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:44.816131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-74b9dd9a-fd07-47bb-ad0c-cdd1f0de1cf6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:44.823379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-74b9dd9a-fd07-47bb-ad0c-cdd1f0de1cf6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:44.823819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-74b9dd9a-fd07-47bb-ad0c-cdd1f0de1cf6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:44.824581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-74b9dd9a-fd07-47bb-ad0c-cdd1f0de1cf6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:44.825027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-74b9dd9a-fd07-47bb-ad0c-cdd1f0de1cf6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:44.855112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-74b9dd9a-fd07-47bb-ad0c-cdd1f0de1cf6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045287 Apr 11 19:54:44.855700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 583/1100] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:44.931670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a633cd42-4064-473d-a04e-bb0772ea87c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:44.932628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a633cd42-4064-473d-a04e-bb0772ea87c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:44.939165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a633cd42-4064-473d-a04e-bb0772ea87c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:44.939622 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a633cd42-4064-473d-a04e-bb0772ea87c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:44.940390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a633cd42-4064-473d-a04e-bb0772ea87c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:44.940822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a633cd42-4064-473d-a04e-bb0772ea87c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:44.969912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a633cd42-4064-473d-a04e-bb0772ea87c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Apr 11 19:54:44.970483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 518/1101] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:45.554960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ab2396b-2129-4a06-a94d-73625c8a49e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:45.555464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ab2396b-2129-4a06-a94d-73625c8a49e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:45.562047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ab2396b-2129-4a06-a94d-73625c8a49e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:45.562484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ab2396b-2129-4a06-a94d-73625c8a49e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:45.563245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ab2396b-2129-4a06-a94d-73625c8a49e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:45.563669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ab2396b-2129-4a06-a94d-73625c8a49e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:45.623930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ab2396b-2129-4a06-a94d-73625c8a49e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:45.632195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ab2396b-2129-4a06-a94d-73625c8a49e4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081324 Apr 11 19:54:45.632763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 584/1102] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:45 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:45.825705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-93554f86-2ee4-4590-8ae5-a68fcc8d2b48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:45.826569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-93554f86-2ee4-4590-8ae5-a68fcc8d2b48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:45.833118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93554f86-2ee4-4590-8ae5-a68fcc8d2b48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:45.833573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93554f86-2ee4-4590-8ae5-a68fcc8d2b48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:45.834406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93554f86-2ee4-4590-8ae5-a68fcc8d2b48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:45.834841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93554f86-2ee4-4590-8ae5-a68fcc8d2b48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:45.866149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-93554f86-2ee4-4590-8ae5-a68fcc8d2b48 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Apr 11 19:54:45.867028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 519/1103] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:45.872105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dfd3fb60-e50e-4fb2-a3bc-b606ca536553 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:45.873823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dfd3fb60-e50e-4fb2-a3bc-b606ca536553 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:45.880943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfd3fb60-e50e-4fb2-a3bc-b606ca536553 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:45.881618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfd3fb60-e50e-4fb2-a3bc-b606ca536553 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:45.882385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfd3fb60-e50e-4fb2-a3bc-b606ca536553 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:45.882783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfd3fb60-e50e-4fb2-a3bc-b606ca536553 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:45.911896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dfd3fb60-e50e-4fb2-a3bc-b606ca536553 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047871 Apr 11 19:54:45.912433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 585/1104] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:45.981422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b2155950-25d7-4cc4-a1d4-dc36eccb7324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:45.982333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b2155950-25d7-4cc4-a1d4-dc36eccb7324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:45.988785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2155950-25d7-4cc4-a1d4-dc36eccb7324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:45.989259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2155950-25d7-4cc4-a1d4-dc36eccb7324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:45.990072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2155950-25d7-4cc4-a1d4-dc36eccb7324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:45.990504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2155950-25d7-4cc4-a1d4-dc36eccb7324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:46.020117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b2155950-25d7-4cc4-a1d4-dc36eccb7324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042820 Apr 11 19:54:46.020670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 520/1105] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:46.649490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-254917fb-f759-4497-b35e-20b13f683ccb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:46.650121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-254917fb-f759-4497-b35e-20b13f683ccb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:46.656583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-254917fb-f759-4497-b35e-20b13f683ccb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:46.657052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-254917fb-f759-4497-b35e-20b13f683ccb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:46.657802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-254917fb-f759-4497-b35e-20b13f683ccb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:46.658230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-254917fb-f759-4497-b35e-20b13f683ccb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:46.718391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-254917fb-f759-4497-b35e-20b13f683ccb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:46.726562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-254917fb-f759-4497-b35e-20b13f683ccb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081032 Apr 11 19:54:46.727131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 586/1106] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:46 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:46.880825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2517f76c-47a0-4863-8361-9d6e66bc1a21 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:46.881779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2517f76c-47a0-4863-8361-9d6e66bc1a21 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:46.888582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2517f76c-47a0-4863-8361-9d6e66bc1a21 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:46.889065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2517f76c-47a0-4863-8361-9d6e66bc1a21 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:46.889858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2517f76c-47a0-4863-8361-9d6e66bc1a21 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:46.890321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2517f76c-47a0-4863-8361-9d6e66bc1a21 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:46.919520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2517f76c-47a0-4863-8361-9d6e66bc1a21 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Apr 11 19:54:46.920167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 521/1107] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:46.924795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0bf13421-08a7-4724-b5b0-2cd7b08475e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:46.925753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0bf13421-08a7-4724-b5b0-2cd7b08475e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:46.932469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bf13421-08a7-4724-b5b0-2cd7b08475e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:46.932933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bf13421-08a7-4724-b5b0-2cd7b08475e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:46.933703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bf13421-08a7-4724-b5b0-2cd7b08475e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:46.934157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bf13421-08a7-4724-b5b0-2cd7b08475e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:46.963346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0bf13421-08a7-4724-b5b0-2cd7b08475e1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043313 Apr 11 19:54:46.963906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 587/1108] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:47.031292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3728a67f-c625-4bd8-9834-6aed089b8310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:47.032243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3728a67f-c625-4bd8-9834-6aed089b8310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:47.038671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3728a67f-c625-4bd8-9834-6aed089b8310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:47.039109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3728a67f-c625-4bd8-9834-6aed089b8310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:47.039864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3728a67f-c625-4bd8-9834-6aed089b8310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:47.040287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3728a67f-c625-4bd8-9834-6aed089b8310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:47.069381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3728a67f-c625-4bd8-9834-6aed089b8310 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 Apr 11 19:54:47.069907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 522/1109] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:47.744011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-76c0bbc3-581c-40bf-9b4e-fdee285b1d44 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:47.744612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-76c0bbc3-581c-40bf-9b4e-fdee285b1d44 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:47.752368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76c0bbc3-581c-40bf-9b4e-fdee285b1d44 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:47.752813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76c0bbc3-581c-40bf-9b4e-fdee285b1d44 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:47.753619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76c0bbc3-581c-40bf-9b4e-fdee285b1d44 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:47.754043 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76c0bbc3-581c-40bf-9b4e-fdee285b1d44 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:47.814473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-76c0bbc3-581c-40bf-9b4e-fdee285b1d44 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:47.822666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-76c0bbc3-581c-40bf-9b4e-fdee285b1d44 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082612 Apr 11 19:54:47.823225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 588/1110] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:47 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:47.931258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8b8406c4-3eb2-4875-ae2a-2d4c8050d3e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:47.932225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8b8406c4-3eb2-4875-ae2a-2d4c8050d3e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:47.938948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b8406c4-3eb2-4875-ae2a-2d4c8050d3e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:47.939389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b8406c4-3eb2-4875-ae2a-2d4c8050d3e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:47.940152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b8406c4-3eb2-4875-ae2a-2d4c8050d3e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:47.940576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b8406c4-3eb2-4875-ae2a-2d4c8050d3e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:47.969663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8b8406c4-3eb2-4875-ae2a-2d4c8050d3e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042478 Apr 11 19:54:47.973268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 523/1111] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:47.975386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-034e9f8a-3c21-418f-bb98-35d30bfd9e0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:47.976324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-034e9f8a-3c21-418f-bb98-35d30bfd9e0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:47.983193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034e9f8a-3c21-418f-bb98-35d30bfd9e0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:47.983640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034e9f8a-3c21-418f-bb98-35d30bfd9e0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:47.984404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034e9f8a-3c21-418f-bb98-35d30bfd9e0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:47.984834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034e9f8a-3c21-418f-bb98-35d30bfd9e0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:48.015019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-034e9f8a-3c21-418f-bb98-35d30bfd9e0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043508 Apr 11 19:54:48.015491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 589/1112] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:48.081058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea79efa6-2c24-463b-a8e9-d61c17ebd8d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:48.081986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ea79efa6-2c24-463b-a8e9-d61c17ebd8d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:48.088611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea79efa6-2c24-463b-a8e9-d61c17ebd8d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:48.089089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea79efa6-2c24-463b-a8e9-d61c17ebd8d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:48.089844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea79efa6-2c24-463b-a8e9-d61c17ebd8d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:48.090272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea79efa6-2c24-463b-a8e9-d61c17ebd8d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:48.119600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea79efa6-2c24-463b-a8e9-d61c17ebd8d8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 Apr 11 19:54:48.120173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 524/1113] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:48.839993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d121918b-37f8-40fc-b11a-3fc82cf1b54a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:48.840535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d121918b-37f8-40fc-b11a-3fc82cf1b54a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:48.847188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d121918b-37f8-40fc-b11a-3fc82cf1b54a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:48.847618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d121918b-37f8-40fc-b11a-3fc82cf1b54a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:48.848407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d121918b-37f8-40fc-b11a-3fc82cf1b54a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:48.848840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d121918b-37f8-40fc-b11a-3fc82cf1b54a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:48.912681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d121918b-37f8-40fc-b11a-3fc82cf1b54a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:48.920658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d121918b-37f8-40fc-b11a-3fc82cf1b54a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084693 Apr 11 19:54:48.921266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 590/1114] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:48 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:48.981671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7efb81d3-6634-49f5-bdad-3edd12028a1d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:48.982601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7efb81d3-6634-49f5-bdad-3edd12028a1d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:48.989445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7efb81d3-6634-49f5-bdad-3edd12028a1d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:48.989999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7efb81d3-6634-49f5-bdad-3edd12028a1d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:48.990862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7efb81d3-6634-49f5-bdad-3edd12028a1d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:48.991334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7efb81d3-6634-49f5-bdad-3edd12028a1d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:49.021777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7efb81d3-6634-49f5-bdad-3edd12028a1d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Apr 11 19:54:49.022304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 525/1115] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:49.027468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e47be01f-c247-4edf-99b0-f01fb42096fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:49.028406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e47be01f-c247-4edf-99b0-f01fb42096fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:49.035092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e47be01f-c247-4edf-99b0-f01fb42096fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:49.035528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e47be01f-c247-4edf-99b0-f01fb42096fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:49.036302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e47be01f-c247-4edf-99b0-f01fb42096fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:49.036721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e47be01f-c247-4edf-99b0-f01fb42096fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:49.066257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e47be01f-c247-4edf-99b0-f01fb42096fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042876 Apr 11 19:54:49.066832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 591/1116] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:49.132425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d60ce90-c55b-4b60-b5bd-0d6905b527de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:49.133324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d60ce90-c55b-4b60-b5bd-0d6905b527de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:49.139905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d60ce90-c55b-4b60-b5bd-0d6905b527de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:49.140379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d60ce90-c55b-4b60-b5bd-0d6905b527de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:49.141203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d60ce90-c55b-4b60-b5bd-0d6905b527de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:49.141632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d60ce90-c55b-4b60-b5bd-0d6905b527de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:49.171381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d60ce90-c55b-4b60-b5bd-0d6905b527de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043338 Apr 11 19:54:49.172023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 526/1117] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:49.937697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2bb8b50f-772e-40a3-b6b6-ee535e7e2101 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:49.940089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2bb8b50f-772e-40a3-b6b6-ee535e7e2101 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:49.945053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2bb8b50f-772e-40a3-b6b6-ee535e7e2101 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:49.945522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2bb8b50f-772e-40a3-b6b6-ee535e7e2101 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:49.946356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2bb8b50f-772e-40a3-b6b6-ee535e7e2101 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:49.946913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2bb8b50f-772e-40a3-b6b6-ee535e7e2101 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:50.007130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2bb8b50f-772e-40a3-b6b6-ee535e7e2101 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:50.014669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2bb8b50f-772e-40a3-b6b6-ee535e7e2101 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080814 Apr 11 19:54:50.015262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 592/1118] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:49 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:50.033606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ddf54534-c01d-4a3a-b5dc-cf663ba48d6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:50.034519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ddf54534-c01d-4a3a-b5dc-cf663ba48d6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:50.041182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddf54534-c01d-4a3a-b5dc-cf663ba48d6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:50.041621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddf54534-c01d-4a3a-b5dc-cf663ba48d6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:50.042361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddf54534-c01d-4a3a-b5dc-cf663ba48d6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:50.042789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddf54534-c01d-4a3a-b5dc-cf663ba48d6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:50.072177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ddf54534-c01d-4a3a-b5dc-cf663ba48d6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042530 Apr 11 19:54:50.072719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 527/1119] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:54:50.079049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7cf4599b-c317-4a76-99be-e5d4d12ebdaf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:50.079961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7cf4599b-c317-4a76-99be-e5d4d12ebdaf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:50.086514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf4599b-c317-4a76-99be-e5d4d12ebdaf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:50.087028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf4599b-c317-4a76-99be-e5d4d12ebdaf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:50.087816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf4599b-c317-4a76-99be-e5d4d12ebdaf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:50.088279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf4599b-c317-4a76-99be-e5d4d12ebdaf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:50.117858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7cf4599b-c317-4a76-99be-e5d4d12ebdaf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042786 Apr 11 19:54:50.118427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 593/1120] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:50.183596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f051ec84-d3c5-466b-a23a-c8b53d925aa0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:50.184519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f051ec84-d3c5-466b-a23a-c8b53d925aa0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:50.191227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f051ec84-d3c5-466b-a23a-c8b53d925aa0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:50.191674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f051ec84-d3c5-466b-a23a-c8b53d925aa0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:50.192442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f051ec84-d3c5-466b-a23a-c8b53d925aa0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:50.192877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f051ec84-d3c5-466b-a23a-c8b53d925aa0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:50.222544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f051ec84-d3c5-466b-a23a-c8b53d925aa0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043008 Apr 11 19:54:50.223098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 528/1121] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:51.031748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-79c4029f-a082-4e2f-8000-6ce44c33963f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:51.032419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-79c4029f-a082-4e2f-8000-6ce44c33963f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:51.038946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79c4029f-a082-4e2f-8000-6ce44c33963f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:51.039428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79c4029f-a082-4e2f-8000-6ce44c33963f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:51.040232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79c4029f-a082-4e2f-8000-6ce44c33963f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:51.040700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79c4029f-a082-4e2f-8000-6ce44c33963f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:51.084035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d0e86c8-63c8-481e-8ab9-82e69e5f4ac6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:51.085225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d0e86c8-63c8-481e-8ab9-82e69e5f4ac6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:51.091784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d0e86c8-63c8-481e-8ab9-82e69e5f4ac6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:51.092230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d0e86c8-63c8-481e-8ab9-82e69e5f4ac6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:51.093019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d0e86c8-63c8-481e-8ab9-82e69e5f4ac6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:51.093454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d0e86c8-63c8-481e-8ab9-82e69e5f4ac6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:51.101806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-79c4029f-a082-4e2f-8000-6ce44c33963f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:51.111122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-79c4029f-a082-4e2f-8000-6ce44c33963f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083187 Apr 11 19:54:51.111957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 594/1122] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:51 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:51.123505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d0e86c8-63c8-481e-8ab9-82e69e5f4ac6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Apr 11 19:54:51.124087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 529/1123] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:51.130113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2efa0f25-3bb8-411d-96e1-2ae72ac068d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:51.131076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2efa0f25-3bb8-411d-96e1-2ae72ac068d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:51.137299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2efa0f25-3bb8-411d-96e1-2ae72ac068d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:51.137753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2efa0f25-3bb8-411d-96e1-2ae72ac068d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:51.138509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2efa0f25-3bb8-411d-96e1-2ae72ac068d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:51.138935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2efa0f25-3bb8-411d-96e1-2ae72ac068d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:51.168211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2efa0f25-3bb8-411d-96e1-2ae72ac068d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041995 Apr 11 19:54:51.168769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 595/1124] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:51.234173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4045a078-2b92-4fee-b314-e442f63954aa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:51.235097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4045a078-2b92-4fee-b314-e442f63954aa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:51.241489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4045a078-2b92-4fee-b314-e442f63954aa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:51.241933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4045a078-2b92-4fee-b314-e442f63954aa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:51.242695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4045a078-2b92-4fee-b314-e442f63954aa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:51.243121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4045a078-2b92-4fee-b314-e442f63954aa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:51.271697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4045a078-2b92-4fee-b314-e442f63954aa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041508 Apr 11 19:54:51.272247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 530/1125] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:52.129076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5cd38840-281d-461f-876f-8c5fd93c7822 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:52.129813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5cd38840-281d-461f-876f-8c5fd93c7822 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:52.134857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c17e5f1d-73ae-4f32-ad3c-d697a5dbb0d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:52.135843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c17e5f1d-73ae-4f32-ad3c-d697a5dbb0d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:52.136630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd38840-281d-461f-876f-8c5fd93c7822 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:52.137098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd38840-281d-461f-876f-8c5fd93c7822 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:52.137863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd38840-281d-461f-876f-8c5fd93c7822 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:52.138262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd38840-281d-461f-876f-8c5fd93c7822 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:52.142048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c17e5f1d-73ae-4f32-ad3c-d697a5dbb0d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:52.142518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c17e5f1d-73ae-4f32-ad3c-d697a5dbb0d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:52.143275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c17e5f1d-73ae-4f32-ad3c-d697a5dbb0d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:52.143704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c17e5f1d-73ae-4f32-ad3c-d697a5dbb0d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:52.174529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c17e5f1d-73ae-4f32-ad3c-d697a5dbb0d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Apr 11 19:54:52.175690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 531/1126] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:52.180677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f06ee003-1abb-43e9-b3e6-e951cd3600b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:52.181640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f06ee003-1abb-43e9-b3e6-e951cd3600b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:52.187851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06ee003-1abb-43e9-b3e6-e951cd3600b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:52.188303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06ee003-1abb-43e9-b3e6-e951cd3600b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:52.189108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06ee003-1abb-43e9-b3e6-e951cd3600b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:52.189546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06ee003-1abb-43e9-b3e6-e951cd3600b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:52.206061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5cd38840-281d-461f-876f-8c5fd93c7822 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:52.213503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5cd38840-281d-461f-876f-8c5fd93c7822 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088837 Apr 11 19:54:52.214079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 596/1127] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:52 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:52.218949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f06ee003-1abb-43e9-b3e6-e951cd3600b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042030 Apr 11 19:54:52.219853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 532/1128] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:52.284318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0494d571-07f0-4a2b-ac36-dab71c7cf9a7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:52.285448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0494d571-07f0-4a2b-ac36-dab71c7cf9a7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:52.291992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0494d571-07f0-4a2b-ac36-dab71c7cf9a7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:52.292410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0494d571-07f0-4a2b-ac36-dab71c7cf9a7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:52.293245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0494d571-07f0-4a2b-ac36-dab71c7cf9a7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:52.293673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0494d571-07f0-4a2b-ac36-dab71c7cf9a7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:52.322882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0494d571-07f0-4a2b-ac36-dab71c7cf9a7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042674 Apr 11 19:54:52.323439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 597/1129] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:53.187570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-41675879-8803-44a2-9514-ce13c1ea7ede tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:53.188530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-41675879-8803-44a2-9514-ce13c1ea7ede tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:53.195437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41675879-8803-44a2-9514-ce13c1ea7ede tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:53.195886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41675879-8803-44a2-9514-ce13c1ea7ede tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:53.196694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41675879-8803-44a2-9514-ce13c1ea7ede tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:53.197192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41675879-8803-44a2-9514-ce13c1ea7ede tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:53.227105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-41675879-8803-44a2-9514-ce13c1ea7ede tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Apr 11 19:54:53.227665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 533/1130] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:53.234685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5cd02f2d-7f47-4a21-9830-0f210ae15ac2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:53.235274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5cd02f2d-7f47-4a21-9830-0f210ae15ac2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:53.237852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-31432deb-de6c-4551-8fe3-a5dd9e070fe6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:53.238774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-31432deb-de6c-4551-8fe3-a5dd9e070fe6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:53.242081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd02f2d-7f47-4a21-9830-0f210ae15ac2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:53.242527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd02f2d-7f47-4a21-9830-0f210ae15ac2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:53.243337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd02f2d-7f47-4a21-9830-0f210ae15ac2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:53.243900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd02f2d-7f47-4a21-9830-0f210ae15ac2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:53.244854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31432deb-de6c-4551-8fe3-a5dd9e070fe6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:53.245342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31432deb-de6c-4551-8fe3-a5dd9e070fe6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:53.246110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31432deb-de6c-4551-8fe3-a5dd9e070fe6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:53.246541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31432deb-de6c-4551-8fe3-a5dd9e070fe6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:53.276542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-31432deb-de6c-4551-8fe3-a5dd9e070fe6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042484 Apr 11 19:54:53.277152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 534/1131] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:53.309679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5cd02f2d-7f47-4a21-9830-0f210ae15ac2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:53.317233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5cd02f2d-7f47-4a21-9830-0f210ae15ac2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086521 Apr 11 19:54:53.317805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 598/1132] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:53 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:53.335151 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-656bf3e1-6f01-4b0c-8211-7529d975c666 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:53.336092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-656bf3e1-6f01-4b0c-8211-7529d975c666 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:53.342716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-656bf3e1-6f01-4b0c-8211-7529d975c666 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:53.343166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-656bf3e1-6f01-4b0c-8211-7529d975c666 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:53.343929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-656bf3e1-6f01-4b0c-8211-7529d975c666 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:53.344369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-656bf3e1-6f01-4b0c-8211-7529d975c666 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:53.373064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-656bf3e1-6f01-4b0c-8211-7529d975c666 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Apr 11 19:54:53.373625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 535/1133] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:54.239955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-681746cc-c15d-492f-91b1-f26022402642 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:54.240984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-681746cc-c15d-492f-91b1-f26022402642 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:54.247799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-681746cc-c15d-492f-91b1-f26022402642 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:54.248264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-681746cc-c15d-492f-91b1-f26022402642 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:54.249074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-681746cc-c15d-492f-91b1-f26022402642 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:54.249513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-681746cc-c15d-492f-91b1-f26022402642 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:54.279764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-681746cc-c15d-492f-91b1-f26022402642 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Apr 11 19:54:54.280337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 599/1134] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:54.289131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fdac60fe-4817-4c32-86f4-e8cd1a5950bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:54.290077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fdac60fe-4817-4c32-86f4-e8cd1a5950bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:54.296810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fdac60fe-4817-4c32-86f4-e8cd1a5950bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:54.297311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fdac60fe-4817-4c32-86f4-e8cd1a5950bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:54.298078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fdac60fe-4817-4c32-86f4-e8cd1a5950bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:54.298517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fdac60fe-4817-4c32-86f4-e8cd1a5950bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:54.327867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fdac60fe-4817-4c32-86f4-e8cd1a5950bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043219 Apr 11 19:54:54.328445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 536/1135] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:54.334365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ae7adbc8-b55d-4a01-9b72-e4dd4ef765a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:54.334976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ae7adbc8-b55d-4a01-9b72-e4dd4ef765a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:54.340935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae7adbc8-b55d-4a01-9b72-e4dd4ef765a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:54.341500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae7adbc8-b55d-4a01-9b72-e4dd4ef765a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:54.342294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae7adbc8-b55d-4a01-9b72-e4dd4ef765a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:54.342722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae7adbc8-b55d-4a01-9b72-e4dd4ef765a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:54.385526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04ce3311-b782-426c-96e4-481e93c2f2a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:54.386492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04ce3311-b782-426c-96e4-481e93c2f2a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:54.392575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04ce3311-b782-426c-96e4-481e93c2f2a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:54.393051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04ce3311-b782-426c-96e4-481e93c2f2a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:54.393818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04ce3311-b782-426c-96e4-481e93c2f2a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:54.394249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04ce3311-b782-426c-96e4-481e93c2f2a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:54.408236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ae7adbc8-b55d-4a01-9b72-e4dd4ef765a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:54.421425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ae7adbc8-b55d-4a01-9b72-e4dd4ef765a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090454 Apr 11 19:54:54.422191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 600/1136] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:54 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:54.427817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04ce3311-b782-426c-96e4-481e93c2f2a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Apr 11 19:54:54.428402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 537/1137] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:55.291562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5252c07a-d070-4b6d-b07a-9f401d2e4d00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:55.292489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5252c07a-d070-4b6d-b07a-9f401d2e4d00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:55.307286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5252c07a-d070-4b6d-b07a-9f401d2e4d00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:55.307286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5252c07a-d070-4b6d-b07a-9f401d2e4d00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:55.307286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5252c07a-d070-4b6d-b07a-9f401d2e4d00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:55.307286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5252c07a-d070-4b6d-b07a-9f401d2e4d00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:55.331050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5252c07a-d070-4b6d-b07a-9f401d2e4d00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 Apr 11 19:54:55.331617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 601/1138] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:55.340143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-73512094-e5ac-4c49-a779-1ab2381e7ed9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:55.341118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-73512094-e5ac-4c49-a779-1ab2381e7ed9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:55.347527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73512094-e5ac-4c49-a779-1ab2381e7ed9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:55.347976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73512094-e5ac-4c49-a779-1ab2381e7ed9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:55.348749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73512094-e5ac-4c49-a779-1ab2381e7ed9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:55.349221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73512094-e5ac-4c49-a779-1ab2381e7ed9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:55.378408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-73512094-e5ac-4c49-a779-1ab2381e7ed9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042307 Apr 11 19:54:55.378950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 538/1139] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:55.439499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4d7c577-5ddd-4aa5-9a57-98ed089b980b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:55.439804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc8797ec-be9f-4f9e-b49a-b01afd64d1cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:55.440123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4d7c577-5ddd-4aa5-9a57-98ed089b980b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:55.440770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc8797ec-be9f-4f9e-b49a-b01afd64d1cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:55.446787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4d7c577-5ddd-4aa5-9a57-98ed089b980b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:55.447251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4d7c577-5ddd-4aa5-9a57-98ed089b980b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:55.447540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc8797ec-be9f-4f9e-b49a-b01afd64d1cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:55.447990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4d7c577-5ddd-4aa5-9a57-98ed089b980b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:55.448170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc8797ec-be9f-4f9e-b49a-b01afd64d1cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:55.448419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4d7c577-5ddd-4aa5-9a57-98ed089b980b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:55.448762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc8797ec-be9f-4f9e-b49a-b01afd64d1cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:55.449241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc8797ec-be9f-4f9e-b49a-b01afd64d1cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:55.487819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc8797ec-be9f-4f9e-b49a-b01afd64d1cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052021 Apr 11 19:54:55.488513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 539/1140] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:55.726733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4d7c577-5ddd-4aa5-9a57-98ed089b980b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:55.734513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4d7c577-5ddd-4aa5-9a57-98ed089b980b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.298988 Apr 11 19:54:55.735063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 602/1141] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:55 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:56.342959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-692222f2-f16b-446b-beb3-7ee7879442b4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:56.343792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-692222f2-f16b-446b-beb3-7ee7879442b4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:56.350335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-692222f2-f16b-446b-beb3-7ee7879442b4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:56.350787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-692222f2-f16b-446b-beb3-7ee7879442b4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:56.351567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-692222f2-f16b-446b-beb3-7ee7879442b4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:56.352007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-692222f2-f16b-446b-beb3-7ee7879442b4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:56.382034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-692222f2-f16b-446b-beb3-7ee7879442b4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043166 Apr 11 19:54:56.382575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 540/1142] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:56.389895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-62c2e995-d720-4098-8490-2b89f0f0d3f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:56.390818 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-62c2e995-d720-4098-8490-2b89f0f0d3f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:56.397940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62c2e995-d720-4098-8490-2b89f0f0d3f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:56.398389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62c2e995-d720-4098-8490-2b89f0f0d3f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:56.399163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62c2e995-d720-4098-8490-2b89f0f0d3f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:56.399597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62c2e995-d720-4098-8490-2b89f0f0d3f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:56.429518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-62c2e995-d720-4098-8490-2b89f0f0d3f8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043647 Apr 11 19:54:56.430061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 603/1143] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:56.500434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3a1c41c-303f-4762-9904-7de886e7a42b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:56.501417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3a1c41c-303f-4762-9904-7de886e7a42b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:56.508341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a1c41c-303f-4762-9904-7de886e7a42b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:56.508525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a1c41c-303f-4762-9904-7de886e7a42b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:56.509282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a1c41c-303f-4762-9904-7de886e7a42b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:56.509692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a1c41c-303f-4762-9904-7de886e7a42b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:56.539289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3a1c41c-303f-4762-9904-7de886e7a42b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 Apr 11 19:54:56.539859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 541/1144] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:56.752195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-41e5456a-38c4-411c-8f79-38af44eeac4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:56.752931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-41e5456a-38c4-411c-8f79-38af44eeac4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:56.759519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41e5456a-38c4-411c-8f79-38af44eeac4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:56.759996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41e5456a-38c4-411c-8f79-38af44eeac4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:56.760757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41e5456a-38c4-411c-8f79-38af44eeac4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:56.761215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41e5456a-38c4-411c-8f79-38af44eeac4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:56.821447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-41e5456a-38c4-411c-8f79-38af44eeac4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:56.828869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-41e5456a-38c4-411c-8f79-38af44eeac4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080924 Apr 11 19:54:56.829495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 604/1145] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:56 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:57.394818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53221ec1-c9db-4d1f-9648-106cd0a05d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:57.395670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53221ec1-c9db-4d1f-9648-106cd0a05d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:57.408682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53221ec1-c9db-4d1f-9648-106cd0a05d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:57.409179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53221ec1-c9db-4d1f-9648-106cd0a05d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:57.409958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53221ec1-c9db-4d1f-9648-106cd0a05d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:57.410390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53221ec1-c9db-4d1f-9648-106cd0a05d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:57.442870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53221ec1-c9db-4d1f-9648-106cd0a05d13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051955 Apr 11 19:54:57.443896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 542/1146] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:57.444880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b5992ddb-bcfc-4f94-badc-6bbd53bca240 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:57.446328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b5992ddb-bcfc-4f94-badc-6bbd53bca240 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:57.461784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5992ddb-bcfc-4f94-badc-6bbd53bca240 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:57.462469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5992ddb-bcfc-4f94-badc-6bbd53bca240 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:57.463668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5992ddb-bcfc-4f94-badc-6bbd53bca240 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:57.464316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5992ddb-bcfc-4f94-badc-6bbd53bca240 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:57.496650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b5992ddb-bcfc-4f94-badc-6bbd53bca240 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058594 Apr 11 19:54:57.497255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 605/1147] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:54:57.550673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2029e9a2-81c8-492f-a9d4-7fdabf538eca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:57.551631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2029e9a2-81c8-492f-a9d4-7fdabf538eca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:57.558212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2029e9a2-81c8-492f-a9d4-7fdabf538eca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:57.558663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2029e9a2-81c8-492f-a9d4-7fdabf538eca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:57.559430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2029e9a2-81c8-492f-a9d4-7fdabf538eca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:57.559934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2029e9a2-81c8-492f-a9d4-7fdabf538eca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:57.589674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2029e9a2-81c8-492f-a9d4-7fdabf538eca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Apr 11 19:54:57.590214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 543/1148] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:57.846569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-df30125a-5a07-4f55-9f11-1bd675b573a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:57.847176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-df30125a-5a07-4f55-9f11-1bd675b573a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:57.853803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df30125a-5a07-4f55-9f11-1bd675b573a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:57.854254 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df30125a-5a07-4f55-9f11-1bd675b573a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:57.855048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df30125a-5a07-4f55-9f11-1bd675b573a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:57.855487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df30125a-5a07-4f55-9f11-1bd675b573a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:57.922232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-df30125a-5a07-4f55-9f11-1bd675b573a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:57.930538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-df30125a-5a07-4f55-9f11-1bd675b573a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087880 Apr 11 19:54:57.931107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 606/1149] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:57 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:58.455190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d39ae0eb-0ccd-41fb-98bd-8e6bc6ce2eb2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:58.456065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d39ae0eb-0ccd-41fb-98bd-8e6bc6ce2eb2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:58.462991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d39ae0eb-0ccd-41fb-98bd-8e6bc6ce2eb2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:58.463434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d39ae0eb-0ccd-41fb-98bd-8e6bc6ce2eb2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:58.464201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d39ae0eb-0ccd-41fb-98bd-8e6bc6ce2eb2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:58.464630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d39ae0eb-0ccd-41fb-98bd-8e6bc6ce2eb2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:58.495581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d39ae0eb-0ccd-41fb-98bd-8e6bc6ce2eb2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044502 Apr 11 19:54:58.496152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 544/1150] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:58.510034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ee025ca-86b5-4aa1-892e-2ff6714f869e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:58.510685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ee025ca-86b5-4aa1-892e-2ff6714f869e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:58.517393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee025ca-86b5-4aa1-892e-2ff6714f869e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:58.518023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee025ca-86b5-4aa1-892e-2ff6714f869e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:58.518628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee025ca-86b5-4aa1-892e-2ff6714f869e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:58.519059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee025ca-86b5-4aa1-892e-2ff6714f869e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:58.549041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ee025ca-86b5-4aa1-892e-2ff6714f869e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043503 Apr 11 19:54:58.549639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 607/1151] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:58.602198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6afe90b6-6d3b-4fad-99c3-ee51b1aa9113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:58.603124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6afe90b6-6d3b-4fad-99c3-ee51b1aa9113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:58.609704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afe90b6-6d3b-4fad-99c3-ee51b1aa9113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:58.610133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afe90b6-6d3b-4fad-99c3-ee51b1aa9113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:58.610927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afe90b6-6d3b-4fad-99c3-ee51b1aa9113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:58.611359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afe90b6-6d3b-4fad-99c3-ee51b1aa9113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:58.649326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6afe90b6-6d3b-4fad-99c3-ee51b1aa9113 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051331 Apr 11 19:54:58.649921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 545/1152] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:58.949249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48bf4359-f357-4aff-8103-93d63f667e98 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:58.950203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-48bf4359-f357-4aff-8103-93d63f667e98 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:58.956606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48bf4359-f357-4aff-8103-93d63f667e98 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:58.957094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48bf4359-f357-4aff-8103-93d63f667e98 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:58.957865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48bf4359-f357-4aff-8103-93d63f667e98 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:58.958390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48bf4359-f357-4aff-8103-93d63f667e98 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:59.020949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-48bf4359-f357-4aff-8103-93d63f667e98 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:54:59.028937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-48bf4359-f357-4aff-8103-93d63f667e98 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083632 Apr 11 19:54:59.029538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 608/1153] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:54:58 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:54:59.508734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b94bb647-cf79-4bc3-8b12-328527420547 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:59.509721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b94bb647-cf79-4bc3-8b12-328527420547 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:59.517055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b94bb647-cf79-4bc3-8b12-328527420547 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:59.517532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b94bb647-cf79-4bc3-8b12-328527420547 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:59.518286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b94bb647-cf79-4bc3-8b12-328527420547 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:59.518729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b94bb647-cf79-4bc3-8b12-328527420547 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:59.549118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b94bb647-cf79-4bc3-8b12-328527420547 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Apr 11 19:54:59.549660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 546/1154] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:54:59.561186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3395a067-6eda-4cd9-b1cf-645679f2d4e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:59.562125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3395a067-6eda-4cd9-b1cf-645679f2d4e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:59.568712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3395a067-6eda-4cd9-b1cf-645679f2d4e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:59.569217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3395a067-6eda-4cd9-b1cf-645679f2d4e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:59.570011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3395a067-6eda-4cd9-b1cf-645679f2d4e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:59.570444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3395a067-6eda-4cd9-b1cf-645679f2d4e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:59.600208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3395a067-6eda-4cd9-b1cf-645679f2d4e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043077 Apr 11 19:54:59.600814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 609/1155] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:54:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:54:59.661484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02241337-fc51-4bb9-842f-5383e8fd7913 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:54:59.662502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02241337-fc51-4bb9-842f-5383e8fd7913 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:54:59.669245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02241337-fc51-4bb9-842f-5383e8fd7913 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:59.669694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02241337-fc51-4bb9-842f-5383e8fd7913 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:59.670458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02241337-fc51-4bb9-842f-5383e8fd7913 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:54:59.670888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02241337-fc51-4bb9-842f-5383e8fd7913 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:54:59.700083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02241337-fc51-4bb9-842f-5383e8fd7913 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 Apr 11 19:54:59.700643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 547/1156] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:54:59 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:00.046454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-042975ae-0d79-4f5b-b978-49a778ace87f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:00.047057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-042975ae-0d79-4f5b-b978-49a778ace87f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:00.053695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-042975ae-0d79-4f5b-b978-49a778ace87f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:00.054143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-042975ae-0d79-4f5b-b978-49a778ace87f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:00.054906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-042975ae-0d79-4f5b-b978-49a778ace87f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:00.055335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-042975ae-0d79-4f5b-b978-49a778ace87f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:00.122849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-042975ae-0d79-4f5b-b978-49a778ace87f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:00.131590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-042975ae-0d79-4f5b-b978-49a778ace87f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.089046 Apr 11 19:55:00.132179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 610/1157] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:00 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:00.561785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce7b9216-8b5c-42ea-815d-41096ee5e51b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:00.562708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce7b9216-8b5c-42ea-815d-41096ee5e51b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:00.569584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce7b9216-8b5c-42ea-815d-41096ee5e51b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:00.570031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce7b9216-8b5c-42ea-815d-41096ee5e51b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:00.570794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce7b9216-8b5c-42ea-815d-41096ee5e51b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:00.571226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce7b9216-8b5c-42ea-815d-41096ee5e51b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:00.601203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce7b9216-8b5c-42ea-815d-41096ee5e51b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043402 Apr 11 19:55:00.601738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 548/1158] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:00.611873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6309a12-f20b-4c99-9f4c-9dfb8a1b4f06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:00.612820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a6309a12-f20b-4c99-9f4c-9dfb8a1b4f06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:00.619628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6309a12-f20b-4c99-9f4c-9dfb8a1b4f06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:00.620069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6309a12-f20b-4c99-9f4c-9dfb8a1b4f06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:00.620813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6309a12-f20b-4c99-9f4c-9dfb8a1b4f06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:00.621272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6309a12-f20b-4c99-9f4c-9dfb8a1b4f06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:00.651559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a6309a12-f20b-4c99-9f4c-9dfb8a1b4f06 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043628 Apr 11 19:55:00.652118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 611/1159] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:00.711764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d99f731b-ede9-4b35-ad7c-c687abb03cb9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:00.712683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d99f731b-ede9-4b35-ad7c-c687abb03cb9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:00.718849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d99f731b-ede9-4b35-ad7c-c687abb03cb9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:00.719295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d99f731b-ede9-4b35-ad7c-c687abb03cb9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:00.720060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d99f731b-ede9-4b35-ad7c-c687abb03cb9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:00.720489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d99f731b-ede9-4b35-ad7c-c687abb03cb9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:00.748316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d99f731b-ede9-4b35-ad7c-c687abb03cb9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040539 Apr 11 19:55:00.748879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 549/1160] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:01.148576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c57c8803-1636-4594-9d2b-fa5c967246ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:01.149211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c57c8803-1636-4594-9d2b-fa5c967246ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:01.155640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c57c8803-1636-4594-9d2b-fa5c967246ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:01.156081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c57c8803-1636-4594-9d2b-fa5c967246ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:01.156842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c57c8803-1636-4594-9d2b-fa5c967246ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:01.157384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c57c8803-1636-4594-9d2b-fa5c967246ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:01.219112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c57c8803-1636-4594-9d2b-fa5c967246ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:01.227346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c57c8803-1636-4594-9d2b-fa5c967246ce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082632 Apr 11 19:55:01.227919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 612/1161] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:01 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:01.613347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f92d43cd-073d-4fc9-a4b8-06c1e3cf3b7a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:01.614266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f92d43cd-073d-4fc9-a4b8-06c1e3cf3b7a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:01.621142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f92d43cd-073d-4fc9-a4b8-06c1e3cf3b7a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:01.621586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f92d43cd-073d-4fc9-a4b8-06c1e3cf3b7a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:01.622356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f92d43cd-073d-4fc9-a4b8-06c1e3cf3b7a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:01.622784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f92d43cd-073d-4fc9-a4b8-06c1e3cf3b7a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:01.652790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f92d43cd-073d-4fc9-a4b8-06c1e3cf3b7a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Apr 11 19:55:01.653392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 550/1162] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:01.663577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b5a1cd46-be36-4097-8abb-bef74c9075bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:01.664531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b5a1cd46-be36-4097-8abb-bef74c9075bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:01.671210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5a1cd46-be36-4097-8abb-bef74c9075bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:01.671657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5a1cd46-be36-4097-8abb-bef74c9075bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:01.672415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5a1cd46-be36-4097-8abb-bef74c9075bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:01.672846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5a1cd46-be36-4097-8abb-bef74c9075bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:01.702018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b5a1cd46-be36-4097-8abb-bef74c9075bc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042362 Apr 11 19:55:01.702580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 613/1163] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:01.760740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6f0da44-2d80-4847-b667-db646d09a8b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:01.761794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a6f0da44-2d80-4847-b667-db646d09a8b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:01.768401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6f0da44-2d80-4847-b667-db646d09a8b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:01.768889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6f0da44-2d80-4847-b667-db646d09a8b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:01.769732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6f0da44-2d80-4847-b667-db646d09a8b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:01.770194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6f0da44-2d80-4847-b667-db646d09a8b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:01.799575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6f0da44-2d80-4847-b667-db646d09a8b6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 Apr 11 19:55:01.800454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 551/1164] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:02.244343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2898258-ef15-45da-beca-5012ffa2f006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:02.244938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2898258-ef15-45da-beca-5012ffa2f006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:02.251678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2898258-ef15-45da-beca-5012ffa2f006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:02.252123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2898258-ef15-45da-beca-5012ffa2f006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:02.252894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2898258-ef15-45da-beca-5012ffa2f006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:02.253358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2898258-ef15-45da-beca-5012ffa2f006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:02.315274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c2898258-ef15-45da-beca-5012ffa2f006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:02.323296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2898258-ef15-45da-beca-5012ffa2f006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082893 Apr 11 19:55:02.323862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 614/1165] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:02 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:02.665466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c71e93a-5379-4809-ba6e-ed2e6ed6480d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:02.666402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c71e93a-5379-4809-ba6e-ed2e6ed6480d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:02.673241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c71e93a-5379-4809-ba6e-ed2e6ed6480d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:02.673687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c71e93a-5379-4809-ba6e-ed2e6ed6480d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:02.674451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c71e93a-5379-4809-ba6e-ed2e6ed6480d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:02.674865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c71e93a-5379-4809-ba6e-ed2e6ed6480d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:02.704616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c71e93a-5379-4809-ba6e-ed2e6ed6480d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 Apr 11 19:55:02.705264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 552/1166] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:02.715001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-700aed3c-68dc-430d-9d19-2e9ebbca10ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:02.715952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-700aed3c-68dc-430d-9d19-2e9ebbca10ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:02.722707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-700aed3c-68dc-430d-9d19-2e9ebbca10ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:02.723157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-700aed3c-68dc-430d-9d19-2e9ebbca10ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:02.723920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-700aed3c-68dc-430d-9d19-2e9ebbca10ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:02.724352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-700aed3c-68dc-430d-9d19-2e9ebbca10ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:02.754562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-700aed3c-68dc-430d-9d19-2e9ebbca10ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043540 Apr 11 19:55:02.755128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 615/1167] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:02.812098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7b921098-0e06-4d8e-a2e7-92036a3a75c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:02.812936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7b921098-0e06-4d8e-a2e7-92036a3a75c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:02.819513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b921098-0e06-4d8e-a2e7-92036a3a75c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:02.819954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b921098-0e06-4d8e-a2e7-92036a3a75c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:02.820712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b921098-0e06-4d8e-a2e7-92036a3a75c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:02.821166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b921098-0e06-4d8e-a2e7-92036a3a75c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:02.850607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7b921098-0e06-4d8e-a2e7-92036a3a75c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042774 Apr 11 19:55:02.851166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 553/1168] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:03.340266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fe728a36-d3ba-43ba-9def-18458356cdab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:03.340873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fe728a36-d3ba-43ba-9def-18458356cdab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:03.347446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe728a36-d3ba-43ba-9def-18458356cdab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:03.347899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe728a36-d3ba-43ba-9def-18458356cdab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:03.348666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe728a36-d3ba-43ba-9def-18458356cdab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:03.349133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe728a36-d3ba-43ba-9def-18458356cdab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:03.410444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fe728a36-d3ba-43ba-9def-18458356cdab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:03.418995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fe728a36-d3ba-43ba-9def-18458356cdab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082819 Apr 11 19:55:03.419580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 616/1169] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:03 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:03.717210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5cfd31c8-7e91-43ed-8956-f6e88191a360 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:03.718052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5cfd31c8-7e91-43ed-8956-f6e88191a360 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:03.724663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cfd31c8-7e91-43ed-8956-f6e88191a360 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:03.725149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cfd31c8-7e91-43ed-8956-f6e88191a360 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:03.725907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cfd31c8-7e91-43ed-8956-f6e88191a360 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:03.726337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cfd31c8-7e91-43ed-8956-f6e88191a360 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:03.759455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5cfd31c8-7e91-43ed-8956-f6e88191a360 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Apr 11 19:55:03.763470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 554/1170] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:03.767885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fb18e1d9-0c88-4e34-85c4-b547f0c58b7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:03.768830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fb18e1d9-0c88-4e34-85c4-b547f0c58b7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:03.775636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb18e1d9-0c88-4e34-85c4-b547f0c58b7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:03.776339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb18e1d9-0c88-4e34-85c4-b547f0c58b7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:03.777217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb18e1d9-0c88-4e34-85c4-b547f0c58b7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:03.777814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb18e1d9-0c88-4e34-85c4-b547f0c58b7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:03.810986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fb18e1d9-0c88-4e34-85c4-b547f0c58b7a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047556 Apr 11 19:55:03.811545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 617/1171] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:03.862861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a281cbdd-33d7-43c1-bc77-d4fdbc33869a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:03.863788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a281cbdd-33d7-43c1-bc77-d4fdbc33869a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:03.870485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a281cbdd-33d7-43c1-bc77-d4fdbc33869a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:03.871114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a281cbdd-33d7-43c1-bc77-d4fdbc33869a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:03.872026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a281cbdd-33d7-43c1-bc77-d4fdbc33869a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:03.872551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a281cbdd-33d7-43c1-bc77-d4fdbc33869a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:03.903704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a281cbdd-33d7-43c1-bc77-d4fdbc33869a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Apr 11 19:55:03.904285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 555/1172] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:04.437837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ebabcfe4-8a4d-4e2e-b2e3-0dcac2dd885c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:04.438352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ebabcfe4-8a4d-4e2e-b2e3-0dcac2dd885c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:04.444547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebabcfe4-8a4d-4e2e-b2e3-0dcac2dd885c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:04.444955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebabcfe4-8a4d-4e2e-b2e3-0dcac2dd885c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:04.445712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebabcfe4-8a4d-4e2e-b2e3-0dcac2dd885c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:04.446139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebabcfe4-8a4d-4e2e-b2e3-0dcac2dd885c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:04.506976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ebabcfe4-8a4d-4e2e-b2e3-0dcac2dd885c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:04.516424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ebabcfe4-8a4d-4e2e-b2e3-0dcac2dd885c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082257 Apr 11 19:55:04.517296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 618/1173] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:04 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:04.772159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c16b264-b806-4b30-95fa-687100f4c80a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:04.773019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c16b264-b806-4b30-95fa-687100f4c80a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:04.779842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c16b264-b806-4b30-95fa-687100f4c80a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:04.780289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c16b264-b806-4b30-95fa-687100f4c80a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:04.781086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c16b264-b806-4b30-95fa-687100f4c80a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:04.781520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c16b264-b806-4b30-95fa-687100f4c80a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:04.811215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c16b264-b806-4b30-95fa-687100f4c80a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Apr 11 19:55:04.811772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 556/1174] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:04.823006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-582b3c7c-0658-486b-9758-918d3cf6198f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:04.823924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-582b3c7c-0658-486b-9758-918d3cf6198f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:04.830624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-582b3c7c-0658-486b-9758-918d3cf6198f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:04.831183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-582b3c7c-0658-486b-9758-918d3cf6198f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:04.831983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-582b3c7c-0658-486b-9758-918d3cf6198f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:04.832446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-582b3c7c-0658-486b-9758-918d3cf6198f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:04.861586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-582b3c7c-0658-486b-9758-918d3cf6198f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042478 Apr 11 19:55:04.862129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 619/1175] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:04.916198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0e047a6-3ee3-46f9-8557-bef4a5756c73 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:04.917168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0e047a6-3ee3-46f9-8557-bef4a5756c73 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:04.923653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0e047a6-3ee3-46f9-8557-bef4a5756c73 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:04.924102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0e047a6-3ee3-46f9-8557-bef4a5756c73 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:04.924870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0e047a6-3ee3-46f9-8557-bef4a5756c73 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:04.925339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0e047a6-3ee3-46f9-8557-bef4a5756c73 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:04.954491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0e047a6-3ee3-46f9-8557-bef4a5756c73 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042391 Apr 11 19:55:04.955082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 557/1176] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:05.534135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cf8e2f4-2fb8-433c-ba5d-2538066c860b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:05.534622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cf8e2f4-2fb8-433c-ba5d-2538066c860b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:05.541306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf8e2f4-2fb8-433c-ba5d-2538066c860b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:05.541794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf8e2f4-2fb8-433c-ba5d-2538066c860b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:05.542566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf8e2f4-2fb8-433c-ba5d-2538066c860b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:05.542999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf8e2f4-2fb8-433c-ba5d-2538066c860b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:05.605898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cf8e2f4-2fb8-433c-ba5d-2538066c860b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:05.613979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cf8e2f4-2fb8-433c-ba5d-2538066c860b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083970 Apr 11 19:55:05.614567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 620/1177] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:05 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:05.823590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d7a9590c-d734-41bf-8f7d-79deb2d0084a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:05.824427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d7a9590c-d734-41bf-8f7d-79deb2d0084a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:05.831405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7a9590c-d734-41bf-8f7d-79deb2d0084a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:05.831859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7a9590c-d734-41bf-8f7d-79deb2d0084a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:05.832627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7a9590c-d734-41bf-8f7d-79deb2d0084a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:05.833089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7a9590c-d734-41bf-8f7d-79deb2d0084a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:05.863325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d7a9590c-d734-41bf-8f7d-79deb2d0084a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Apr 11 19:55:05.863907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 558/1178] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:05.874130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73ef4b4b-f775-4c74-8abd-75964731b88a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:05.875435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73ef4b4b-f775-4c74-8abd-75964731b88a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:05.881903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73ef4b4b-f775-4c74-8abd-75964731b88a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:05.882347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73ef4b4b-f775-4c74-8abd-75964731b88a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:05.883099 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73ef4b4b-f775-4c74-8abd-75964731b88a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:05.883523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73ef4b4b-f775-4c74-8abd-75964731b88a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:05.913245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73ef4b4b-f775-4c74-8abd-75964731b88a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042997 Apr 11 19:55:05.913792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 621/1179] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:05.966637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-91659366-b24b-4e6a-8ce8-0d447238aa91 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:05.967554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-91659366-b24b-4e6a-8ce8-0d447238aa91 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:05.974066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91659366-b24b-4e6a-8ce8-0d447238aa91 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:05.974563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91659366-b24b-4e6a-8ce8-0d447238aa91 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:05.975324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91659366-b24b-4e6a-8ce8-0d447238aa91 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:05.975748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91659366-b24b-4e6a-8ce8-0d447238aa91 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:06.004809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-91659366-b24b-4e6a-8ce8-0d447238aa91 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 Apr 11 19:55:06.005395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 559/1180] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:06.631893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9e727097-eabc-459b-aef8-41047c606d9f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:06.632513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9e727097-eabc-459b-aef8-41047c606d9f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:06.639170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e727097-eabc-459b-aef8-41047c606d9f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:06.639616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e727097-eabc-459b-aef8-41047c606d9f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:06.640397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e727097-eabc-459b-aef8-41047c606d9f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:06.640803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e727097-eabc-459b-aef8-41047c606d9f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:06.703034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9e727097-eabc-459b-aef8-41047c606d9f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:06.710805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9e727097-eabc-459b-aef8-41047c606d9f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082819 Apr 11 19:55:06.711407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 622/1181] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:06 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:06.876737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66f9d6bc-237b-4b80-80af-f35175c2c3de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:06.877640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-66f9d6bc-237b-4b80-80af-f35175c2c3de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:06.884490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66f9d6bc-237b-4b80-80af-f35175c2c3de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:06.884938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66f9d6bc-237b-4b80-80af-f35175c2c3de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:06.885732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66f9d6bc-237b-4b80-80af-f35175c2c3de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:06.886168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66f9d6bc-237b-4b80-80af-f35175c2c3de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:06.916104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-66f9d6bc-237b-4b80-80af-f35175c2c3de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Apr 11 19:55:06.916670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 560/1182] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:06.927778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e087f4be-3fb3-4c3e-a4c3-4f92519111c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:06.928706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e087f4be-3fb3-4c3e-a4c3-4f92519111c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:06.935585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e087f4be-3fb3-4c3e-a4c3-4f92519111c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:06.936036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e087f4be-3fb3-4c3e-a4c3-4f92519111c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:06.936818 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e087f4be-3fb3-4c3e-a4c3-4f92519111c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:06.937303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e087f4be-3fb3-4c3e-a4c3-4f92519111c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:06.969127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e087f4be-3fb3-4c3e-a4c3-4f92519111c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045143 Apr 11 19:55:06.969722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 623/1183] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:07.017003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-984ac7f6-2498-41b1-ac34-3619710d21bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:07.018049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-984ac7f6-2498-41b1-ac34-3619710d21bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:07.024944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-984ac7f6-2498-41b1-ac34-3619710d21bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:07.025435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-984ac7f6-2498-41b1-ac34-3619710d21bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:07.026196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-984ac7f6-2498-41b1-ac34-3619710d21bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:07.026752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-984ac7f6-2498-41b1-ac34-3619710d21bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:07.057023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-984ac7f6-2498-41b1-ac34-3619710d21bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Apr 11 19:55:07.057588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 561/1184] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:07.728162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5349b855-1604-429a-a527-318629031436 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:07.728773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5349b855-1604-429a-a527-318629031436 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:07.735164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5349b855-1604-429a-a527-318629031436 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:07.735605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5349b855-1604-429a-a527-318629031436 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:07.736360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5349b855-1604-429a-a527-318629031436 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:07.736788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5349b855-1604-429a-a527-318629031436 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:07.797947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5349b855-1604-429a-a527-318629031436 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:07.805623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5349b855-1604-429a-a527-318629031436 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081598 Apr 11 19:55:07.806175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 624/1185] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:07 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:07.929714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1344e2db-d6cb-4600-80e2-f25cbe46cff2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:07.930665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1344e2db-d6cb-4600-80e2-f25cbe46cff2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:07.937913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1344e2db-d6cb-4600-80e2-f25cbe46cff2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:07.938359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1344e2db-d6cb-4600-80e2-f25cbe46cff2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:07.939120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1344e2db-d6cb-4600-80e2-f25cbe46cff2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:07.939550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1344e2db-d6cb-4600-80e2-f25cbe46cff2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:07.979296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1344e2db-d6cb-4600-80e2-f25cbe46cff2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054123 Apr 11 19:55:07.980049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 562/1186] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:07.981024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-62af71a3-117e-461a-87cf-535feb49868d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:07.982482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-62af71a3-117e-461a-87cf-535feb49868d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:07.989214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62af71a3-117e-461a-87cf-535feb49868d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:07.989654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62af71a3-117e-461a-87cf-535feb49868d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:07.990426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62af71a3-117e-461a-87cf-535feb49868d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:07.990876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62af71a3-117e-461a-87cf-535feb49868d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:08.022062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-62af71a3-117e-461a-87cf-535feb49868d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044940 Apr 11 19:55:08.022619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 625/1187] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:08.070193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-96c6d3a7-6e20-4635-b2c1-f048e3740adc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:08.071152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-96c6d3a7-6e20-4635-b2c1-f048e3740adc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:08.077842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96c6d3a7-6e20-4635-b2c1-f048e3740adc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:08.078287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96c6d3a7-6e20-4635-b2c1-f048e3740adc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:08.079034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96c6d3a7-6e20-4635-b2c1-f048e3740adc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:08.079464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96c6d3a7-6e20-4635-b2c1-f048e3740adc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:08.110043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-96c6d3a7-6e20-4635-b2c1-f048e3740adc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Apr 11 19:55:08.110683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 563/1188] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:08.822927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f56f78c1-7b66-4c4a-9c03-f56fb28eb421 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:08.823432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f56f78c1-7b66-4c4a-9c03-f56fb28eb421 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:08.830470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f56f78c1-7b66-4c4a-9c03-f56fb28eb421 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:08.830959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f56f78c1-7b66-4c4a-9c03-f56fb28eb421 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:08.831712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f56f78c1-7b66-4c4a-9c03-f56fb28eb421 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:08.832135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f56f78c1-7b66-4c4a-9c03-f56fb28eb421 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:08.896347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f56f78c1-7b66-4c4a-9c03-f56fb28eb421 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:08.904006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f56f78c1-7b66-4c4a-9c03-f56fb28eb421 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085507 Apr 11 19:55:08.904570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 626/1189] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:08 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:08.991443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ca46ba16-4d59-4ec5-8114-3d6b2d0e4dcd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:08.992369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ca46ba16-4d59-4ec5-8114-3d6b2d0e4dcd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:08.999253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca46ba16-4d59-4ec5-8114-3d6b2d0e4dcd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:09.000097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca46ba16-4d59-4ec5-8114-3d6b2d0e4dcd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:09.000894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca46ba16-4d59-4ec5-8114-3d6b2d0e4dcd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:09.001353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca46ba16-4d59-4ec5-8114-3d6b2d0e4dcd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:09.030941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ca46ba16-4d59-4ec5-8114-3d6b2d0e4dcd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Apr 11 19:55:09.031725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 564/1190] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:09.035816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a9f254b2-8847-4201-8b94-124639ff9e2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:09.037273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a9f254b2-8847-4201-8b94-124639ff9e2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:09.047816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9f254b2-8847-4201-8b94-124639ff9e2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:09.048736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9f254b2-8847-4201-8b94-124639ff9e2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:09.050146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9f254b2-8847-4201-8b94-124639ff9e2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:09.051196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9f254b2-8847-4201-8b94-124639ff9e2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:09.092366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a9f254b2-8847-4201-8b94-124639ff9e2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060974 Apr 11 19:55:09.092845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 627/1191] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:09.127446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e8eeca2e-f4fe-47c0-ac9d-1ba0c7f3f306 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:09.128552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e8eeca2e-f4fe-47c0-ac9d-1ba0c7f3f306 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:09.136045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8eeca2e-f4fe-47c0-ac9d-1ba0c7f3f306 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:09.136657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8eeca2e-f4fe-47c0-ac9d-1ba0c7f3f306 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:09.137747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8eeca2e-f4fe-47c0-ac9d-1ba0c7f3f306 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:09.138311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8eeca2e-f4fe-47c0-ac9d-1ba0c7f3f306 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:09.174874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e8eeca2e-f4fe-47c0-ac9d-1ba0c7f3f306 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056823 Apr 11 19:55:09.175964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 565/1192] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:55:09.922162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5096c6c-ccf4-4e70-84e8-fc775fee5ae9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:09.922815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5096c6c-ccf4-4e70-84e8-fc775fee5ae9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:09.929758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5096c6c-ccf4-4e70-84e8-fc775fee5ae9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:09.930242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5096c6c-ccf4-4e70-84e8-fc775fee5ae9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:09.931051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5096c6c-ccf4-4e70-84e8-fc775fee5ae9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:09.931530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5096c6c-ccf4-4e70-84e8-fc775fee5ae9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:09.995027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5096c6c-ccf4-4e70-84e8-fc775fee5ae9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:10.003280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5096c6c-ccf4-4e70-84e8-fc775fee5ae9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085704 Apr 11 19:55:10.003875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 628/1193] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:09 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:10.042631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a7a4970-a2e7-4dfb-948d-51dadfdad294 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:10.043766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a7a4970-a2e7-4dfb-948d-51dadfdad294 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:10.050849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a7a4970-a2e7-4dfb-948d-51dadfdad294 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:10.051493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a7a4970-a2e7-4dfb-948d-51dadfdad294 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:10.052254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a7a4970-a2e7-4dfb-948d-51dadfdad294 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:10.052795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a7a4970-a2e7-4dfb-948d-51dadfdad294 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:10.083215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a7a4970-a2e7-4dfb-948d-51dadfdad294 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Apr 11 19:55:10.083838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 566/1194] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:10.105850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-de9b9890-14a5-482d-b8a0-e05500b85d91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:10.106913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-de9b9890-14a5-482d-b8a0-e05500b85d91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:10.113657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de9b9890-14a5-482d-b8a0-e05500b85d91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:10.114097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de9b9890-14a5-482d-b8a0-e05500b85d91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:10.114893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de9b9890-14a5-482d-b8a0-e05500b85d91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:10.115317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de9b9890-14a5-482d-b8a0-e05500b85d91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:10.145593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-de9b9890-14a5-482d-b8a0-e05500b85d91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044192 Apr 11 19:55:10.146156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 629/1195] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:10.188176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1e2c923-7dce-4f53-82db-0a96222ba548 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:10.189309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f1e2c923-7dce-4f53-82db-0a96222ba548 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:10.196446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1e2c923-7dce-4f53-82db-0a96222ba548 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:10.196891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1e2c923-7dce-4f53-82db-0a96222ba548 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:10.197684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1e2c923-7dce-4f53-82db-0a96222ba548 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:10.198118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1e2c923-7dce-4f53-82db-0a96222ba548 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:10.227718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f1e2c923-7dce-4f53-82db-0a96222ba548 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Apr 11 19:55:10.228282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 567/1196] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:11.020455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-78b897bf-a23b-466b-8ba6-cd9fd781b3ec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:11.021107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-78b897bf-a23b-466b-8ba6-cd9fd781b3ec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:11.027821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78b897bf-a23b-466b-8ba6-cd9fd781b3ec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:11.028316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78b897bf-a23b-466b-8ba6-cd9fd781b3ec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:11.029202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78b897bf-a23b-466b-8ba6-cd9fd781b3ec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:11.029640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78b897bf-a23b-466b-8ba6-cd9fd781b3ec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:11.094491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78b897bf-a23b-466b-8ba6-cd9fd781b3ec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:11.095333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0be95d99-0868-42af-a94f-b3b197bde5d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:11.096278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0be95d99-0868-42af-a94f-b3b197bde5d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:11.102763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-78b897bf-a23b-466b-8ba6-cd9fd781b3ec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086400 Apr 11 19:55:11.103002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0be95d99-0868-42af-a94f-b3b197bde5d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:11.103339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 630/1197] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:11 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:11.103451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0be95d99-0868-42af-a94f-b3b197bde5d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:11.104217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0be95d99-0868-42af-a94f-b3b197bde5d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:11.104646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0be95d99-0868-42af-a94f-b3b197bde5d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:11.135076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0be95d99-0868-42af-a94f-b3b197bde5d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 Apr 11 19:55:11.135635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 568/1198] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:11.157885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f02731f2-182f-4518-b807-5d8346bbb16d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:11.158900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f02731f2-182f-4518-b807-5d8346bbb16d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:11.165924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f02731f2-182f-4518-b807-5d8346bbb16d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:11.166365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f02731f2-182f-4518-b807-5d8346bbb16d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:11.167115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f02731f2-182f-4518-b807-5d8346bbb16d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:11.167543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f02731f2-182f-4518-b807-5d8346bbb16d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:11.197612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f02731f2-182f-4518-b807-5d8346bbb16d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043882 Apr 11 19:55:11.198171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 631/1199] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:11.239831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d50b7b7-b86b-4cc0-b381-278a2a96447d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:11.240942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d50b7b7-b86b-4cc0-b381-278a2a96447d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:11.247791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d50b7b7-b86b-4cc0-b381-278a2a96447d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:11.248247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d50b7b7-b86b-4cc0-b381-278a2a96447d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:11.249095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d50b7b7-b86b-4cc0-b381-278a2a96447d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:11.249528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d50b7b7-b86b-4cc0-b381-278a2a96447d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:11.280455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d50b7b7-b86b-4cc0-b381-278a2a96447d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Apr 11 19:55:11.280961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 569/1200] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:12.121241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-762bdae6-870c-4d75-aae6-34447c7e3463 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:12.121850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-762bdae6-870c-4d75-aae6-34447c7e3463 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:12.129917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-762bdae6-870c-4d75-aae6-34447c7e3463 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:12.130374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-762bdae6-870c-4d75-aae6-34447c7e3463 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:12.131292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-762bdae6-870c-4d75-aae6-34447c7e3463 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:12.131772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-762bdae6-870c-4d75-aae6-34447c7e3463 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:12.147683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6bb0a3e2-5782-4353-ad46-83805ba6f162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:12.148737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6bb0a3e2-5782-4353-ad46-83805ba6f162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:12.155311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bb0a3e2-5782-4353-ad46-83805ba6f162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:12.155759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bb0a3e2-5782-4353-ad46-83805ba6f162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:12.156529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bb0a3e2-5782-4353-ad46-83805ba6f162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:12.156988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bb0a3e2-5782-4353-ad46-83805ba6f162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:12.190988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6bb0a3e2-5782-4353-ad46-83805ba6f162 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047442 Apr 11 19:55:12.191856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 570/1201] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:12.204524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-762bdae6-870c-4d75-aae6-34447c7e3463 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:12.212402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-762bdae6-870c-4d75-aae6-34447c7e3463 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.095573 Apr 11 19:55:12.212972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 632/1202] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:12 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:12.215389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf159272-4281-4dd6-b4bc-20f9688b088b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:12.217555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf159272-4281-4dd6-b4bc-20f9688b088b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:12.230200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf159272-4281-4dd6-b4bc-20f9688b088b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:12.231138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf159272-4281-4dd6-b4bc-20f9688b088b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:12.232714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf159272-4281-4dd6-b4bc-20f9688b088b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:12.233461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf159272-4281-4dd6-b4bc-20f9688b088b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:12.264211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf159272-4281-4dd6-b4bc-20f9688b088b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057999 Apr 11 19:55:12.264823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 571/1203] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:55:12.292046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ffaa697c-68ed-4d7c-ab9c-b8026acc8d86 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:12.293019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ffaa697c-68ed-4d7c-ab9c-b8026acc8d86 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:12.299422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffaa697c-68ed-4d7c-ab9c-b8026acc8d86 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:12.299871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffaa697c-68ed-4d7c-ab9c-b8026acc8d86 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:12.300648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffaa697c-68ed-4d7c-ab9c-b8026acc8d86 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:12.301112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffaa697c-68ed-4d7c-ab9c-b8026acc8d86 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:12.331920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ffaa697c-68ed-4d7c-ab9c-b8026acc8d86 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043814 Apr 11 19:55:12.332502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 633/1204] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:13.203495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53473c42-7a27-4f8e-9e80-37389398e22c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:13.204418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53473c42-7a27-4f8e-9e80-37389398e22c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:13.210980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53473c42-7a27-4f8e-9e80-37389398e22c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:13.211429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53473c42-7a27-4f8e-9e80-37389398e22c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:13.212192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53473c42-7a27-4f8e-9e80-37389398e22c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:13.212625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53473c42-7a27-4f8e-9e80-37389398e22c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:13.229253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f68e0de6-5799-4c59-988e-799b3104440a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:13.229837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f68e0de6-5799-4c59-988e-799b3104440a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:13.236497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f68e0de6-5799-4c59-988e-799b3104440a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:13.236961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f68e0de6-5799-4c59-988e-799b3104440a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:13.237758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f68e0de6-5799-4c59-988e-799b3104440a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:13.238191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f68e0de6-5799-4c59-988e-799b3104440a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:13.242731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53473c42-7a27-4f8e-9e80-37389398e22c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Apr 11 19:55:13.243530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 572/1205] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:13.275992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-49739338-483c-49b6-81ee-5a2ef2146284 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:13.276934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-49739338-483c-49b6-81ee-5a2ef2146284 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:13.283071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49739338-483c-49b6-81ee-5a2ef2146284 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:13.283552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49739338-483c-49b6-81ee-5a2ef2146284 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:13.284320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49739338-483c-49b6-81ee-5a2ef2146284 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:13.284749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49739338-483c-49b6-81ee-5a2ef2146284 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:13.300388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f68e0de6-5799-4c59-988e-799b3104440a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:13.308505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f68e0de6-5799-4c59-988e-799b3104440a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083084 Apr 11 19:55:13.309234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 634/1206] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:13 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:13.316455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-49739338-483c-49b6-81ee-5a2ef2146284 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044248 Apr 11 19:55:13.317147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 573/1207] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:55:13.344141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e3bca1a-42e1-4a57-86c4-b34dd6964722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:13.345109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e3bca1a-42e1-4a57-86c4-b34dd6964722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:13.351552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e3bca1a-42e1-4a57-86c4-b34dd6964722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:13.351999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e3bca1a-42e1-4a57-86c4-b34dd6964722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:13.352783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e3bca1a-42e1-4a57-86c4-b34dd6964722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:13.353281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e3bca1a-42e1-4a57-86c4-b34dd6964722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:13.384583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e3bca1a-42e1-4a57-86c4-b34dd6964722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Apr 11 19:55:13.385181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 635/1208] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:14.255812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a7555188-40ff-4c69-a23d-fd6271f7fedc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:14.256782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a7555188-40ff-4c69-a23d-fd6271f7fedc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:14.263201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7555188-40ff-4c69-a23d-fd6271f7fedc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:14.263642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7555188-40ff-4c69-a23d-fd6271f7fedc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:14.264397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7555188-40ff-4c69-a23d-fd6271f7fedc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:14.264824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7555188-40ff-4c69-a23d-fd6271f7fedc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:14.294282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a7555188-40ff-4c69-a23d-fd6271f7fedc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 Apr 11 19:55:14.294830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 574/1209] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:14.326603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-afcde93b-1b36-493d-bac3-1689af6a024f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:14.327236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-afcde93b-1b36-493d-bac3-1689af6a024f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:14.328302 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-70faad57-d1a6-4286-88dd-b2777eb64ad8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:14.329310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-70faad57-d1a6-4286-88dd-b2777eb64ad8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:14.333906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afcde93b-1b36-493d-bac3-1689af6a024f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:14.334359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afcde93b-1b36-493d-bac3-1689af6a024f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:14.335133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afcde93b-1b36-493d-bac3-1689af6a024f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:14.335264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70faad57-d1a6-4286-88dd-b2777eb64ad8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:14.335563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afcde93b-1b36-493d-bac3-1689af6a024f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:14.335687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70faad57-d1a6-4286-88dd-b2777eb64ad8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:14.336464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70faad57-d1a6-4286-88dd-b2777eb64ad8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:14.336896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70faad57-d1a6-4286-88dd-b2777eb64ad8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:14.367064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-70faad57-d1a6-4286-88dd-b2777eb64ad8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043032 Apr 11 19:55:14.367633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 575/1210] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:55:14.396282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-604ba765-647b-4163-8442-ffcb91a5abcc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:14.397243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-604ba765-647b-4163-8442-ffcb91a5abcc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:14.403571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-604ba765-647b-4163-8442-ffcb91a5abcc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:14.404019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-604ba765-647b-4163-8442-ffcb91a5abcc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:14.404791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-604ba765-647b-4163-8442-ffcb91a5abcc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:14.405643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-604ba765-647b-4163-8442-ffcb91a5abcc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:14.407489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-afcde93b-1b36-493d-bac3-1689af6a024f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:14.415376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-afcde93b-1b36-493d-bac3-1689af6a024f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092758 Apr 11 19:55:14.419767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 636/1211] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:14 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:14.436781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-604ba765-647b-4163-8442-ffcb91a5abcc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Apr 11 19:55:14.437397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 576/1212] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:55:15.310173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d942801b-fb5f-4bd1-9e93-e1f66cc7641a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:15.311352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d942801b-fb5f-4bd1-9e93-e1f66cc7641a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:15.318974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d942801b-fb5f-4bd1-9e93-e1f66cc7641a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:15.319540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d942801b-fb5f-4bd1-9e93-e1f66cc7641a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:15.320530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d942801b-fb5f-4bd1-9e93-e1f66cc7641a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:15.321112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d942801b-fb5f-4bd1-9e93-e1f66cc7641a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:15.352120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d942801b-fb5f-4bd1-9e93-e1f66cc7641a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047109 Apr 11 19:55:15.352798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 637/1213] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:15.379398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c555ca52-300a-422e-83d8-828e7edbdc1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:15.380317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c555ca52-300a-422e-83d8-828e7edbdc1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:15.386549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c555ca52-300a-422e-83d8-828e7edbdc1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:15.387002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c555ca52-300a-422e-83d8-828e7edbdc1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:15.387763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c555ca52-300a-422e-83d8-828e7edbdc1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:15.388229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c555ca52-300a-422e-83d8-828e7edbdc1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:15.416482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c555ca52-300a-422e-83d8-828e7edbdc1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041533 Apr 11 19:55:15.417058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 577/1214] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:15.432072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-105d324e-08f3-4a85-bf75-79df4d50af80 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:15.432700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-105d324e-08f3-4a85-bf75-79df4d50af80 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:15.439795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-105d324e-08f3-4a85-bf75-79df4d50af80 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:15.440151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-105d324e-08f3-4a85-bf75-79df4d50af80 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:15.440936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-105d324e-08f3-4a85-bf75-79df4d50af80 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:15.441417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-105d324e-08f3-4a85-bf75-79df4d50af80 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:15.448054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac178e93-0d17-482e-9516-47eb06f7a88b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:15.449068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac178e93-0d17-482e-9516-47eb06f7a88b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:15.455633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac178e93-0d17-482e-9516-47eb06f7a88b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:15.456076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac178e93-0d17-482e-9516-47eb06f7a88b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:15.456851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac178e93-0d17-482e-9516-47eb06f7a88b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:15.457314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac178e93-0d17-482e-9516-47eb06f7a88b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:15.486830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac178e93-0d17-482e-9516-47eb06f7a88b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 Apr 11 19:55:15.487427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 578/1215] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:15.504028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-105d324e-08f3-4a85-bf75-79df4d50af80 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:15.513056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-105d324e-08f3-4a85-bf75-79df4d50af80 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085216 Apr 11 19:55:15.513634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 638/1216] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:15 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:16.366918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a4c8eae7-fbe4-4c1b-8b71-816bcfc4bed0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:16.367838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a4c8eae7-fbe4-4c1b-8b71-816bcfc4bed0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:16.373974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4c8eae7-fbe4-4c1b-8b71-816bcfc4bed0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:16.374418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4c8eae7-fbe4-4c1b-8b71-816bcfc4bed0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:16.375480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4c8eae7-fbe4-4c1b-8b71-816bcfc4bed0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:16.375905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4c8eae7-fbe4-4c1b-8b71-816bcfc4bed0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:16.406523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a4c8eae7-fbe4-4c1b-8b71-816bcfc4bed0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Apr 11 19:55:16.407248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 579/1217] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:16.431093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8fed5cf9-4893-4f4f-af10-8b301fe950af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:16.432008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8fed5cf9-4893-4f4f-af10-8b301fe950af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:16.439173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8fed5cf9-4893-4f4f-af10-8b301fe950af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:16.439618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8fed5cf9-4893-4f4f-af10-8b301fe950af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:16.440385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8fed5cf9-4893-4f4f-af10-8b301fe950af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:16.440834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8fed5cf9-4893-4f4f-af10-8b301fe950af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:16.471461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8fed5cf9-4893-4f4f-af10-8b301fe950af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044212 Apr 11 19:55:16.471917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 639/1218] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:16.500623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-faa4cc3e-d202-4385-ac07-9815cfcd4a39 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:16.502181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-faa4cc3e-d202-4385-ac07-9815cfcd4a39 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:16.510808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-faa4cc3e-d202-4385-ac07-9815cfcd4a39 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:16.511252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-faa4cc3e-d202-4385-ac07-9815cfcd4a39 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:16.512023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-faa4cc3e-d202-4385-ac07-9815cfcd4a39 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:16.512476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-faa4cc3e-d202-4385-ac07-9815cfcd4a39 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:16.531777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b69f3d9-0e27-4399-900b-f54bff4bd2a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:16.532392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7b69f3d9-0e27-4399-900b-f54bff4bd2a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:16.538800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b69f3d9-0e27-4399-900b-f54bff4bd2a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:16.539246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b69f3d9-0e27-4399-900b-f54bff4bd2a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:16.540003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b69f3d9-0e27-4399-900b-f54bff4bd2a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:16.540439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b69f3d9-0e27-4399-900b-f54bff4bd2a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:16.542955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-faa4cc3e-d202-4385-ac07-9815cfcd4a39 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Apr 11 19:55:16.543516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 580/1219] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:16.604172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7b69f3d9-0e27-4399-900b-f54bff4bd2a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:16.611997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7b69f3d9-0e27-4399-900b-f54bff4bd2a1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084042 Apr 11 19:55:16.612565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 640/1220] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:16 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:17.420504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3dbdf43-093d-4456-80fb-22cbdbd1f205 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:17.421591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3dbdf43-093d-4456-80fb-22cbdbd1f205 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:17.428879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3dbdf43-093d-4456-80fb-22cbdbd1f205 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:17.429343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3dbdf43-093d-4456-80fb-22cbdbd1f205 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:17.430099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3dbdf43-093d-4456-80fb-22cbdbd1f205 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:17.430587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3dbdf43-093d-4456-80fb-22cbdbd1f205 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:17.460556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3dbdf43-093d-4456-80fb-22cbdbd1f205 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Apr 11 19:55:17.461021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 581/1221] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:17.485147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5eef6c5-5df8-401c-9297-a32465302d24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:17.486170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5eef6c5-5df8-401c-9297-a32465302d24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:17.493297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eef6c5-5df8-401c-9297-a32465302d24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:17.493745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eef6c5-5df8-401c-9297-a32465302d24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:17.494507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eef6c5-5df8-401c-9297-a32465302d24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:17.494940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eef6c5-5df8-401c-9297-a32465302d24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:17.527691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5eef6c5-5df8-401c-9297-a32465302d24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047954 Apr 11 19:55:17.528239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 641/1222] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:17.556141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f7d7c27-e97e-41b9-90e9-ce4916fee1ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:17.557199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f7d7c27-e97e-41b9-90e9-ce4916fee1ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:17.566423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f7d7c27-e97e-41b9-90e9-ce4916fee1ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:17.567160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f7d7c27-e97e-41b9-90e9-ce4916fee1ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:17.568606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f7d7c27-e97e-41b9-90e9-ce4916fee1ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:17.569316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f7d7c27-e97e-41b9-90e9-ce4916fee1ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:17.600803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f7d7c27-e97e-41b9-90e9-ce4916fee1ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049516 Apr 11 19:55:17.601442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 582/1223] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:17.686041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b01cc9a5-e68a-4a8e-9b05-aa3f002dc0ba tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:17.686661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b01cc9a5-e68a-4a8e-9b05-aa3f002dc0ba tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:17.694264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b01cc9a5-e68a-4a8e-9b05-aa3f002dc0ba tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:17.694763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b01cc9a5-e68a-4a8e-9b05-aa3f002dc0ba tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:17.695729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b01cc9a5-e68a-4a8e-9b05-aa3f002dc0ba tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:17.696214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b01cc9a5-e68a-4a8e-9b05-aa3f002dc0ba tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:17.760447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b01cc9a5-e68a-4a8e-9b05-aa3f002dc0ba tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:17.772767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b01cc9a5-e68a-4a8e-9b05-aa3f002dc0ba tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090673 Apr 11 19:55:17.773349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 642/1224] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:17 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:18.473476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e5fd0bc4-a00e-468c-ad9b-2283d464f375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:18.474366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e5fd0bc4-a00e-468c-ad9b-2283d464f375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:18.480995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5fd0bc4-a00e-468c-ad9b-2283d464f375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:18.481441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5fd0bc4-a00e-468c-ad9b-2283d464f375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:18.482190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5fd0bc4-a00e-468c-ad9b-2283d464f375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:18.482614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5fd0bc4-a00e-468c-ad9b-2283d464f375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:18.511752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e5fd0bc4-a00e-468c-ad9b-2283d464f375 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042518 Apr 11 19:55:18.512303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 583/1225] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:18.539094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a197e719-5a40-4e25-8607-464d15c49a7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:18.540017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a197e719-5a40-4e25-8607-464d15c49a7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:18.546501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a197e719-5a40-4e25-8607-464d15c49a7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:18.546951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a197e719-5a40-4e25-8607-464d15c49a7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:18.547711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a197e719-5a40-4e25-8607-464d15c49a7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:18.548139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a197e719-5a40-4e25-8607-464d15c49a7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:18.578205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a197e719-5a40-4e25-8607-464d15c49a7e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042878 Apr 11 19:55:18.578777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 643/1226] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:18.612761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a2678b7-773e-4e13-87fe-21702957b332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:18.613723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a2678b7-773e-4e13-87fe-21702957b332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:18.620178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a2678b7-773e-4e13-87fe-21702957b332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:18.620633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a2678b7-773e-4e13-87fe-21702957b332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:18.621420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a2678b7-773e-4e13-87fe-21702957b332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:18.621849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a2678b7-773e-4e13-87fe-21702957b332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:18.651879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a2678b7-773e-4e13-87fe-21702957b332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Apr 11 19:55:18.652680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 584/1227] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:18.791780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8dff78d6-d84c-4426-9199-8e97a6e0841c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:18.792295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8dff78d6-d84c-4426-9199-8e97a6e0841c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:18.798677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8dff78d6-d84c-4426-9199-8e97a6e0841c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:18.799121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8dff78d6-d84c-4426-9199-8e97a6e0841c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:18.799879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8dff78d6-d84c-4426-9199-8e97a6e0841c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:18.800310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8dff78d6-d84c-4426-9199-8e97a6e0841c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:18.859990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8dff78d6-d84c-4426-9199-8e97a6e0841c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:18.867783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8dff78d6-d84c-4426-9199-8e97a6e0841c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080026 Apr 11 19:55:18.868353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 644/1228] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:18 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:19.523269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b83f8c8b-3c55-4f75-be69-d5a8d91976cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:19.524106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b83f8c8b-3c55-4f75-be69-d5a8d91976cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:19.530951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b83f8c8b-3c55-4f75-be69-d5a8d91976cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:19.531402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b83f8c8b-3c55-4f75-be69-d5a8d91976cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:19.532170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b83f8c8b-3c55-4f75-be69-d5a8d91976cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:19.532604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b83f8c8b-3c55-4f75-be69-d5a8d91976cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:19.562469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b83f8c8b-3c55-4f75-be69-d5a8d91976cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043439 Apr 11 19:55:19.563036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 585/1229] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:19.591997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2fb42b58-633c-4246-a502-89ad6e9382e6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:19.592934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2fb42b58-633c-4246-a502-89ad6e9382e6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:19.600608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fb42b58-633c-4246-a502-89ad6e9382e6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:19.601198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fb42b58-633c-4246-a502-89ad6e9382e6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:19.601995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fb42b58-633c-4246-a502-89ad6e9382e6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:19.602430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fb42b58-633c-4246-a502-89ad6e9382e6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:19.635307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2fb42b58-633c-4246-a502-89ad6e9382e6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048477 Apr 11 19:55:19.635871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 645/1230] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:19.664421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1817a14e-67ca-470f-844e-6af90eae5f40 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:19.665423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1817a14e-67ca-470f-844e-6af90eae5f40 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:19.672504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1817a14e-67ca-470f-844e-6af90eae5f40 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:19.672963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1817a14e-67ca-470f-844e-6af90eae5f40 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:19.673774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1817a14e-67ca-470f-844e-6af90eae5f40 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:19.674204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1817a14e-67ca-470f-844e-6af90eae5f40 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:19.706466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1817a14e-67ca-470f-844e-6af90eae5f40 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046208 Apr 11 19:55:19.707071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 586/1231] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:19.885379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb04fe66-2ee3-4b96-b0df-0d83c7339268 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:19.885897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb04fe66-2ee3-4b96-b0df-0d83c7339268 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:19.892674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb04fe66-2ee3-4b96-b0df-0d83c7339268 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:19.893163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb04fe66-2ee3-4b96-b0df-0d83c7339268 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:19.893914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb04fe66-2ee3-4b96-b0df-0d83c7339268 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:19.894345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb04fe66-2ee3-4b96-b0df-0d83c7339268 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:19.957467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bb04fe66-2ee3-4b96-b0df-0d83c7339268 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:19.965670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb04fe66-2ee3-4b96-b0df-0d83c7339268 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084322 Apr 11 19:55:19.966279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 646/1232] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:19 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:20.574480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-78be3ca5-a1c1-4fc0-a576-7ec955c8fc65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:20.575400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-78be3ca5-a1c1-4fc0-a576-7ec955c8fc65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:20.582242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78be3ca5-a1c1-4fc0-a576-7ec955c8fc65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:20.582685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78be3ca5-a1c1-4fc0-a576-7ec955c8fc65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:20.583424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78be3ca5-a1c1-4fc0-a576-7ec955c8fc65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:20.583949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78be3ca5-a1c1-4fc0-a576-7ec955c8fc65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:20.613101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-78be3ca5-a1c1-4fc0-a576-7ec955c8fc65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 Apr 11 19:55:20.613650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 587/1233] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:20.647766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0be3a58d-b615-4da5-9514-d2f2c605d166 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:20.648704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0be3a58d-b615-4da5-9514-d2f2c605d166 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:20.655322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0be3a58d-b615-4da5-9514-d2f2c605d166 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:20.655754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0be3a58d-b615-4da5-9514-d2f2c605d166 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:20.656506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0be3a58d-b615-4da5-9514-d2f2c605d166 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:20.656940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0be3a58d-b615-4da5-9514-d2f2c605d166 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:20.686715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0be3a58d-b615-4da5-9514-d2f2c605d166 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042979 Apr 11 19:55:20.687266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 647/1234] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:20.718326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43d2427d-8ba8-467a-a165-e56f1f05bc09 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:20.719244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43d2427d-8ba8-467a-a165-e56f1f05bc09 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:20.725799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43d2427d-8ba8-467a-a165-e56f1f05bc09 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:20.726245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43d2427d-8ba8-467a-a165-e56f1f05bc09 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:20.727009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43d2427d-8ba8-467a-a165-e56f1f05bc09 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:20.727444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43d2427d-8ba8-467a-a165-e56f1f05bc09 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:20.756634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43d2427d-8ba8-467a-a165-e56f1f05bc09 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Apr 11 19:55:20.757225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 588/1235] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:20.982600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-003f8979-42e5-4243-b32e-b6da9a80a5e5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:20.983234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-003f8979-42e5-4243-b32e-b6da9a80a5e5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:20.989766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003f8979-42e5-4243-b32e-b6da9a80a5e5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:20.990212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003f8979-42e5-4243-b32e-b6da9a80a5e5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:20.991004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003f8979-42e5-4243-b32e-b6da9a80a5e5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:20.991431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003f8979-42e5-4243-b32e-b6da9a80a5e5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:21.051153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-003f8979-42e5-4243-b32e-b6da9a80a5e5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:21.058950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-003f8979-42e5-4243-b32e-b6da9a80a5e5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080238 Apr 11 19:55:21.059516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 648/1236] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:20 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:21.625626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a14a276a-7896-4303-9397-a6ed4f703f80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:21.626549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a14a276a-7896-4303-9397-a6ed4f703f80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:21.633398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a14a276a-7896-4303-9397-a6ed4f703f80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:21.633843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a14a276a-7896-4303-9397-a6ed4f703f80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:21.634604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a14a276a-7896-4303-9397-a6ed4f703f80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:21.635035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a14a276a-7896-4303-9397-a6ed4f703f80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:21.663989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a14a276a-7896-4303-9397-a6ed4f703f80 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042677 Apr 11 19:55:21.664550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 589/1237] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:21.698772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3aca9388-c279-41b4-92e2-4dec467064b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:21.699690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3aca9388-c279-41b4-92e2-4dec467064b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:21.706168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3aca9388-c279-41b4-92e2-4dec467064b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:21.706610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3aca9388-c279-41b4-92e2-4dec467064b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:21.707369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3aca9388-c279-41b4-92e2-4dec467064b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:21.707797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3aca9388-c279-41b4-92e2-4dec467064b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:21.736249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3aca9388-c279-41b4-92e2-4dec467064b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041457 Apr 11 19:55:21.736795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 649/1238] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:21.822173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0d383ada-ae15-4258-bafe-5130e0be39c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:21.823086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0d383ada-ae15-4258-bafe-5130e0be39c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:21.829927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d383ada-ae15-4258-bafe-5130e0be39c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:21.830365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d383ada-ae15-4258-bafe-5130e0be39c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:21.831185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d383ada-ae15-4258-bafe-5130e0be39c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:21.831610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d383ada-ae15-4258-bafe-5130e0be39c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:21.860272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0d383ada-ae15-4258-bafe-5130e0be39c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042180 Apr 11 19:55:21.860811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 590/1239] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:22.075884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5e0cf00-a3f1-471d-8d47-39f57e9d9689 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:22.076479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5e0cf00-a3f1-471d-8d47-39f57e9d9689 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:22.082849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5e0cf00-a3f1-471d-8d47-39f57e9d9689 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:22.083294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5e0cf00-a3f1-471d-8d47-39f57e9d9689 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:22.084119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5e0cf00-a3f1-471d-8d47-39f57e9d9689 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:22.084541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5e0cf00-a3f1-471d-8d47-39f57e9d9689 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:22.144095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5e0cf00-a3f1-471d-8d47-39f57e9d9689 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:22.151675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5e0cf00-a3f1-471d-8d47-39f57e9d9689 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.079744 Apr 11 19:55:22.152202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 650/1240] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:22 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:22.676275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e2c7524-f5ce-40cc-84f3-d92128154bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:22.677248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9e2c7524-f5ce-40cc-84f3-d92128154bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:22.683998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e2c7524-f5ce-40cc-84f3-d92128154bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:22.684467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e2c7524-f5ce-40cc-84f3-d92128154bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:22.685259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e2c7524-f5ce-40cc-84f3-d92128154bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:22.685686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e2c7524-f5ce-40cc-84f3-d92128154bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:22.715507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e2c7524-f5ce-40cc-84f3-d92128154bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Apr 11 19:55:22.716050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 591/1241] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:22.747869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c1acc973-1c46-4047-ba57-70bc4ae65bfc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:22.748785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c1acc973-1c46-4047-ba57-70bc4ae65bfc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:22.755605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1acc973-1c46-4047-ba57-70bc4ae65bfc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:22.756050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1acc973-1c46-4047-ba57-70bc4ae65bfc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:22.756801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1acc973-1c46-4047-ba57-70bc4ae65bfc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:22.757251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1acc973-1c46-4047-ba57-70bc4ae65bfc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:22.785165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c1acc973-1c46-4047-ba57-70bc4ae65bfc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041127 Apr 11 19:55:22.785626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 651/1242] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:22.872104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f36b1ba0-9a24-4466-8368-d22493e8877c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:22.873048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f36b1ba0-9a24-4466-8368-d22493e8877c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:22.879935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f36b1ba0-9a24-4466-8368-d22493e8877c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:22.880419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f36b1ba0-9a24-4466-8368-d22493e8877c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:22.881204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f36b1ba0-9a24-4466-8368-d22493e8877c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:22.881635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f36b1ba0-9a24-4466-8368-d22493e8877c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:22.910439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f36b1ba0-9a24-4466-8368-d22493e8877c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 Apr 11 19:55:22.911002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 592/1243] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:23.168869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a5e3e3f-9ecc-4e9e-87a4-823c9b566b6d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:23.169392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a5e3e3f-9ecc-4e9e-87a4-823c9b566b6d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:23.175912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a5e3e3f-9ecc-4e9e-87a4-823c9b566b6d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:23.176357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a5e3e3f-9ecc-4e9e-87a4-823c9b566b6d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:23.177152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a5e3e3f-9ecc-4e9e-87a4-823c9b566b6d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:23.177646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a5e3e3f-9ecc-4e9e-87a4-823c9b566b6d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:23.238063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0a5e3e3f-9ecc-4e9e-87a4-823c9b566b6d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:23.246169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a5e3e3f-9ecc-4e9e-87a4-823c9b566b6d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081170 Apr 11 19:55:23.246736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 652/1244] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:23 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:23.727813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4f85517c-0f7d-4c60-9c4e-eec119a62b40 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:23.728654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4f85517c-0f7d-4c60-9c4e-eec119a62b40 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:23.735197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f85517c-0f7d-4c60-9c4e-eec119a62b40 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:23.735646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f85517c-0f7d-4c60-9c4e-eec119a62b40 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:23.736405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f85517c-0f7d-4c60-9c4e-eec119a62b40 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:23.736833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f85517c-0f7d-4c60-9c4e-eec119a62b40 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:23.766147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4f85517c-0f7d-4c60-9c4e-eec119a62b40 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042390 Apr 11 19:55:23.766730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 593/1245] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:23.797382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dcdf9858-ea94-44f3-ac40-5d59d63659f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:23.798320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dcdf9858-ea94-44f3-ac40-5d59d63659f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:23.805049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dcdf9858-ea94-44f3-ac40-5d59d63659f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:23.805502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dcdf9858-ea94-44f3-ac40-5d59d63659f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:23.806277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dcdf9858-ea94-44f3-ac40-5d59d63659f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:23.806709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dcdf9858-ea94-44f3-ac40-5d59d63659f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:23.838302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dcdf9858-ea94-44f3-ac40-5d59d63659f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044997 Apr 11 19:55:23.838880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 653/1246] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:23.926334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66eaf7a3-7552-4dc5-9a9f-beb0bacc17d9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:23.927807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-66eaf7a3-7552-4dc5-9a9f-beb0bacc17d9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:23.938193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66eaf7a3-7552-4dc5-9a9f-beb0bacc17d9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:23.938890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66eaf7a3-7552-4dc5-9a9f-beb0bacc17d9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:23.940114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66eaf7a3-7552-4dc5-9a9f-beb0bacc17d9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:23.940802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66eaf7a3-7552-4dc5-9a9f-beb0bacc17d9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:23.970239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-66eaf7a3-7552-4dc5-9a9f-beb0bacc17d9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050659 Apr 11 19:55:23.970781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 594/1247] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:24.267696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb8048c0-6cd0-4bb0-a54e-6d0512a4c371 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:24.268707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb8048c0-6cd0-4bb0-a54e-6d0512a4c371 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:24.276383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb8048c0-6cd0-4bb0-a54e-6d0512a4c371 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:24.276831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb8048c0-6cd0-4bb0-a54e-6d0512a4c371 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:24.277626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb8048c0-6cd0-4bb0-a54e-6d0512a4c371 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:24.278059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb8048c0-6cd0-4bb0-a54e-6d0512a4c371 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:24.353264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cb8048c0-6cd0-4bb0-a54e-6d0512a4c371 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:24.363756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb8048c0-6cd0-4bb0-a54e-6d0512a4c371 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.102445 Apr 11 19:55:24.364593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 654/1248] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:24 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:24.778290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7ba6510d-c369-4bf8-9d8a-efc479ea88e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:24.779087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7ba6510d-c369-4bf8-9d8a-efc479ea88e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:24.785748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ba6510d-c369-4bf8-9d8a-efc479ea88e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:24.786192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ba6510d-c369-4bf8-9d8a-efc479ea88e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:24.787099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ba6510d-c369-4bf8-9d8a-efc479ea88e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:24.787510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ba6510d-c369-4bf8-9d8a-efc479ea88e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:24.818135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7ba6510d-c369-4bf8-9d8a-efc479ea88e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043742 Apr 11 19:55:24.818696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 595/1249] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:24.851742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-302da3b9-2b6c-4cb6-af40-306abf680488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:24.852665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-302da3b9-2b6c-4cb6-af40-306abf680488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:24.860410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-302da3b9-2b6c-4cb6-af40-306abf680488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:24.860851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-302da3b9-2b6c-4cb6-af40-306abf680488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:24.861641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-302da3b9-2b6c-4cb6-af40-306abf680488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:24.862066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-302da3b9-2b6c-4cb6-af40-306abf680488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:24.893649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-302da3b9-2b6c-4cb6-af40-306abf680488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046144 Apr 11 19:55:24.894214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 655/1250] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:24.985838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-282289ef-5ac9-43a9-8678-73c6e46e99cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:24.987413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-282289ef-5ac9-43a9-8678-73c6e46e99cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:24.997464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-282289ef-5ac9-43a9-8678-73c6e46e99cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:24.998203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-282289ef-5ac9-43a9-8678-73c6e46e99cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:24.999432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-282289ef-5ac9-43a9-8678-73c6e46e99cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:25.000443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-282289ef-5ac9-43a9-8678-73c6e46e99cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:25.031521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-282289ef-5ac9-43a9-8678-73c6e46e99cf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052782 Apr 11 19:55:25.031991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 596/1251] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:25.386124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92cb07a0-e90d-4314-9175-345729c5fa52 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:25.386642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92cb07a0-e90d-4314-9175-345729c5fa52 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:25.393650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92cb07a0-e90d-4314-9175-345729c5fa52 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:25.394095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92cb07a0-e90d-4314-9175-345729c5fa52 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:25.394880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92cb07a0-e90d-4314-9175-345729c5fa52 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:25.395329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92cb07a0-e90d-4314-9175-345729c5fa52 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:25.459939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-92cb07a0-e90d-4314-9175-345729c5fa52 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:25.468076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92cb07a0-e90d-4314-9175-345729c5fa52 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085906 Apr 11 19:55:25.468621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 656/1252] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:25 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:25.667146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:55:25.667457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 19:55:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 19:55:25.831299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-076c319a-b9f0-4b28-b648-0d22aedacb85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:25.832280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-076c319a-b9f0-4b28-b648-0d22aedacb85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:25.839667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-076c319a-b9f0-4b28-b648-0d22aedacb85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:25.840163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-076c319a-b9f0-4b28-b648-0d22aedacb85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:25.841070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-076c319a-b9f0-4b28-b648-0d22aedacb85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:25.841556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-076c319a-b9f0-4b28-b648-0d22aedacb85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:25.873630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-076c319a-b9f0-4b28-b648-0d22aedacb85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046659 Apr 11 19:55:25.874195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 597/1253] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:25.906138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4732c5b2-6773-4b36-85e4-22ce0c4d8151 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:25.907064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4732c5b2-6773-4b36-85e4-22ce0c4d8151 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:25.913678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4732c5b2-6773-4b36-85e4-22ce0c4d8151 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:25.914128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4732c5b2-6773-4b36-85e4-22ce0c4d8151 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:25.914999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4732c5b2-6773-4b36-85e4-22ce0c4d8151 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:25.915439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4732c5b2-6773-4b36-85e4-22ce0c4d8151 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:25.948087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4732c5b2-6773-4b36-85e4-22ce0c4d8151 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046104 Apr 11 19:55:25.948710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 657/1254] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:26.044444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-69f03276-8d8b-4e43-97d5-6d851c3d0eaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:26.045865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-69f03276-8d8b-4e43-97d5-6d851c3d0eaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:26.054493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69f03276-8d8b-4e43-97d5-6d851c3d0eaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:26.055163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69f03276-8d8b-4e43-97d5-6d851c3d0eaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:26.056307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69f03276-8d8b-4e43-97d5-6d851c3d0eaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:26.056986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69f03276-8d8b-4e43-97d5-6d851c3d0eaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:26.089384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-69f03276-8d8b-4e43-97d5-6d851c3d0eaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049679 Apr 11 19:55:26.089946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 598/1255] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:26.488337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9feffc6a-5708-4641-9912-2c04392a4756 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:26.489369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9feffc6a-5708-4641-9912-2c04392a4756 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:26.497276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9feffc6a-5708-4641-9912-2c04392a4756 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:26.497989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9feffc6a-5708-4641-9912-2c04392a4756 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:26.499257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9feffc6a-5708-4641-9912-2c04392a4756 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:26.500268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9feffc6a-5708-4641-9912-2c04392a4756 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:26.567917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9feffc6a-5708-4641-9912-2c04392a4756 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:26.575511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9feffc6a-5708-4641-9912-2c04392a4756 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093187 Apr 11 19:55:26.576063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 658/1256] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:26 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:26.886718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b6e6239d-cb59-4cc8-a826-f2b70ac2516d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:26.887552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b6e6239d-cb59-4cc8-a826-f2b70ac2516d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:26.894529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6e6239d-cb59-4cc8-a826-f2b70ac2516d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:26.894967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6e6239d-cb59-4cc8-a826-f2b70ac2516d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:26.895720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6e6239d-cb59-4cc8-a826-f2b70ac2516d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:26.896219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6e6239d-cb59-4cc8-a826-f2b70ac2516d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:26.926024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b6e6239d-cb59-4cc8-a826-f2b70ac2516d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Apr 11 19:55:26.926572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 599/1257] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:26.959968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-04b6846e-e34a-41c2-bcc0-0cfd0519d9ab tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:26.960891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-04b6846e-e34a-41c2-bcc0-0cfd0519d9ab tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:26.967263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04b6846e-e34a-41c2-bcc0-0cfd0519d9ab tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:26.967706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04b6846e-e34a-41c2-bcc0-0cfd0519d9ab tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:26.968471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04b6846e-e34a-41c2-bcc0-0cfd0519d9ab tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:26.968913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04b6846e-e34a-41c2-bcc0-0cfd0519d9ab tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:26.997931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-04b6846e-e34a-41c2-bcc0-0cfd0519d9ab tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041914 Apr 11 19:55:26.998491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 659/1258] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:27.101165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-99dd38ad-a721-45e5-86cb-f5ffb01d8ae6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:27.102094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-99dd38ad-a721-45e5-86cb-f5ffb01d8ae6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:27.108441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99dd38ad-a721-45e5-86cb-f5ffb01d8ae6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:27.108884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99dd38ad-a721-45e5-86cb-f5ffb01d8ae6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:27.109735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99dd38ad-a721-45e5-86cb-f5ffb01d8ae6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:27.110157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99dd38ad-a721-45e5-86cb-f5ffb01d8ae6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:27.140488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-99dd38ad-a721-45e5-86cb-f5ffb01d8ae6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043349 Apr 11 19:55:27.141124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 600/1259] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:27.595977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fff844be-9496-4023-b3d6-84b925036b97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:27.596982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fff844be-9496-4023-b3d6-84b925036b97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:27.607555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff844be-9496-4023-b3d6-84b925036b97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:27.608302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff844be-9496-4023-b3d6-84b925036b97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:27.609640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff844be-9496-4023-b3d6-84b925036b97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:27.610351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff844be-9496-4023-b3d6-84b925036b97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:27.675062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fff844be-9496-4023-b3d6-84b925036b97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:27.688871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fff844be-9496-4023-b3d6-84b925036b97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098405 Apr 11 19:55:27.690370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 660/1260] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:27 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:27.939486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-574fedab-3dd6-4485-bf7b-39f98b15aeda tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:27.940405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-574fedab-3dd6-4485-bf7b-39f98b15aeda tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:27.947553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-574fedab-3dd6-4485-bf7b-39f98b15aeda tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:27.947992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-574fedab-3dd6-4485-bf7b-39f98b15aeda tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:27.948759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-574fedab-3dd6-4485-bf7b-39f98b15aeda tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:27.949844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-574fedab-3dd6-4485-bf7b-39f98b15aeda tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:27.979973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-574fedab-3dd6-4485-bf7b-39f98b15aeda tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Apr 11 19:55:27.980531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 601/1261] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:28.013105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8992e3b3-1522-49c7-9ab6-a503b0ed2771 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:28.014115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8992e3b3-1522-49c7-9ab6-a503b0ed2771 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:28.024658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8992e3b3-1522-49c7-9ab6-a503b0ed2771 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:28.024658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8992e3b3-1522-49c7-9ab6-a503b0ed2771 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:28.024658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8992e3b3-1522-49c7-9ab6-a503b0ed2771 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:28.024658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8992e3b3-1522-49c7-9ab6-a503b0ed2771 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:28.053908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8992e3b3-1522-49c7-9ab6-a503b0ed2771 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046156 Apr 11 19:55:28.054464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 661/1262] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:28.155902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-619ca7dc-1af8-49e1-b81e-796d055828a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:28.157335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-619ca7dc-1af8-49e1-b81e-796d055828a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:28.166801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-619ca7dc-1af8-49e1-b81e-796d055828a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:28.167494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-619ca7dc-1af8-49e1-b81e-796d055828a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:28.168675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-619ca7dc-1af8-49e1-b81e-796d055828a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:28.169490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-619ca7dc-1af8-49e1-b81e-796d055828a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:28.204465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-619ca7dc-1af8-49e1-b81e-796d055828a5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054751 Apr 11 19:55:28.205062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 602/1263] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:28.716660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-000a9f9d-5d75-4d03-b83e-80314b7437bd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:28.717668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-000a9f9d-5d75-4d03-b83e-80314b7437bd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:28.726501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-000a9f9d-5d75-4d03-b83e-80314b7437bd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:28.726948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-000a9f9d-5d75-4d03-b83e-80314b7437bd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:28.727704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-000a9f9d-5d75-4d03-b83e-80314b7437bd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:28.728137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-000a9f9d-5d75-4d03-b83e-80314b7437bd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:28.808474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-000a9f9d-5d75-4d03-b83e-80314b7437bd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:28.819548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-000a9f9d-5d75-4d03-b83e-80314b7437bd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.108538 Apr 11 19:55:28.820623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 662/1264] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:28 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:28.992227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5ebce25-082c-4a2e-b0ac-27cb963280e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:28.993171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5ebce25-082c-4a2e-b0ac-27cb963280e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:28.999565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5ebce25-082c-4a2e-b0ac-27cb963280e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:29.000317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5ebce25-082c-4a2e-b0ac-27cb963280e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:29.001157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5ebce25-082c-4a2e-b0ac-27cb963280e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:29.001605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5ebce25-082c-4a2e-b0ac-27cb963280e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:29.030176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5ebce25-082c-4a2e-b0ac-27cb963280e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042073 Apr 11 19:55:29.030964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 603/1265] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:29.065918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f241864b-0a2c-49d1-b0bb-139b15480a25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:29.066762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f241864b-0a2c-49d1-b0bb-139b15480a25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:29.073193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f241864b-0a2c-49d1-b0bb-139b15480a25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:29.073636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f241864b-0a2c-49d1-b0bb-139b15480a25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:29.074399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f241864b-0a2c-49d1-b0bb-139b15480a25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:29.074827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f241864b-0a2c-49d1-b0bb-139b15480a25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:29.103419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f241864b-0a2c-49d1-b0bb-139b15480a25 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041534 Apr 11 19:55:29.103965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 663/1266] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:29.219026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1209fd2d-a495-4193-8a40-0fc00542c4e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:29.220338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1209fd2d-a495-4193-8a40-0fc00542c4e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:29.228173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1209fd2d-a495-4193-8a40-0fc00542c4e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:29.228624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1209fd2d-a495-4193-8a40-0fc00542c4e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:29.229435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1209fd2d-a495-4193-8a40-0fc00542c4e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:29.229865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1209fd2d-a495-4193-8a40-0fc00542c4e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:29.258381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1209fd2d-a495-4193-8a40-0fc00542c4e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045296 Apr 11 19:55:29.258924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 604/1267] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:29.837447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9eb65257-a52d-47e7-af15-ca75e2aad1fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:29.838073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9eb65257-a52d-47e7-af15-ca75e2aad1fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:29.844577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9eb65257-a52d-47e7-af15-ca75e2aad1fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:29.845109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9eb65257-a52d-47e7-af15-ca75e2aad1fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:29.845914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9eb65257-a52d-47e7-af15-ca75e2aad1fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:29.846517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9eb65257-a52d-47e7-af15-ca75e2aad1fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:29.925754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9eb65257-a52d-47e7-af15-ca75e2aad1fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:29.933379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9eb65257-a52d-47e7-af15-ca75e2aad1fc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.100128 Apr 11 19:55:29.933935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 664/1268] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:29 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:30.045872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c032eee5-4712-48d4-8c81-cb67d839a53e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:30.047390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c032eee5-4712-48d4-8c81-cb67d839a53e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:30.058064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c032eee5-4712-48d4-8c81-cb67d839a53e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:30.058801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c032eee5-4712-48d4-8c81-cb67d839a53e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:30.060035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c032eee5-4712-48d4-8c81-cb67d839a53e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:30.060800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c032eee5-4712-48d4-8c81-cb67d839a53e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:30.093317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c032eee5-4712-48d4-8c81-cb67d839a53e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053764 Apr 11 19:55:30.093769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 605/1269] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:30.115400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59916a24-ae15-4010-ac76-51f4bdf0cb75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:30.116312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59916a24-ae15-4010-ac76-51f4bdf0cb75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:30.123112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59916a24-ae15-4010-ac76-51f4bdf0cb75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:30.123554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59916a24-ae15-4010-ac76-51f4bdf0cb75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:30.124469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59916a24-ae15-4010-ac76-51f4bdf0cb75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:30.125270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59916a24-ae15-4010-ac76-51f4bdf0cb75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:30.155884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59916a24-ae15-4010-ac76-51f4bdf0cb75 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044473 Apr 11 19:55:30.156415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 665/1270] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:30.273636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c0486fd-4214-43a2-91cb-02e8b030f232 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:30.274559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c0486fd-4214-43a2-91cb-02e8b030f232 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:30.281017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c0486fd-4214-43a2-91cb-02e8b030f232 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:30.281460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c0486fd-4214-43a2-91cb-02e8b030f232 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:30.282208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c0486fd-4214-43a2-91cb-02e8b030f232 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:30.282633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c0486fd-4214-43a2-91cb-02e8b030f232 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:30.312136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c0486fd-4214-43a2-91cb-02e8b030f232 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Apr 11 19:55:30.312674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 606/1271] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:30.953335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e54db595-3031-4795-81d2-b49ef34765d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:30.953954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e54db595-3031-4795-81d2-b49ef34765d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:30.960488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e54db595-3031-4795-81d2-b49ef34765d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:30.960937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e54db595-3031-4795-81d2-b49ef34765d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:30.961807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e54db595-3031-4795-81d2-b49ef34765d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:30.962305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e54db595-3031-4795-81d2-b49ef34765d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:31.027435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e54db595-3031-4795-81d2-b49ef34765d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:31.035507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e54db595-3031-4795-81d2-b49ef34765d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086166 Apr 11 19:55:31.036068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 666/1272] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:30 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:31.107451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c0089ab-2877-4d83-b2a2-32240bbba4d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:31.108371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c0089ab-2877-4d83-b2a2-32240bbba4d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:31.115011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c0089ab-2877-4d83-b2a2-32240bbba4d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:31.115452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c0089ab-2877-4d83-b2a2-32240bbba4d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:31.116210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c0089ab-2877-4d83-b2a2-32240bbba4d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:31.116633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c0089ab-2877-4d83-b2a2-32240bbba4d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:31.145388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c0089ab-2877-4d83-b2a2-32240bbba4d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Apr 11 19:55:31.146029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 607/1273] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:31.168652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b11d237-91fc-4038-befb-5c9bf53871d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:31.169618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b11d237-91fc-4038-befb-5c9bf53871d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:31.177141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b11d237-91fc-4038-befb-5c9bf53871d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:31.177587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b11d237-91fc-4038-befb-5c9bf53871d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:31.178366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b11d237-91fc-4038-befb-5c9bf53871d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:31.178793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b11d237-91fc-4038-befb-5c9bf53871d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:31.211292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b11d237-91fc-4038-befb-5c9bf53871d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046538 Apr 11 19:55:31.211775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 667/1274] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:31.326406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-15e810cc-045e-45e6-8c18-5c3dc9b38324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:31.327758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-15e810cc-045e-45e6-8c18-5c3dc9b38324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:31.336936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15e810cc-045e-45e6-8c18-5c3dc9b38324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:31.337653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15e810cc-045e-45e6-8c18-5c3dc9b38324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:31.338827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15e810cc-045e-45e6-8c18-5c3dc9b38324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:31.339519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15e810cc-045e-45e6-8c18-5c3dc9b38324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:31.378041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-15e810cc-045e-45e6-8c18-5c3dc9b38324 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057850 Apr 11 19:55:31.378630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 608/1275] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:32.052782 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a3b28683-2ca1-4508-a282-1ff8309885eb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:32.053406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a3b28683-2ca1-4508-a282-1ff8309885eb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:32.061325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3b28683-2ca1-4508-a282-1ff8309885eb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:32.061858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3b28683-2ca1-4508-a282-1ff8309885eb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:32.062986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3b28683-2ca1-4508-a282-1ff8309885eb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:32.063492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3b28683-2ca1-4508-a282-1ff8309885eb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:32.136912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3b28683-2ca1-4508-a282-1ff8309885eb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:32.146316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a3b28683-2ca1-4508-a282-1ff8309885eb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.097602 Apr 11 19:55:32.146971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 668/1276] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:32 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:32.157445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1ff34e8-166c-41aa-8528-1eb5f944f2ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:32.158456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f1ff34e8-166c-41aa-8528-1eb5f944f2ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:32.165245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1ff34e8-166c-41aa-8528-1eb5f944f2ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:32.165688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1ff34e8-166c-41aa-8528-1eb5f944f2ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:32.166442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1ff34e8-166c-41aa-8528-1eb5f944f2ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:32.166874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1ff34e8-166c-41aa-8528-1eb5f944f2ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:32.195494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f1ff34e8-166c-41aa-8528-1eb5f944f2ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041930 Apr 11 19:55:32.196046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 609/1277] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:32.223428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc450853-5b86-447d-871d-a51a3088fb15 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:32.224533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc450853-5b86-447d-871d-a51a3088fb15 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:32.231466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc450853-5b86-447d-871d-a51a3088fb15 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:32.231914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc450853-5b86-447d-871d-a51a3088fb15 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:32.232687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc450853-5b86-447d-871d-a51a3088fb15 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:32.233148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc450853-5b86-447d-871d-a51a3088fb15 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:32.262168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc450853-5b86-447d-871d-a51a3088fb15 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042780 Apr 11 19:55:32.262737 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 669/1278] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:32.390949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77a2edd9-2dbd-4d5d-8565-6735a146829f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:32.391772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77a2edd9-2dbd-4d5d-8565-6735a146829f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:32.398130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77a2edd9-2dbd-4d5d-8565-6735a146829f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:32.398573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77a2edd9-2dbd-4d5d-8565-6735a146829f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:32.399357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77a2edd9-2dbd-4d5d-8565-6735a146829f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:32.399779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77a2edd9-2dbd-4d5d-8565-6735a146829f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:32.428640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77a2edd9-2dbd-4d5d-8565-6735a146829f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041827 Apr 11 19:55:32.429212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 610/1279] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:33.209900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1cb65677-2b9d-4b8f-b06c-ceb52ab0e225 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:33.211001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1cb65677-2b9d-4b8f-b06c-ceb52ab0e225 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:33.218513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cb65677-2b9d-4b8f-b06c-ceb52ab0e225 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:33.218949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cb65677-2b9d-4b8f-b06c-ceb52ab0e225 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:33.219700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cb65677-2b9d-4b8f-b06c-ceb52ab0e225 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:33.220156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cb65677-2b9d-4b8f-b06c-ceb52ab0e225 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:33.240012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ed3a557-f316-4bbf-a5d6-ad355fb788fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:33.240716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ed3a557-f316-4bbf-a5d6-ad355fb788fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:33.247026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ed3a557-f316-4bbf-a5d6-ad355fb788fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:33.247580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ed3a557-f316-4bbf-a5d6-ad355fb788fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:33.248361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ed3a557-f316-4bbf-a5d6-ad355fb788fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:33.248794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ed3a557-f316-4bbf-a5d6-ad355fb788fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:33.252707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1cb65677-2b9d-4b8f-b06c-ceb52ab0e225 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048784 Apr 11 19:55:33.253310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 611/1280] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:33.273761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94bfa1d0-35b3-42aa-9b5b-48364d8282cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:33.274675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94bfa1d0-35b3-42aa-9b5b-48364d8282cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:33.280525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94bfa1d0-35b3-42aa-9b5b-48364d8282cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:33.281008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94bfa1d0-35b3-42aa-9b5b-48364d8282cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:33.281771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94bfa1d0-35b3-42aa-9b5b-48364d8282cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:33.282201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94bfa1d0-35b3-42aa-9b5b-48364d8282cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:33.309862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5ed3a557-f316-4bbf-a5d6-ad355fb788fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:33.310742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94bfa1d0-35b3-42aa-9b5b-48364d8282cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041040 Apr 11 19:55:33.311331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 612/1281] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:33.317280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ed3a557-f316-4bbf-a5d6-ad355fb788fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.155695 Apr 11 19:55:33.317866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 670/1282] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:33 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:33.444511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f1965cd-d7b5-4f01-b96a-d105d1cf9977 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:33.446048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f1965cd-d7b5-4f01-b96a-d105d1cf9977 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:33.456369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f1965cd-d7b5-4f01-b96a-d105d1cf9977 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:33.457180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f1965cd-d7b5-4f01-b96a-d105d1cf9977 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:33.458493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f1965cd-d7b5-4f01-b96a-d105d1cf9977 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:33.458928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f1965cd-d7b5-4f01-b96a-d105d1cf9977 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:33.487447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f1965cd-d7b5-4f01-b96a-d105d1cf9977 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049518 Apr 11 19:55:33.488003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 613/1283] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:34.268875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-10694e9d-7b47-4e88-bc5b-910f3841f474 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:34.270482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-10694e9d-7b47-4e88-bc5b-910f3841f474 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:34.277560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10694e9d-7b47-4e88-bc5b-910f3841f474 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:34.277999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10694e9d-7b47-4e88-bc5b-910f3841f474 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:34.278755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10694e9d-7b47-4e88-bc5b-910f3841f474 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:34.279181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10694e9d-7b47-4e88-bc5b-910f3841f474 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:34.308552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-10694e9d-7b47-4e88-bc5b-910f3841f474 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 Apr 11 19:55:34.309307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 671/1284] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:34.322718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fbdc469d-afe9-4803-8937-cdd5da16c118 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:34.323788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fbdc469d-afe9-4803-8937-cdd5da16c118 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:34.330861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbdc469d-afe9-4803-8937-cdd5da16c118 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:34.331309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbdc469d-afe9-4803-8937-cdd5da16c118 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:34.332075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbdc469d-afe9-4803-8937-cdd5da16c118 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:34.332505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbdc469d-afe9-4803-8937-cdd5da16c118 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:34.333682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6317ea63-0721-4b7b-8fda-2124b56999a2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:34.334292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6317ea63-0721-4b7b-8fda-2124b56999a2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:34.340649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6317ea63-0721-4b7b-8fda-2124b56999a2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:34.341139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6317ea63-0721-4b7b-8fda-2124b56999a2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:34.341899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6317ea63-0721-4b7b-8fda-2124b56999a2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:34.342330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6317ea63-0721-4b7b-8fda-2124b56999a2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:34.362917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fbdc469d-afe9-4803-8937-cdd5da16c118 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044204 Apr 11 19:55:34.363484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 614/1285] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:34.402741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6317ea63-0721-4b7b-8fda-2124b56999a2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:34.410330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6317ea63-0721-4b7b-8fda-2124b56999a2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080373 Apr 11 19:55:34.410886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 672/1286] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:34 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:34.504098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-49f5926a-e2f7-4d21-85f0-e91fbbfa8d33 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:34.505510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-49f5926a-e2f7-4d21-85f0-e91fbbfa8d33 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:34.512066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49f5926a-e2f7-4d21-85f0-e91fbbfa8d33 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:34.512515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49f5926a-e2f7-4d21-85f0-e91fbbfa8d33 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:34.513300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49f5926a-e2f7-4d21-85f0-e91fbbfa8d33 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:34.513731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49f5926a-e2f7-4d21-85f0-e91fbbfa8d33 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:34.542512 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-49f5926a-e2f7-4d21-85f0-e91fbbfa8d33 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045657 Apr 11 19:55:34.543064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 615/1287] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:35.324115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-456415f5-c860-461d-a0d4-f87ee94d8d24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:35.325681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-456415f5-c860-461d-a0d4-f87ee94d8d24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:35.336318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-456415f5-c860-461d-a0d4-f87ee94d8d24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:35.337111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-456415f5-c860-461d-a0d4-f87ee94d8d24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:35.338383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-456415f5-c860-461d-a0d4-f87ee94d8d24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:35.339103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-456415f5-c860-461d-a0d4-f87ee94d8d24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:35.373633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-456415f5-c860-461d-a0d4-f87ee94d8d24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056278 Apr 11 19:55:35.374205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 673/1288] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:35.375323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-acb7629e-d2e6-4c59-846f-57885cfe55a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:35.376207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-acb7629e-d2e6-4c59-846f-57885cfe55a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:35.382606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acb7629e-d2e6-4c59-846f-57885cfe55a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:35.383053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acb7629e-d2e6-4c59-846f-57885cfe55a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:35.383808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acb7629e-d2e6-4c59-846f-57885cfe55a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:35.384242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acb7629e-d2e6-4c59-846f-57885cfe55a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:35.411767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-acb7629e-d2e6-4c59-846f-57885cfe55a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040844 Apr 11 19:55:35.412299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 616/1289] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:35.427346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7daf1727-0d9c-4054-832f-8c0006283706 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:35.427964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7daf1727-0d9c-4054-832f-8c0006283706 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:35.434798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7daf1727-0d9c-4054-832f-8c0006283706 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:35.435252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7daf1727-0d9c-4054-832f-8c0006283706 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:35.436015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7daf1727-0d9c-4054-832f-8c0006283706 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:35.436452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7daf1727-0d9c-4054-832f-8c0006283706 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:35.502382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7daf1727-0d9c-4054-832f-8c0006283706 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:35.513894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7daf1727-0d9c-4054-832f-8c0006283706 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090062 Apr 11 19:55:35.514653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 674/1290] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:35 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:35.554362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e64554f7-49f6-4845-a878-eeccfbdc299f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:35.555308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e64554f7-49f6-4845-a878-eeccfbdc299f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:35.561555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e64554f7-49f6-4845-a878-eeccfbdc299f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:35.561996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e64554f7-49f6-4845-a878-eeccfbdc299f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:35.562740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e64554f7-49f6-4845-a878-eeccfbdc299f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:35.563162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e64554f7-49f6-4845-a878-eeccfbdc299f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:35.590974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e64554f7-49f6-4845-a878-eeccfbdc299f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040619 Apr 11 19:55:35.591504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 617/1291] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:36.390196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-412d3f37-ba64-4ae2-9779-69321842fc6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:36.391554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-412d3f37-ba64-4ae2-9779-69321842fc6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:36.399809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-412d3f37-ba64-4ae2-9779-69321842fc6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:36.400258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-412d3f37-ba64-4ae2-9779-69321842fc6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:36.401054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-412d3f37-ba64-4ae2-9779-69321842fc6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:36.401488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-412d3f37-ba64-4ae2-9779-69321842fc6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:36.423775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7188fd3c-cc9a-4cac-9515-3fc54cb02c1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:36.424688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7188fd3c-cc9a-4cac-9515-3fc54cb02c1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:36.430237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-412d3f37-ba64-4ae2-9779-69321842fc6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046834 Apr 11 19:55:36.430792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 675/1292] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:36.431368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7188fd3c-cc9a-4cac-9515-3fc54cb02c1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:36.431817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7188fd3c-cc9a-4cac-9515-3fc54cb02c1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:36.432587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7188fd3c-cc9a-4cac-9515-3fc54cb02c1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:36.433055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7188fd3c-cc9a-4cac-9515-3fc54cb02c1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:36.461701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7188fd3c-cc9a-4cac-9515-3fc54cb02c1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041938 Apr 11 19:55:36.462221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 618/1293] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:36.535088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d7a24b54-bcbb-4da6-acff-ff91aa20a8b3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:36.536185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d7a24b54-bcbb-4da6-acff-ff91aa20a8b3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:36.546279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7a24b54-bcbb-4da6-acff-ff91aa20a8b3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:36.547017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7a24b54-bcbb-4da6-acff-ff91aa20a8b3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:36.548256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7a24b54-bcbb-4da6-acff-ff91aa20a8b3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:36.549054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7a24b54-bcbb-4da6-acff-ff91aa20a8b3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:36.602790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a05baa4-0c50-4245-b861-f32ff387c3da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:36.603718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a05baa4-0c50-4245-b861-f32ff387c3da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:36.610096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d7a24b54-bcbb-4da6-acff-ff91aa20a8b3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:36.610297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a05baa4-0c50-4245-b861-f32ff387c3da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:36.610669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a05baa4-0c50-4245-b861-f32ff387c3da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:36.611433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a05baa4-0c50-4245-b861-f32ff387c3da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:36.611872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a05baa4-0c50-4245-b861-f32ff387c3da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:36.618273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d7a24b54-bcbb-4da6-acff-ff91aa20a8b3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.089830 Apr 11 19:55:36.618828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 676/1294] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:36 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:36.641125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a05baa4-0c50-4245-b861-f32ff387c3da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Apr 11 19:55:36.641625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 619/1295] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:37.446957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73f6c34e-36e9-4cf9-9186-c2512fbe2bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:37.448335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73f6c34e-36e9-4cf9-9186-c2512fbe2bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:37.459109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73f6c34e-36e9-4cf9-9186-c2512fbe2bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:37.459853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73f6c34e-36e9-4cf9-9186-c2512fbe2bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:37.461169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73f6c34e-36e9-4cf9-9186-c2512fbe2bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:37.461890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73f6c34e-36e9-4cf9-9186-c2512fbe2bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:37.476156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1d256f5-cc9c-438d-82cb-1d692ed97004 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:37.477174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1d256f5-cc9c-438d-82cb-1d692ed97004 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:37.483775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1d256f5-cc9c-438d-82cb-1d692ed97004 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:37.484224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1d256f5-cc9c-438d-82cb-1d692ed97004 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:37.485028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1d256f5-cc9c-438d-82cb-1d692ed97004 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:37.485464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1d256f5-cc9c-438d-82cb-1d692ed97004 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:37.496273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73f6c34e-36e9-4cf9-9186-c2512fbe2bb4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056422 Apr 11 19:55:37.497071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 677/1296] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:37.514789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1d256f5-cc9c-438d-82cb-1d692ed97004 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043885 Apr 11 19:55:37.515359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 620/1297] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:37.639443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5a95f91a-05f6-448e-9986-5dff8a524017 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:37.640450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5a95f91a-05f6-448e-9986-5dff8a524017 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:37.650792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a95f91a-05f6-448e-9986-5dff8a524017 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:37.651535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a95f91a-05f6-448e-9986-5dff8a524017 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:37.652953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a95f91a-05f6-448e-9986-5dff8a524017 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:37.653688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a95f91a-05f6-448e-9986-5dff8a524017 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:37.656749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6d90824a-1ae2-4abd-9767-d81f540df803 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:37.658400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6d90824a-1ae2-4abd-9767-d81f540df803 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:37.665804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d90824a-1ae2-4abd-9767-d81f540df803 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:37.666255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d90824a-1ae2-4abd-9767-d81f540df803 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:37.667026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d90824a-1ae2-4abd-9767-d81f540df803 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:37.667458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d90824a-1ae2-4abd-9767-d81f540df803 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:37.695852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6d90824a-1ae2-4abd-9767-d81f540df803 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045763 Apr 11 19:55:37.696645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 621/1298] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:37 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:37.720087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5a95f91a-05f6-448e-9986-5dff8a524017 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:37.728422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5a95f91a-05f6-448e-9986-5dff8a524017 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.095681 Apr 11 19:55:37.729008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 678/1299] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:37 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:38.512686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4829f9ef-1a6b-46c2-9910-9874ca3ec914 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:38.514084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4829f9ef-1a6b-46c2-9910-9874ca3ec914 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:38.523759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4829f9ef-1a6b-46c2-9910-9874ca3ec914 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:38.524201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4829f9ef-1a6b-46c2-9910-9874ca3ec914 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:38.524937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4829f9ef-1a6b-46c2-9910-9874ca3ec914 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:38.525412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4829f9ef-1a6b-46c2-9910-9874ca3ec914 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:38.527791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb2e6818-ebfd-4a2f-b44d-01206cb892ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:38.528718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb2e6818-ebfd-4a2f-b44d-01206cb892ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:38.535385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb2e6818-ebfd-4a2f-b44d-01206cb892ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:38.535841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb2e6818-ebfd-4a2f-b44d-01206cb892ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:38.536654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb2e6818-ebfd-4a2f-b44d-01206cb892ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:38.537118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb2e6818-ebfd-4a2f-b44d-01206cb892ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:38.555322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4829f9ef-1a6b-46c2-9910-9874ca3ec914 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049372 Apr 11 19:55:38.555879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 622/1300] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:38.567675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb2e6818-ebfd-4a2f-b44d-01206cb892ee tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043886 Apr 11 19:55:38.568206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 679/1301] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:38.707899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eac18cf0-c16b-4601-8aff-22e755f5d6e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:38.708814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eac18cf0-c16b-4601-8aff-22e755f5d6e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:38.716161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac18cf0-c16b-4601-8aff-22e755f5d6e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:38.716602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac18cf0-c16b-4601-8aff-22e755f5d6e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:38.717394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac18cf0-c16b-4601-8aff-22e755f5d6e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:38.717869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac18cf0-c16b-4601-8aff-22e755f5d6e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:38.744589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd8d175a-2822-4913-b0b5-08a563d06c4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:38.745240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd8d175a-2822-4913-b0b5-08a563d06c4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:38.746746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eac18cf0-c16b-4601-8aff-22e755f5d6e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042792 Apr 11 19:55:38.747294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 623/1302] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:38.752130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd8d175a-2822-4913-b0b5-08a563d06c4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:38.752582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd8d175a-2822-4913-b0b5-08a563d06c4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:38.753382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd8d175a-2822-4913-b0b5-08a563d06c4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:38.753801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd8d175a-2822-4913-b0b5-08a563d06c4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:38.825764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cd8d175a-2822-4913-b0b5-08a563d06c4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:38.837000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd8d175a-2822-4913-b0b5-08a563d06c4d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.096146 Apr 11 19:55:38.837781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 680/1303] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:38 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:39.567426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-86b3dd08-4f46-4b08-972e-db7d82aee600 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:39.568265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-86b3dd08-4f46-4b08-972e-db7d82aee600 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:39.575130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86b3dd08-4f46-4b08-972e-db7d82aee600 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:39.575574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86b3dd08-4f46-4b08-972e-db7d82aee600 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:39.576332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86b3dd08-4f46-4b08-972e-db7d82aee600 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:39.576755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86b3dd08-4f46-4b08-972e-db7d82aee600 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:39.580097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7a58780-2599-4d3f-967b-caaa644bb0a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:39.581054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7a58780-2599-4d3f-967b-caaa644bb0a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:39.587917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7a58780-2599-4d3f-967b-caaa644bb0a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:39.588381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7a58780-2599-4d3f-967b-caaa644bb0a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:39.589162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7a58780-2599-4d3f-967b-caaa644bb0a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:39.589563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7a58780-2599-4d3f-967b-caaa644bb0a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:39.611136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-86b3dd08-4f46-4b08-972e-db7d82aee600 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047714 Apr 11 19:55:39.611684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 624/1304] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:39.620473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7a58780-2599-4d3f-967b-caaa644bb0a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044636 Apr 11 19:55:39.621263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 681/1305] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:39.763232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f8f4994-bf23-4c83-a4ea-ea944b7e6c3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:39.764724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f8f4994-bf23-4c83-a4ea-ea944b7e6c3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:39.774975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f8f4994-bf23-4c83-a4ea-ea944b7e6c3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:39.775715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f8f4994-bf23-4c83-a4ea-ea944b7e6c3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:39.777069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f8f4994-bf23-4c83-a4ea-ea944b7e6c3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:39.777776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f8f4994-bf23-4c83-a4ea-ea944b7e6c3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:39.816416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f8f4994-bf23-4c83-a4ea-ea944b7e6c3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059867 Apr 11 19:55:39.817000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 625/1306] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:39.856111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-db2367b6-a017-4b20-8780-ff597719a000 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:39.856852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-db2367b6-a017-4b20-8780-ff597719a000 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:39.864739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db2367b6-a017-4b20-8780-ff597719a000 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:39.865340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db2367b6-a017-4b20-8780-ff597719a000 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:39.866281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db2367b6-a017-4b20-8780-ff597719a000 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:39.866821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db2367b6-a017-4b20-8780-ff597719a000 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:39.929940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-db2367b6-a017-4b20-8780-ff597719a000 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:39.938004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-db2367b6-a017-4b20-8780-ff597719a000 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087307 Apr 11 19:55:39.938613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 682/1307] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:39 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:40.623318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-205ec96f-fb21-44e0-b27a-2f2cb6d47598 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:40.624240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-205ec96f-fb21-44e0-b27a-2f2cb6d47598 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:40.631232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-205ec96f-fb21-44e0-b27a-2f2cb6d47598 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:40.631674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-205ec96f-fb21-44e0-b27a-2f2cb6d47598 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:40.631923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9253f324-c463-497b-aa0a-b866e73871f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:40.632408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-205ec96f-fb21-44e0-b27a-2f2cb6d47598 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:40.632840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9253f324-c463-497b-aa0a-b866e73871f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:40.633048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-205ec96f-fb21-44e0-b27a-2f2cb6d47598 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:40.639975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9253f324-c463-497b-aa0a-b866e73871f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:40.640433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9253f324-c463-497b-aa0a-b866e73871f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:40.641250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9253f324-c463-497b-aa0a-b866e73871f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:40.641685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9253f324-c463-497b-aa0a-b866e73871f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:40.663179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-205ec96f-fb21-44e0-b27a-2f2cb6d47598 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043814 Apr 11 19:55:40.663744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 626/1308] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:40.670669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9253f324-c463-497b-aa0a-b866e73871f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042722 Apr 11 19:55:40.671213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 683/1309] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:40.832475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-12e25c22-9212-4a43-b41d-e2218fa0ccf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:40.833905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-12e25c22-9212-4a43-b41d-e2218fa0ccf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:40.841731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12e25c22-9212-4a43-b41d-e2218fa0ccf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:40.842174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12e25c22-9212-4a43-b41d-e2218fa0ccf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:40.842928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12e25c22-9212-4a43-b41d-e2218fa0ccf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:40.843359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12e25c22-9212-4a43-b41d-e2218fa0ccf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:40.872936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-12e25c22-9212-4a43-b41d-e2218fa0ccf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046960 Apr 11 19:55:40.873525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 627/1310] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:40.957999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f595f8f-1be7-49db-ba23-d5e1a2c9b78f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:40.958642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f595f8f-1be7-49db-ba23-d5e1a2c9b78f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:40.965072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f595f8f-1be7-49db-ba23-d5e1a2c9b78f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:40.965509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f595f8f-1be7-49db-ba23-d5e1a2c9b78f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:40.966296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f595f8f-1be7-49db-ba23-d5e1a2c9b78f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:40.966726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f595f8f-1be7-49db-ba23-d5e1a2c9b78f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:41.034999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f595f8f-1be7-49db-ba23-d5e1a2c9b78f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:41.042813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f595f8f-1be7-49db-ba23-d5e1a2c9b78f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088892 Apr 11 19:55:41.043373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 684/1311] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:40 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:41.675084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1ebac1d-062f-47f3-9e04-129cc67e6e06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:41.676015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1ebac1d-062f-47f3-9e04-129cc67e6e06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:41.682683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1ebac1d-062f-47f3-9e04-129cc67e6e06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:41.682881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fe381174-6019-4cac-a9b3-c417873d121e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:41.683297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1ebac1d-062f-47f3-9e04-129cc67e6e06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:41.683854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1ebac1d-062f-47f3-9e04-129cc67e6e06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:41.684313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1ebac1d-062f-47f3-9e04-129cc67e6e06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:41.685276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fe381174-6019-4cac-a9b3-c417873d121e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:41.691549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe381174-6019-4cac-a9b3-c417873d121e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:41.692040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe381174-6019-4cac-a9b3-c417873d121e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:41.692816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe381174-6019-4cac-a9b3-c417873d121e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:41.693291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe381174-6019-4cac-a9b3-c417873d121e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:41.714312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1ebac1d-062f-47f3-9e04-129cc67e6e06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Apr 11 19:55:41.715407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 628/1312] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:41.723601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fe381174-6019-4cac-a9b3-c417873d121e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044917 Apr 11 19:55:41.724161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 685/1313] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:41.888300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2eb2d27b-1e20-4227-87e7-9443ee7cbc5a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:41.889405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2eb2d27b-1e20-4227-87e7-9443ee7cbc5a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:41.895697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb2d27b-1e20-4227-87e7-9443ee7cbc5a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:41.896140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb2d27b-1e20-4227-87e7-9443ee7cbc5a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:41.896888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb2d27b-1e20-4227-87e7-9443ee7cbc5a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:41.897351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb2d27b-1e20-4227-87e7-9443ee7cbc5a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:41.926285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2eb2d27b-1e20-4227-87e7-9443ee7cbc5a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042539 Apr 11 19:55:41.926843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 629/1314] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:42.060780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c42f37f5-cbbf-4947-b1e3-b728a163d343 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:42.061344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c42f37f5-cbbf-4947-b1e3-b728a163d343 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:42.067799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c42f37f5-cbbf-4947-b1e3-b728a163d343 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:42.068247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c42f37f5-cbbf-4947-b1e3-b728a163d343 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:42.069038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c42f37f5-cbbf-4947-b1e3-b728a163d343 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:42.069469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c42f37f5-cbbf-4947-b1e3-b728a163d343 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:42.133970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c42f37f5-cbbf-4947-b1e3-b728a163d343 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:42.141908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c42f37f5-cbbf-4947-b1e3-b728a163d343 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085114 Apr 11 19:55:42.142473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 686/1315] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:42 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:42.727873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c2bb7bca-7f8b-4fc1-8b61-1768ef3e5217 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:42.728807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c2bb7bca-7f8b-4fc1-8b61-1768ef3e5217 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:42.735593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f308c4ad-290f-46cb-9d8b-837c0f339b3f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:42.736091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2bb7bca-7f8b-4fc1-8b61-1768ef3e5217 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:42.736202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2bb7bca-7f8b-4fc1-8b61-1768ef3e5217 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:42.736532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f308c4ad-290f-46cb-9d8b-837c0f339b3f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:42.737005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2bb7bca-7f8b-4fc1-8b61-1768ef3e5217 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:42.737434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2bb7bca-7f8b-4fc1-8b61-1768ef3e5217 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:42.743384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f308c4ad-290f-46cb-9d8b-837c0f339b3f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:42.743829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f308c4ad-290f-46cb-9d8b-837c0f339b3f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:42.744603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f308c4ad-290f-46cb-9d8b-837c0f339b3f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:42.745138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f308c4ad-290f-46cb-9d8b-837c0f339b3f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:42.769417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c2bb7bca-7f8b-4fc1-8b61-1768ef3e5217 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Apr 11 19:55:42.770475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 630/1316] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:42.780730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f308c4ad-290f-46cb-9d8b-837c0f339b3f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049098 Apr 11 19:55:42.781523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 687/1317] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:42.942213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-172e04ec-a440-4e56-9376-d0676b939419 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:42.943725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-172e04ec-a440-4e56-9376-d0676b939419 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:42.954039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-172e04ec-a440-4e56-9376-d0676b939419 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:42.954837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-172e04ec-a440-4e56-9376-d0676b939419 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:42.956094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-172e04ec-a440-4e56-9376-d0676b939419 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:42.957403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-172e04ec-a440-4e56-9376-d0676b939419 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:42.993210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-172e04ec-a440-4e56-9376-d0676b939419 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057636 Apr 11 19:55:42.993758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 631/1318] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:43.169636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e5329d8-3fd9-42f6-844a-b3a712073035 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:43.171491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e5329d8-3fd9-42f6-844a-b3a712073035 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:43.184922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e5329d8-3fd9-42f6-844a-b3a712073035 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:43.185551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e5329d8-3fd9-42f6-844a-b3a712073035 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:43.186434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e5329d8-3fd9-42f6-844a-b3a712073035 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:43.187004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e5329d8-3fd9-42f6-844a-b3a712073035 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:43.253994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e5329d8-3fd9-42f6-844a-b3a712073035 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:43.262287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e5329d8-3fd9-42f6-844a-b3a712073035 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.104059 Apr 11 19:55:43.262849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 688/1319] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:43 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:43.782912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d3bf2664-ee66-4e46-9b63-3f137b18cfa9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:43.783865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d3bf2664-ee66-4e46-9b63-3f137b18cfa9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:43.790391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3bf2664-ee66-4e46-9b63-3f137b18cfa9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:43.790841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3bf2664-ee66-4e46-9b63-3f137b18cfa9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:43.791614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3bf2664-ee66-4e46-9b63-3f137b18cfa9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:43.792080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3bf2664-ee66-4e46-9b63-3f137b18cfa9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:43.793925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-997122e3-12a7-4809-aace-a1c6e7760d23 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:43.795484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-997122e3-12a7-4809-aace-a1c6e7760d23 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:43.802835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-997122e3-12a7-4809-aace-a1c6e7760d23 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:43.803273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-997122e3-12a7-4809-aace-a1c6e7760d23 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:43.804065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-997122e3-12a7-4809-aace-a1c6e7760d23 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:43.804500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-997122e3-12a7-4809-aace-a1c6e7760d23 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:43.824118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d3bf2664-ee66-4e46-9b63-3f137b18cfa9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Apr 11 19:55:43.824681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 632/1320] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:43.838113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-997122e3-12a7-4809-aace-a1c6e7760d23 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048878 Apr 11 19:55:43.838712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 689/1321] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:44.008372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f056667a-7b81-4c7d-91fb-4926e6681522 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:44.009636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f056667a-7b81-4c7d-91fb-4926e6681522 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:44.017379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f056667a-7b81-4c7d-91fb-4926e6681522 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:44.017887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f056667a-7b81-4c7d-91fb-4926e6681522 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:44.018839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f056667a-7b81-4c7d-91fb-4926e6681522 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:44.019390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f056667a-7b81-4c7d-91fb-4926e6681522 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:44.049079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f056667a-7b81-4c7d-91fb-4926e6681522 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045955 Apr 11 19:55:44.049622 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 633/1322] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:44.283322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8fb0f140-1a89-4353-b9e2-83be5882e0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:44.284357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8fb0f140-1a89-4353-b9e2-83be5882e0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:44.293586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8fb0f140-1a89-4353-b9e2-83be5882e0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:44.294028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8fb0f140-1a89-4353-b9e2-83be5882e0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:44.294775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8fb0f140-1a89-4353-b9e2-83be5882e0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:44.295201 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8fb0f140-1a89-4353-b9e2-83be5882e0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:44.362229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8fb0f140-1a89-4353-b9e2-83be5882e0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:44.374260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8fb0f140-1a89-4353-b9e2-83be5882e0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.097166 Apr 11 19:55:44.375597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 690/1323] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:44 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:44.839019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4252f552-b036-42c7-b64f-9242631bf34e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:44.840254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4252f552-b036-42c7-b64f-9242631bf34e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:44.854610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4252f552-b036-42c7-b64f-9242631bf34e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:44.855308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f24b8d0b-a014-45f3-a30f-e7809b126079 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:44.855786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4252f552-b036-42c7-b64f-9242631bf34e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:44.856243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f24b8d0b-a014-45f3-a30f-e7809b126079 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:44.856728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4252f552-b036-42c7-b64f-9242631bf34e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:44.857214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4252f552-b036-42c7-b64f-9242631bf34e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:44.863312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f24b8d0b-a014-45f3-a30f-e7809b126079 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:44.863788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f24b8d0b-a014-45f3-a30f-e7809b126079 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:44.864804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f24b8d0b-a014-45f3-a30f-e7809b126079 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:44.865290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f24b8d0b-a014-45f3-a30f-e7809b126079 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:44.894189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4252f552-b036-42c7-b64f-9242631bf34e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061723 Apr 11 19:55:44.894856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 634/1324] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:44.898684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f24b8d0b-a014-45f3-a30f-e7809b126079 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049849 Apr 11 19:55:44.899397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 691/1325] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:45.061340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4698d3d0-7492-4519-af11-5d44282e1229 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:45.062355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4698d3d0-7492-4519-af11-5d44282e1229 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:45.069190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4698d3d0-7492-4519-af11-5d44282e1229 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:45.069621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4698d3d0-7492-4519-af11-5d44282e1229 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:45.070394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4698d3d0-7492-4519-af11-5d44282e1229 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:45.070790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4698d3d0-7492-4519-af11-5d44282e1229 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:45.100877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4698d3d0-7492-4519-af11-5d44282e1229 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Apr 11 19:55:45.101383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 635/1326] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:45.393024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-01ea1ff7-20f5-462e-bcef-4b4725e90a83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:45.393548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-01ea1ff7-20f5-462e-bcef-4b4725e90a83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:45.399866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01ea1ff7-20f5-462e-bcef-4b4725e90a83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:45.400311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01ea1ff7-20f5-462e-bcef-4b4725e90a83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:45.401179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01ea1ff7-20f5-462e-bcef-4b4725e90a83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:45.401618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01ea1ff7-20f5-462e-bcef-4b4725e90a83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:45.471979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-01ea1ff7-20f5-462e-bcef-4b4725e90a83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:45.482296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-01ea1ff7-20f5-462e-bcef-4b4725e90a83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093304 Apr 11 19:55:45.482856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 692/1327] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:45 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:45.906802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-365dc72d-5efb-4833-af05-2835acc47391 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:45.907796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-365dc72d-5efb-4833-af05-2835acc47391 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:45.910711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ca4191f1-c1b5-4623-9506-49be695ce0c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:45.911425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ca4191f1-c1b5-4623-9506-49be695ce0c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:45.914123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-365dc72d-5efb-4833-af05-2835acc47391 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:45.914728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-365dc72d-5efb-4833-af05-2835acc47391 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:45.915501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-365dc72d-5efb-4833-af05-2835acc47391 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:45.915931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-365dc72d-5efb-4833-af05-2835acc47391 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:45.917886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca4191f1-c1b5-4623-9506-49be695ce0c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:45.918501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca4191f1-c1b5-4623-9506-49be695ce0c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:45.920497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca4191f1-c1b5-4623-9506-49be695ce0c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:45.920497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca4191f1-c1b5-4623-9506-49be695ce0c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:45.946586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-365dc72d-5efb-4833-af05-2835acc47391 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Apr 11 19:55:45.947155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 636/1328] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:45.950725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ca4191f1-c1b5-4623-9506-49be695ce0c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044100 Apr 11 19:55:45.951329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 693/1329] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:46.119036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c9806149-4559-4f11-8ddf-353cdd0179d0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:46.120324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c9806149-4559-4f11-8ddf-353cdd0179d0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:46.127361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9806149-4559-4f11-8ddf-353cdd0179d0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:46.127900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9806149-4559-4f11-8ddf-353cdd0179d0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:46.128613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9806149-4559-4f11-8ddf-353cdd0179d0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:46.129080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9806149-4559-4f11-8ddf-353cdd0179d0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:46.157523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c9806149-4559-4f11-8ddf-353cdd0179d0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045118 Apr 11 19:55:46.157967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 637/1330] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:46.503971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf5c4eec-1a7c-4b70-8251-b0dfbb0bc1fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:46.504973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cf5c4eec-1a7c-4b70-8251-b0dfbb0bc1fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:46.513681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf5c4eec-1a7c-4b70-8251-b0dfbb0bc1fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:46.514122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf5c4eec-1a7c-4b70-8251-b0dfbb0bc1fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:46.514869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf5c4eec-1a7c-4b70-8251-b0dfbb0bc1fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:46.515294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf5c4eec-1a7c-4b70-8251-b0dfbb0bc1fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:46.581261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf5c4eec-1a7c-4b70-8251-b0dfbb0bc1fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:46.588757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf5c4eec-1a7c-4b70-8251-b0dfbb0bc1fe tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092047 Apr 11 19:55:46.589415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 694/1331] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:46 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:46.962606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee4dd461-d2b8-43c5-9098-cb86e50a82f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:46.964063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee4dd461-d2b8-43c5-9098-cb86e50a82f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:46.966178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d6620c1-abf2-43d5-8120-a91ec890324b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:46.967158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d6620c1-abf2-43d5-8120-a91ec890324b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:46.970685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee4dd461-d2b8-43c5-9098-cb86e50a82f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:46.971127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee4dd461-d2b8-43c5-9098-cb86e50a82f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:46.971900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee4dd461-d2b8-43c5-9098-cb86e50a82f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:46.972332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee4dd461-d2b8-43c5-9098-cb86e50a82f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:46.973766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d6620c1-abf2-43d5-8120-a91ec890324b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:46.974250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d6620c1-abf2-43d5-8120-a91ec890324b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:46.975031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d6620c1-abf2-43d5-8120-a91ec890324b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:46.975463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d6620c1-abf2-43d5-8120-a91ec890324b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:47.007264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee4dd461-d2b8-43c5-9098-cb86e50a82f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051281 Apr 11 19:55:47.007904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 638/1332] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:47.015423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d6620c1-abf2-43d5-8120-a91ec890324b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054277 Apr 11 19:55:47.016630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 695/1333] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:55:47.171083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a60e2d55-c7cc-46e2-85e2-be5fc30579f3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:47.172018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a60e2d55-c7cc-46e2-85e2-be5fc30579f3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:47.178808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a60e2d55-c7cc-46e2-85e2-be5fc30579f3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:47.179249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a60e2d55-c7cc-46e2-85e2-be5fc30579f3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:47.180013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a60e2d55-c7cc-46e2-85e2-be5fc30579f3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:47.180452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a60e2d55-c7cc-46e2-85e2-be5fc30579f3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:47.210111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a60e2d55-c7cc-46e2-85e2-be5fc30579f3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 Apr 11 19:55:47.210725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 639/1334] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:47.609216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-735e7c8b-557f-4eb7-9f9c-b83dde7478c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:47.610222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-735e7c8b-557f-4eb7-9f9c-b83dde7478c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:47.618919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-735e7c8b-557f-4eb7-9f9c-b83dde7478c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:47.619526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-735e7c8b-557f-4eb7-9f9c-b83dde7478c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:47.620584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-735e7c8b-557f-4eb7-9f9c-b83dde7478c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:47.621440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-735e7c8b-557f-4eb7-9f9c-b83dde7478c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:47.708972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-735e7c8b-557f-4eb7-9f9c-b83dde7478c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:47.718358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-735e7c8b-557f-4eb7-9f9c-b83dde7478c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.115447 Apr 11 19:55:47.719173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 696/1335] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:47 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:48.020576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c7ab554f-bb6a-4281-8bd4-76a55c7b2a0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:48.021637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c7ab554f-bb6a-4281-8bd4-76a55c7b2a0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:48.030791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c7ab554f-bb6a-4281-8bd4-76a55c7b2a0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:48.031234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c7ab554f-bb6a-4281-8bd4-76a55c7b2a0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:48.032070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c7ab554f-bb6a-4281-8bd4-76a55c7b2a0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:48.032559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c7ab554f-bb6a-4281-8bd4-76a55c7b2a0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:48.033083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ec206e4f-e823-4540-92df-ea5fd961084d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:48.033987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ec206e4f-e823-4540-92df-ea5fd961084d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:48.042836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec206e4f-e823-4540-92df-ea5fd961084d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:48.043285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec206e4f-e823-4540-92df-ea5fd961084d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:48.044061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec206e4f-e823-4540-92df-ea5fd961084d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:48.044631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec206e4f-e823-4540-92df-ea5fd961084d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:48.067557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c7ab554f-bb6a-4281-8bd4-76a55c7b2a0b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050939 Apr 11 19:55:48.068104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 640/1336] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:48.074157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ec206e4f-e823-4540-92df-ea5fd961084d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047541 Apr 11 19:55:48.074715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 697/1337] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:55:48.226684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f480c4f-407f-41c2-a14a-e02d09ac21bd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:48.228062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f480c4f-407f-41c2-a14a-e02d09ac21bd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:48.236533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f480c4f-407f-41c2-a14a-e02d09ac21bd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:48.237002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f480c4f-407f-41c2-a14a-e02d09ac21bd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:48.238052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f480c4f-407f-41c2-a14a-e02d09ac21bd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:48.238706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f480c4f-407f-41c2-a14a-e02d09ac21bd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:48.269966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f480c4f-407f-41c2-a14a-e02d09ac21bd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049927 Apr 11 19:55:48.270506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 641/1338] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:48.742413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2ee9f7e6-faa4-4f5a-8470-2ac0c3325b2c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:48.743316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2ee9f7e6-faa4-4f5a-8470-2ac0c3325b2c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:48.752280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ee9f7e6-faa4-4f5a-8470-2ac0c3325b2c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:48.752871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ee9f7e6-faa4-4f5a-8470-2ac0c3325b2c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:48.754022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ee9f7e6-faa4-4f5a-8470-2ac0c3325b2c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:48.754585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ee9f7e6-faa4-4f5a-8470-2ac0c3325b2c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:48.821035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2ee9f7e6-faa4-4f5a-8470-2ac0c3325b2c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:48.830058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2ee9f7e6-faa4-4f5a-8470-2ac0c3325b2c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093050 Apr 11 19:55:48.830811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 698/1339] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:48 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:49.079586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-88e1936d-69bb-4432-91a4-5f0e1c246c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:49.080416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-88e1936d-69bb-4432-91a4-5f0e1c246c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:49.086200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ef85f9ad-941d-44a5-af65-9bb97504cd72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:49.087011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88e1936d-69bb-4432-91a4-5f0e1c246c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:49.087170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ef85f9ad-941d-44a5-af65-9bb97504cd72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:49.087456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88e1936d-69bb-4432-91a4-5f0e1c246c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:49.088230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88e1936d-69bb-4432-91a4-5f0e1c246c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:49.088714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88e1936d-69bb-4432-91a4-5f0e1c246c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:49.093833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef85f9ad-941d-44a5-af65-9bb97504cd72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:49.094279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef85f9ad-941d-44a5-af65-9bb97504cd72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:49.095041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef85f9ad-941d-44a5-af65-9bb97504cd72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:49.095472 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef85f9ad-941d-44a5-af65-9bb97504cd72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:49.118048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-88e1936d-69bb-4432-91a4-5f0e1c246c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Apr 11 19:55:49.118632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 642/1340] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:49.125667 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ef85f9ad-941d-44a5-af65-9bb97504cd72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043554 Apr 11 19:55:49.126217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 699/1341] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:49.282094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-801aa387-774e-41de-9127-87bc786bd23a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:49.283053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-801aa387-774e-41de-9127-87bc786bd23a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:49.290026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-801aa387-774e-41de-9127-87bc786bd23a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:49.290475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-801aa387-774e-41de-9127-87bc786bd23a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:49.291232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-801aa387-774e-41de-9127-87bc786bd23a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:49.291659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-801aa387-774e-41de-9127-87bc786bd23a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:49.321275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-801aa387-774e-41de-9127-87bc786bd23a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043160 Apr 11 19:55:49.321846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 643/1342] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:49.846572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-254eaaf5-fb11-4945-a8ff-d28295d1cfa9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:49.847179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-254eaaf5-fb11-4945-a8ff-d28295d1cfa9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:49.854116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-254eaaf5-fb11-4945-a8ff-d28295d1cfa9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:49.854593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-254eaaf5-fb11-4945-a8ff-d28295d1cfa9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:49.855314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-254eaaf5-fb11-4945-a8ff-d28295d1cfa9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:49.855743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-254eaaf5-fb11-4945-a8ff-d28295d1cfa9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:49.919556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-254eaaf5-fb11-4945-a8ff-d28295d1cfa9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:49.927656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-254eaaf5-fb11-4945-a8ff-d28295d1cfa9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085076 Apr 11 19:55:49.928219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 700/1343] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:49 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:50.135867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e4d3463-194e-4ee2-8451-0ce92bca8024 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:50.137680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e4d3463-194e-4ee2-8451-0ce92bca8024 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:50.142332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-adb667c7-2050-4b7f-a554-0f25674a228c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:50.143239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-adb667c7-2050-4b7f-a554-0f25674a228c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:50.145471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e4d3463-194e-4ee2-8451-0ce92bca8024 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:50.145922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e4d3463-194e-4ee2-8451-0ce92bca8024 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:50.146698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e4d3463-194e-4ee2-8451-0ce92bca8024 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:50.147130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e4d3463-194e-4ee2-8451-0ce92bca8024 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:50.149643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adb667c7-2050-4b7f-a554-0f25674a228c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:50.150108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adb667c7-2050-4b7f-a554-0f25674a228c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:50.153143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adb667c7-2050-4b7f-a554-0f25674a228c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:50.153587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adb667c7-2050-4b7f-a554-0f25674a228c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:50.178784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e4d3463-194e-4ee2-8451-0ce92bca8024 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050929 Apr 11 19:55:50.179412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 644/1344] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:50.186466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-adb667c7-2050-4b7f-a554-0f25674a228c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051297 Apr 11 19:55:50.187033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 701/1345] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:50.337307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b10c6280-4233-4e6e-8a73-0932fe064752 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:50.338799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b10c6280-4233-4e6e-8a73-0932fe064752 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:50.347972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b10c6280-4233-4e6e-8a73-0932fe064752 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:50.348427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b10c6280-4233-4e6e-8a73-0932fe064752 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:50.349223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b10c6280-4233-4e6e-8a73-0932fe064752 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:50.349654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b10c6280-4233-4e6e-8a73-0932fe064752 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:50.379543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b10c6280-4233-4e6e-8a73-0932fe064752 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048869 Apr 11 19:55:50.380095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 645/1346] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:50.948573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8484d750-940a-4ada-9a82-c478b641a4b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:50.949770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8484d750-940a-4ada-9a82-c478b641a4b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:50.959756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8484d750-940a-4ada-9a82-c478b641a4b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:50.960528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8484d750-940a-4ada-9a82-c478b641a4b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:50.961817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8484d750-940a-4ada-9a82-c478b641a4b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:50.962527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8484d750-940a-4ada-9a82-c478b641a4b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:51.032541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8484d750-940a-4ada-9a82-c478b641a4b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:51.042345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8484d750-940a-4ada-9a82-c478b641a4b7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.100461 Apr 11 19:55:51.043011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 702/1347] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:50 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:51.194421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-895a6d49-ff4d-4fe8-ae92-92434284f658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:51.195773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-895a6d49-ff4d-4fe8-ae92-92434284f658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:51.198477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f34d62b0-5033-4644-9cbe-c69be9d2a595 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:51.199495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f34d62b0-5033-4644-9cbe-c69be9d2a595 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:51.204034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-895a6d49-ff4d-4fe8-ae92-92434284f658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:51.204667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-895a6d49-ff4d-4fe8-ae92-92434284f658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:51.205917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-895a6d49-ff4d-4fe8-ae92-92434284f658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:51.206040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f34d62b0-5033-4644-9cbe-c69be9d2a595 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:51.206314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f34d62b0-5033-4644-9cbe-c69be9d2a595 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:51.206468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-895a6d49-ff4d-4fe8-ae92-92434284f658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:51.207075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f34d62b0-5033-4644-9cbe-c69be9d2a595 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:51.207505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f34d62b0-5033-4644-9cbe-c69be9d2a595 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:51.237288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f34d62b0-5033-4644-9cbe-c69be9d2a595 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042702 Apr 11 19:55:51.237550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-895a6d49-ff4d-4fe8-ae92-92434284f658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049501 Apr 11 19:55:51.238072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 646/1348] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:51.241461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 703/1349] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:51.396999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-59f4587b-7803-43eb-9ba7-63293158c7fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:51.397914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-59f4587b-7803-43eb-9ba7-63293158c7fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:51.404402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59f4587b-7803-43eb-9ba7-63293158c7fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:51.404843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59f4587b-7803-43eb-9ba7-63293158c7fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:51.405615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59f4587b-7803-43eb-9ba7-63293158c7fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:51.406038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59f4587b-7803-43eb-9ba7-63293158c7fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:51.434227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-59f4587b-7803-43eb-9ba7-63293158c7fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041200 Apr 11 19:55:51.434791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 647/1350] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:52.062370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-04c15ec8-1ddc-496b-8098-275813f87e33 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:52.063396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-04c15ec8-1ddc-496b-8098-275813f87e33 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:52.073666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04c15ec8-1ddc-496b-8098-275813f87e33 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:52.074401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04c15ec8-1ddc-496b-8098-275813f87e33 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:52.075609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04c15ec8-1ddc-496b-8098-275813f87e33 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:52.076350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04c15ec8-1ddc-496b-8098-275813f87e33 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:52.141556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-04c15ec8-1ddc-496b-8098-275813f87e33 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:52.149504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-04c15ec8-1ddc-496b-8098-275813f87e33 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093104 Apr 11 19:55:52.150077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 704/1351] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:52 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:52.248941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-677e284b-3ffc-472e-9277-931dbcbd091a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:52.249636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5523ed71-128d-493a-8625-19d300f69152 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:52.250340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-677e284b-3ffc-472e-9277-931dbcbd091a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:52.250444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5523ed71-128d-493a-8625-19d300f69152 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:52.257525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-677e284b-3ffc-472e-9277-931dbcbd091a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:52.257703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5523ed71-128d-493a-8625-19d300f69152 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:52.257969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-677e284b-3ffc-472e-9277-931dbcbd091a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:52.258108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5523ed71-128d-493a-8625-19d300f69152 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:52.258727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-677e284b-3ffc-472e-9277-931dbcbd091a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:52.258875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5523ed71-128d-493a-8625-19d300f69152 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:52.259155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-677e284b-3ffc-472e-9277-931dbcbd091a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:52.259314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5523ed71-128d-493a-8625-19d300f69152 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:52.288944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5523ed71-128d-493a-8625-19d300f69152 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044063 Apr 11 19:55:52.289165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-677e284b-3ffc-472e-9277-931dbcbd091a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Apr 11 19:55:52.292482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 705/1353] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:52.292645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 648/1353] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:52.446941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7cf7a140-a7a6-4c32-bd01-fc605f3519df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:52.447871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7cf7a140-a7a6-4c32-bd01-fc605f3519df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:52.454544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf7a140-a7a6-4c32-bd01-fc605f3519df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:52.454984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf7a140-a7a6-4c32-bd01-fc605f3519df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:52.455741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf7a140-a7a6-4c32-bd01-fc605f3519df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:52.456163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf7a140-a7a6-4c32-bd01-fc605f3519df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:52.487724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7cf7a140-a7a6-4c32-bd01-fc605f3519df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Apr 11 19:55:52.488462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 706/1354] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:53.168654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c4f4277a-05c9-44b9-b016-fea2fd3c5758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:53.169430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c4f4277a-05c9-44b9-b016-fea2fd3c5758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:53.178708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4f4277a-05c9-44b9-b016-fea2fd3c5758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:53.178919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4f4277a-05c9-44b9-b016-fea2fd3c5758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:53.180299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4f4277a-05c9-44b9-b016-fea2fd3c5758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:53.180872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4f4277a-05c9-44b9-b016-fea2fd3c5758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:53.251928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c4f4277a-05c9-44b9-b016-fea2fd3c5758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:53.259769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c4f4277a-05c9-44b9-b016-fea2fd3c5758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.096479 Apr 11 19:55:53.260309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 649/1355] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:53 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:53.300052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-916627ae-7ba4-454b-85da-bf9ff466d09f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:53.300761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-344ee4d7-233c-4138-aecd-33b47a518f9a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:53.300996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-916627ae-7ba4-454b-85da-bf9ff466d09f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:53.301699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-344ee4d7-233c-4138-aecd-33b47a518f9a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:53.307480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-916627ae-7ba4-454b-85da-bf9ff466d09f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:53.307736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-344ee4d7-233c-4138-aecd-33b47a518f9a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:53.307908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-916627ae-7ba4-454b-85da-bf9ff466d09f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:53.308189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-344ee4d7-233c-4138-aecd-33b47a518f9a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:53.308699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-916627ae-7ba4-454b-85da-bf9ff466d09f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:53.308955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-344ee4d7-233c-4138-aecd-33b47a518f9a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:53.309211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-916627ae-7ba4-454b-85da-bf9ff466d09f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:53.309379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-344ee4d7-233c-4138-aecd-33b47a518f9a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:53.337714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-344ee4d7-233c-4138-aecd-33b47a518f9a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040694 Apr 11 19:55:53.338277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 650/1356] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:55:53.338489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-916627ae-7ba4-454b-85da-bf9ff466d09f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042411 Apr 11 19:55:53.338894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 707/1357] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:53.502548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-308db5e5-c62f-4f40-8fb9-016ccedf3275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:53.503519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-308db5e5-c62f-4f40-8fb9-016ccedf3275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:53.509752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-308db5e5-c62f-4f40-8fb9-016ccedf3275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:53.510212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-308db5e5-c62f-4f40-8fb9-016ccedf3275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:53.510969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-308db5e5-c62f-4f40-8fb9-016ccedf3275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:53.511400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-308db5e5-c62f-4f40-8fb9-016ccedf3275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:53.540157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-308db5e5-c62f-4f40-8fb9-016ccedf3275 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 Apr 11 19:55:53.540691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 651/1358] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:54.278421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b7592bb3-0c64-4e2b-aa66-7b2904505f73 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:54.279180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b7592bb3-0c64-4e2b-aa66-7b2904505f73 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:54.286970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7592bb3-0c64-4e2b-aa66-7b2904505f73 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:54.287564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7592bb3-0c64-4e2b-aa66-7b2904505f73 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:54.288500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7592bb3-0c64-4e2b-aa66-7b2904505f73 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:54.289083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7592bb3-0c64-4e2b-aa66-7b2904505f73 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:54.350212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c754993-0a51-48de-9f52-944e17eaf9e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:54.351172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c754993-0a51-48de-9f52-944e17eaf9e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:54.357976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c754993-0a51-48de-9f52-944e17eaf9e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:54.358403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c754993-0a51-48de-9f52-944e17eaf9e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:54.359544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c754993-0a51-48de-9f52-944e17eaf9e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:54.359805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c754993-0a51-48de-9f52-944e17eaf9e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:54.363589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b7592bb3-0c64-4e2b-aa66-7b2904505f73 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:54.375032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b7592bb3-0c64-4e2b-aa66-7b2904505f73 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.100936 Apr 11 19:55:54.375916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 708/1359] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:54 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:54.383628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3da61275-2dba-49ac-95c2-08cf244e3f11 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:54.385051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3da61275-2dba-49ac-95c2-08cf244e3f11 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:54.390399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c754993-0a51-48de-9f52-944e17eaf9e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044264 Apr 11 19:55:54.390999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 652/1360] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:54.393940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3da61275-2dba-49ac-95c2-08cf244e3f11 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:54.394685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3da61275-2dba-49ac-95c2-08cf244e3f11 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:54.395524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3da61275-2dba-49ac-95c2-08cf244e3f11 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:54.396283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3da61275-2dba-49ac-95c2-08cf244e3f11 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:54.429768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3da61275-2dba-49ac-95c2-08cf244e3f11 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052427 Apr 11 19:55:54.430419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 709/1361] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:54.553124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b916d0e2-bdfe-4f6d-8e89-f1061d4f452f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:54.554200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b916d0e2-bdfe-4f6d-8e89-f1061d4f452f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:54.560800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b916d0e2-bdfe-4f6d-8e89-f1061d4f452f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:54.561371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b916d0e2-bdfe-4f6d-8e89-f1061d4f452f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:54.562144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b916d0e2-bdfe-4f6d-8e89-f1061d4f452f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:54.562582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b916d0e2-bdfe-4f6d-8e89-f1061d4f452f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:54.591836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b916d0e2-bdfe-4f6d-8e89-f1061d4f452f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042725 Apr 11 19:55:54.592461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 653/1362] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:55.397660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95c7856d-2afc-4479-862f-fc0482dff662 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:55.398464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95c7856d-2afc-4479-862f-fc0482dff662 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:55.403798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb266bf4-3267-41c0-9404-909454ca1ebd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:55.404719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb266bf4-3267-41c0-9404-909454ca1ebd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:55.407323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95c7856d-2afc-4479-862f-fc0482dff662 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:55.408726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95c7856d-2afc-4479-862f-fc0482dff662 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:55.409709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95c7856d-2afc-4479-862f-fc0482dff662 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:55.410403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95c7856d-2afc-4479-862f-fc0482dff662 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:55.413124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb266bf4-3267-41c0-9404-909454ca1ebd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:55.413758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb266bf4-3267-41c0-9404-909454ca1ebd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:55.414943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb266bf4-3267-41c0-9404-909454ca1ebd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:55.415700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb266bf4-3267-41c0-9404-909454ca1ebd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:55.444838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb266bf4-3267-41c0-9404-909454ca1ebd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045723 Apr 11 19:55:55.445474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 654/1363] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:55.450320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e24a119-b226-467e-9819-f422338c7fef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:55.451218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8e24a119-b226-467e-9819-f422338c7fef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:55.457221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e24a119-b226-467e-9819-f422338c7fef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:55.457669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e24a119-b226-467e-9819-f422338c7fef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:55.458445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e24a119-b226-467e-9819-f422338c7fef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:55.458871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e24a119-b226-467e-9819-f422338c7fef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:55.474004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95c7856d-2afc-4479-862f-fc0482dff662 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:55.482485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95c7856d-2afc-4479-862f-fc0482dff662 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090708 Apr 11 19:55:55.483077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 710/1364] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:55 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:55.488089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8e24a119-b226-467e-9819-f422338c7fef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041415 Apr 11 19:55:55.488648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 655/1365] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:55.604448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b39ab149-467a-46a7-8f35-0a02e611db19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:55.605381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b39ab149-467a-46a7-8f35-0a02e611db19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:55.611811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b39ab149-467a-46a7-8f35-0a02e611db19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:55.612249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b39ab149-467a-46a7-8f35-0a02e611db19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:55.613031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b39ab149-467a-46a7-8f35-0a02e611db19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:55.613456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b39ab149-467a-46a7-8f35-0a02e611db19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:55.653747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b39ab149-467a-46a7-8f35-0a02e611db19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053390 Apr 11 19:55:55.654222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 711/1366] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:56.459363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cd245779-c8d1-405a-8bef-b3d780b3792a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:56.460329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cd245779-c8d1-405a-8bef-b3d780b3792a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:56.467398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd245779-c8d1-405a-8bef-b3d780b3792a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:56.467846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd245779-c8d1-405a-8bef-b3d780b3792a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:56.468614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd245779-c8d1-405a-8bef-b3d780b3792a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:56.469082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd245779-c8d1-405a-8bef-b3d780b3792a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:56.499240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cd245779-c8d1-405a-8bef-b3d780b3792a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045651 Apr 11 19:55:56.500151 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 656/1367] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:56.500312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d89a4129-44b6-47b5-a99d-ee8696770baa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:56.501165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d89a4129-44b6-47b5-a99d-ee8696770baa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:56.505075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4a80790b-53f5-44dc-8d0c-8bec060962a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:56.505651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4a80790b-53f5-44dc-8d0c-8bec060962a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:56.507879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d89a4129-44b6-47b5-a99d-ee8696770baa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:56.508326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d89a4129-44b6-47b5-a99d-ee8696770baa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:56.509143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d89a4129-44b6-47b5-a99d-ee8696770baa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:56.509578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d89a4129-44b6-47b5-a99d-ee8696770baa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:56.511526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a80790b-53f5-44dc-8d0c-8bec060962a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:56.512278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a80790b-53f5-44dc-8d0c-8bec060962a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:56.513066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a80790b-53f5-44dc-8d0c-8bec060962a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:56.513509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a80790b-53f5-44dc-8d0c-8bec060962a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:56.539239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d89a4129-44b6-47b5-a99d-ee8696770baa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043252 Apr 11 19:55:56.540040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 712/1368] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:56.578082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4a80790b-53f5-44dc-8d0c-8bec060962a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:56.588337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4a80790b-53f5-44dc-8d0c-8bec060962a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086550 Apr 11 19:55:56.589088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 657/1369] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:56 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:56.669585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66895a8e-45b6-42ae-91e7-c66843f9d7de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:56.671163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66895a8e-45b6-42ae-91e7-c66843f9d7de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:56.681485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66895a8e-45b6-42ae-91e7-c66843f9d7de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:56.681936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66895a8e-45b6-42ae-91e7-c66843f9d7de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:56.682696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66895a8e-45b6-42ae-91e7-c66843f9d7de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:56.683129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66895a8e-45b6-42ae-91e7-c66843f9d7de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:56.711549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66895a8e-45b6-42ae-91e7-c66843f9d7de tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048552 Apr 11 19:55:56.712029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 713/1370] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:57.514233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95d576e0-7db1-4089-8d55-7729c8493ed3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:57.515377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95d576e0-7db1-4089-8d55-7729c8493ed3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:57.523281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95d576e0-7db1-4089-8d55-7729c8493ed3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:57.523840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95d576e0-7db1-4089-8d55-7729c8493ed3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:57.524761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95d576e0-7db1-4089-8d55-7729c8493ed3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:57.525423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95d576e0-7db1-4089-8d55-7729c8493ed3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:57.551095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-985dadcf-9a15-4dc8-8b62-b32b1de15392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:57.552119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-985dadcf-9a15-4dc8-8b62-b32b1de15392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:57.558558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985dadcf-9a15-4dc8-8b62-b32b1de15392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:57.559000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985dadcf-9a15-4dc8-8b62-b32b1de15392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:57.559763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985dadcf-9a15-4dc8-8b62-b32b1de15392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:57.560195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985dadcf-9a15-4dc8-8b62-b32b1de15392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:57.572118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95d576e0-7db1-4089-8d55-7729c8493ed3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063384 Apr 11 19:55:57.572716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 658/1371] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:57.590684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-985dadcf-9a15-4dc8-8b62-b32b1de15392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043472 Apr 11 19:55:57.591250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 714/1372] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:57.609685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1415c2ea-dc9a-40a5-a666-49769f42ff8a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:57.610486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1415c2ea-dc9a-40a5-a666-49769f42ff8a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:57.617146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1415c2ea-dc9a-40a5-a666-49769f42ff8a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:57.617595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1415c2ea-dc9a-40a5-a666-49769f42ff8a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:57.618378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1415c2ea-dc9a-40a5-a666-49769f42ff8a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:57.618828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1415c2ea-dc9a-40a5-a666-49769f42ff8a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:57.678928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1415c2ea-dc9a-40a5-a666-49769f42ff8a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:57.686459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1415c2ea-dc9a-40a5-a666-49769f42ff8a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082224 Apr 11 19:55:57.687019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 659/1373] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:57 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:57.723498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e1d52b89-dcf7-4c5a-a609-5ebe4ef5c3d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:57.724448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e1d52b89-dcf7-4c5a-a609-5ebe4ef5c3d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:57.730761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1d52b89-dcf7-4c5a-a609-5ebe4ef5c3d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:57.731514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1d52b89-dcf7-4c5a-a609-5ebe4ef5c3d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:57.731945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1d52b89-dcf7-4c5a-a609-5ebe4ef5c3d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:57.732365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1d52b89-dcf7-4c5a-a609-5ebe4ef5c3d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:57.760384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e1d52b89-dcf7-4c5a-a609-5ebe4ef5c3d3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040831 Apr 11 19:55:57.760967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 715/1374] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:58.584322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c3b639b-6cd8-4c02-ac4c-364f5924f7af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:58.585276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c3b639b-6cd8-4c02-ac4c-364f5924f7af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:58.592079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c3b639b-6cd8-4c02-ac4c-364f5924f7af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:58.592529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c3b639b-6cd8-4c02-ac4c-364f5924f7af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:58.593331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c3b639b-6cd8-4c02-ac4c-364f5924f7af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:58.593806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c3b639b-6cd8-4c02-ac4c-364f5924f7af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:58.602089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-96bc07b6-61b8-4642-8ca8-b755ccbfc492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:58.603084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-96bc07b6-61b8-4642-8ca8-b755ccbfc492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:58.610075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96bc07b6-61b8-4642-8ca8-b755ccbfc492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:58.610523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96bc07b6-61b8-4642-8ca8-b755ccbfc492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:58.611292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96bc07b6-61b8-4642-8ca8-b755ccbfc492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:58.611723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96bc07b6-61b8-4642-8ca8-b755ccbfc492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:58.623246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c3b639b-6cd8-4c02-ac4c-364f5924f7af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042955 Apr 11 19:55:58.623997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 660/1375] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:58.643537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-96bc07b6-61b8-4642-8ca8-b755ccbfc492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Apr 11 19:55:58.644221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 716/1376] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:58.703429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9b6c4cc1-50f7-40ef-8d10-a832699877fb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:58.704031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9b6c4cc1-50f7-40ef-8d10-a832699877fb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:58.712199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b6c4cc1-50f7-40ef-8d10-a832699877fb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:58.712648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b6c4cc1-50f7-40ef-8d10-a832699877fb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:58.713873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b6c4cc1-50f7-40ef-8d10-a832699877fb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:58.714460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b6c4cc1-50f7-40ef-8d10-a832699877fb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:58.773490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-982366cb-0eb8-480f-a3e4-d998e186f434 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:58.774436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-982366cb-0eb8-480f-a3e4-d998e186f434 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:58.780093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b6c4cc1-50f7-40ef-8d10-a832699877fb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:58.780481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-982366cb-0eb8-480f-a3e4-d998e186f434 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:58.780993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-982366cb-0eb8-480f-a3e4-d998e186f434 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:58.781794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-982366cb-0eb8-480f-a3e4-d998e186f434 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:58.782222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-982366cb-0eb8-480f-a3e4-d998e186f434 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:58.788083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9b6c4cc1-50f7-40ef-8d10-a832699877fb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088549 Apr 11 19:55:58.788635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 661/1377] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:58 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:55:58.810593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-982366cb-0eb8-480f-a3e4-d998e186f434 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041016 Apr 11 19:55:58.811054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 717/1378] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:55:59.640470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec12b156-f4a7-4e99-8d13-282efa1d7226 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:59.642232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec12b156-f4a7-4e99-8d13-282efa1d7226 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:59.648933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec12b156-f4a7-4e99-8d13-282efa1d7226 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:59.649423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec12b156-f4a7-4e99-8d13-282efa1d7226 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:59.650284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec12b156-f4a7-4e99-8d13-282efa1d7226 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:59.650719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec12b156-f4a7-4e99-8d13-282efa1d7226 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:59.655438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c82ac38d-b688-43c7-8e0a-9981dcf0ba52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:59.656408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c82ac38d-b688-43c7-8e0a-9981dcf0ba52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:59.663177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82ac38d-b688-43c7-8e0a-9981dcf0ba52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:59.663620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82ac38d-b688-43c7-8e0a-9981dcf0ba52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:59.664383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82ac38d-b688-43c7-8e0a-9981dcf0ba52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:59.664808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82ac38d-b688-43c7-8e0a-9981dcf0ba52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:59.680275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec12b156-f4a7-4e99-8d13-282efa1d7226 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046814 Apr 11 19:55:59.684263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 662/1379] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:55:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:55:59.697941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c82ac38d-b688-43c7-8e0a-9981dcf0ba52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046188 Apr 11 19:55:59.698707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 718/1380] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:59.808856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-420974fb-75a6-41ff-976c-045226e3276e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:59.809905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-420974fb-75a6-41ff-976c-045226e3276e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:59.820136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-420974fb-75a6-41ff-976c-045226e3276e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:59.820888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-420974fb-75a6-41ff-976c-045226e3276e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:59.822183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-420974fb-75a6-41ff-976c-045226e3276e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:59.822908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-420974fb-75a6-41ff-976c-045226e3276e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:59.825701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75d114f1-eeb6-4fa4-a067-4ee957af6d31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:55:59.827989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75d114f1-eeb6-4fa4-a067-4ee957af6d31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:55:59.834876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75d114f1-eeb6-4fa4-a067-4ee957af6d31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:59.835314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75d114f1-eeb6-4fa4-a067-4ee957af6d31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:59.836326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75d114f1-eeb6-4fa4-a067-4ee957af6d31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:55:59.836758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75d114f1-eeb6-4fa4-a067-4ee957af6d31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:55:59.865417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75d114f1-eeb6-4fa4-a067-4ee957af6d31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046390 Apr 11 19:55:59.865977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 719/1381] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:55:59 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:55:59.885939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-420974fb-75a6-41ff-976c-045226e3276e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:55:59.894009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-420974fb-75a6-41ff-976c-045226e3276e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.091531 Apr 11 19:55:59.894510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 663/1382] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:55:59 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:00.694190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c40cc5d-9f16-47ae-a917-6130987a2c76 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:00.695586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c40cc5d-9f16-47ae-a917-6130987a2c76 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:00.703031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c40cc5d-9f16-47ae-a917-6130987a2c76 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:00.703581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c40cc5d-9f16-47ae-a917-6130987a2c76 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:00.704306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c40cc5d-9f16-47ae-a917-6130987a2c76 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:00.705195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c40cc5d-9f16-47ae-a917-6130987a2c76 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:00.709871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e54855a3-36fc-4a0d-9823-7e5cbeb0d564 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:00.710805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e54855a3-36fc-4a0d-9823-7e5cbeb0d564 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:00.717246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e54855a3-36fc-4a0d-9823-7e5cbeb0d564 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:00.717691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e54855a3-36fc-4a0d-9823-7e5cbeb0d564 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:00.718459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e54855a3-36fc-4a0d-9823-7e5cbeb0d564 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:00.718867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e54855a3-36fc-4a0d-9823-7e5cbeb0d564 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:00.735013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c40cc5d-9f16-47ae-a917-6130987a2c76 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046131 Apr 11 19:56:00.735577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 720/1383] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:00.747913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e54855a3-36fc-4a0d-9823-7e5cbeb0d564 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042111 Apr 11 19:56:00.748436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 664/1384] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:56:00.878108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-86c25694-a74d-4a32-bb48-c1c218fd4d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:00.878939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-86c25694-a74d-4a32-bb48-c1c218fd4d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:00.886978 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86c25694-a74d-4a32-bb48-c1c218fd4d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:00.887631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86c25694-a74d-4a32-bb48-c1c218fd4d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:00.888721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86c25694-a74d-4a32-bb48-c1c218fd4d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:00.889277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86c25694-a74d-4a32-bb48-c1c218fd4d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:00.912300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e1cef1ad-87d8-4c97-b010-6d653769699d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:00.912932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e1cef1ad-87d8-4c97-b010-6d653769699d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:00.918795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1cef1ad-87d8-4c97-b010-6d653769699d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:00.919237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1cef1ad-87d8-4c97-b010-6d653769699d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:00.919990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1cef1ad-87d8-4c97-b010-6d653769699d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:00.920419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1cef1ad-87d8-4c97-b010-6d653769699d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:00.923398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-86c25694-a74d-4a32-bb48-c1c218fd4d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049875 Apr 11 19:56:00.923978 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 721/1385] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:00.987363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e1cef1ad-87d8-4c97-b010-6d653769699d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:00.999198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e1cef1ad-87d8-4c97-b010-6d653769699d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090550 Apr 11 19:56:01.000308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 665/1386] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:00 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:01.750681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0be801bd-23c1-4da9-b12c-7a9e53e46f4e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:01.751672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0be801bd-23c1-4da9-b12c-7a9e53e46f4e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:01.759518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0be801bd-23c1-4da9-b12c-7a9e53e46f4e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:01.759953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0be801bd-23c1-4da9-b12c-7a9e53e46f4e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:01.760716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0be801bd-23c1-4da9-b12c-7a9e53e46f4e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:01.760830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f144c53-2b6a-4acf-b8cb-53669cc5da3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:01.761307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0be801bd-23c1-4da9-b12c-7a9e53e46f4e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:01.761745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f144c53-2b6a-4acf-b8cb-53669cc5da3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:01.768956 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f144c53-2b6a-4acf-b8cb-53669cc5da3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:01.769428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f144c53-2b6a-4acf-b8cb-53669cc5da3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:01.770216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f144c53-2b6a-4acf-b8cb-53669cc5da3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:01.770637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f144c53-2b6a-4acf-b8cb-53669cc5da3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:01.791749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0be801bd-23c1-4da9-b12c-7a9e53e46f4e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047823 Apr 11 19:56:01.792630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 722/1387] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:01.800575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f144c53-2b6a-4acf-b8cb-53669cc5da3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Apr 11 19:56:01.801251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 666/1388] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:01.937803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-61e66bf0-0637-4ff6-ae3d-14f3a470b246 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:01.938992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-61e66bf0-0637-4ff6-ae3d-14f3a470b246 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:01.948699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61e66bf0-0637-4ff6-ae3d-14f3a470b246 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:01.949344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61e66bf0-0637-4ff6-ae3d-14f3a470b246 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:01.950580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61e66bf0-0637-4ff6-ae3d-14f3a470b246 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:01.951193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61e66bf0-0637-4ff6-ae3d-14f3a470b246 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:01.982038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-61e66bf0-0637-4ff6-ae3d-14f3a470b246 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049883 Apr 11 19:56:01.982587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 723/1389] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:02.019229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f91a2603-1a20-4853-ae25-791bf8dfd82e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:02.019419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f91a2603-1a20-4853-ae25-791bf8dfd82e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:02.025960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f91a2603-1a20-4853-ae25-791bf8dfd82e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:02.026551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f91a2603-1a20-4853-ae25-791bf8dfd82e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:02.027395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f91a2603-1a20-4853-ae25-791bf8dfd82e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:02.027831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f91a2603-1a20-4853-ae25-791bf8dfd82e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:02.092525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f91a2603-1a20-4853-ae25-791bf8dfd82e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:02.104074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f91a2603-1a20-4853-ae25-791bf8dfd82e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090539 Apr 11 19:56:02.104924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 667/1390] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:02 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:02.805408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66f1f9d7-a199-4680-8024-91d3a1541b40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:02.806317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66f1f9d7-a199-4680-8024-91d3a1541b40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:02.811752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a458a231-b2d6-47e5-a7f2-b3e7386c8952 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:02.812699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a458a231-b2d6-47e5-a7f2-b3e7386c8952 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:02.813136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66f1f9d7-a199-4680-8024-91d3a1541b40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:02.813581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66f1f9d7-a199-4680-8024-91d3a1541b40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:02.814352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66f1f9d7-a199-4680-8024-91d3a1541b40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:02.814776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66f1f9d7-a199-4680-8024-91d3a1541b40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:02.819199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a458a231-b2d6-47e5-a7f2-b3e7386c8952 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:02.819620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a458a231-b2d6-47e5-a7f2-b3e7386c8952 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:02.820399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a458a231-b2d6-47e5-a7f2-b3e7386c8952 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:02.820828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a458a231-b2d6-47e5-a7f2-b3e7386c8952 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:02.843634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66f1f9d7-a199-4680-8024-91d3a1541b40 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042374 Apr 11 19:56:02.847575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 724/1391] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:02.849943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a458a231-b2d6-47e5-a7f2-b3e7386c8952 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042170 Apr 11 19:56:02.850510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 668/1392] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:02.995564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd0e7167-ee96-455d-9bb6-f932032cebb3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:02.996614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd0e7167-ee96-455d-9bb6-f932032cebb3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:03.004184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd0e7167-ee96-455d-9bb6-f932032cebb3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:03.004684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd0e7167-ee96-455d-9bb6-f932032cebb3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:03.005674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd0e7167-ee96-455d-9bb6-f932032cebb3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:03.006232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd0e7167-ee96-455d-9bb6-f932032cebb3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:03.044745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd0e7167-ee96-455d-9bb6-f932032cebb3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052979 Apr 11 19:56:03.045310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 725/1393] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:03.126018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-34ac9f2f-b274-4d74-9e46-0b5ca3b3ab4a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:03.126654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-34ac9f2f-b274-4d74-9e46-0b5ca3b3ab4a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:03.134275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34ac9f2f-b274-4d74-9e46-0b5ca3b3ab4a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:03.134729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34ac9f2f-b274-4d74-9e46-0b5ca3b3ab4a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:03.135487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34ac9f2f-b274-4d74-9e46-0b5ca3b3ab4a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:03.135997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34ac9f2f-b274-4d74-9e46-0b5ca3b3ab4a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:03.204205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-34ac9f2f-b274-4d74-9e46-0b5ca3b3ab4a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:03.212011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-34ac9f2f-b274-4d74-9e46-0b5ca3b3ab4a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092866 Apr 11 19:56:03.212632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 669/1394] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:03 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:03.855630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-477e6321-5aa1-4459-9de4-ef33cfdf630d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:03.857315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-477e6321-5aa1-4459-9de4-ef33cfdf630d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:03.862368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-af0c1c43-67ae-437d-a91c-b3ea02dfd1d5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:03.863358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-af0c1c43-67ae-437d-a91c-b3ea02dfd1d5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:03.864161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477e6321-5aa1-4459-9de4-ef33cfdf630d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:03.864675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477e6321-5aa1-4459-9de4-ef33cfdf630d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:03.865546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477e6321-5aa1-4459-9de4-ef33cfdf630d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:03.866002 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477e6321-5aa1-4459-9de4-ef33cfdf630d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:03.869188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af0c1c43-67ae-437d-a91c-b3ea02dfd1d5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:03.869631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af0c1c43-67ae-437d-a91c-b3ea02dfd1d5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:03.870391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af0c1c43-67ae-437d-a91c-b3ea02dfd1d5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:03.870817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af0c1c43-67ae-437d-a91c-b3ea02dfd1d5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:03.895695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-477e6321-5aa1-4459-9de4-ef33cfdf630d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044034 Apr 11 19:56:03.897049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 726/1395] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:03.899789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-af0c1c43-67ae-437d-a91c-b3ea02dfd1d5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042037 Apr 11 19:56:03.900341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 670/1396] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:04.060408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ddb25c3a-6018-4196-ad2e-4bd397949464 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:04.061350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ddb25c3a-6018-4196-ad2e-4bd397949464 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:04.067784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddb25c3a-6018-4196-ad2e-4bd397949464 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:04.068225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddb25c3a-6018-4196-ad2e-4bd397949464 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:04.069014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddb25c3a-6018-4196-ad2e-4bd397949464 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:04.069444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddb25c3a-6018-4196-ad2e-4bd397949464 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:04.101701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ddb25c3a-6018-4196-ad2e-4bd397949464 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Apr 11 19:56:04.102208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 727/1397] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:04.229623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6be74fd7-3590-4825-8b3e-51daeb0af5a3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:04.230247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6be74fd7-3590-4825-8b3e-51daeb0af5a3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:04.237258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6be74fd7-3590-4825-8b3e-51daeb0af5a3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:04.237705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6be74fd7-3590-4825-8b3e-51daeb0af5a3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:04.238552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6be74fd7-3590-4825-8b3e-51daeb0af5a3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:04.239013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6be74fd7-3590-4825-8b3e-51daeb0af5a3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:04.314010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6be74fd7-3590-4825-8b3e-51daeb0af5a3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:04.322082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6be74fd7-3590-4825-8b3e-51daeb0af5a3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.096515 Apr 11 19:56:04.322651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 671/1398] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:04 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:04.616813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:56:04.617045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 19:56:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 19:56:04.908143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-479989ca-d26f-460c-a8c9-5993cebbc49c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:04.909242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-479989ca-d26f-460c-a8c9-5993cebbc49c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:04.911639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f939801-327d-4ba9-985b-c99d1dae04dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:04.913209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f939801-327d-4ba9-985b-c99d1dae04dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:04.915479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479989ca-d26f-460c-a8c9-5993cebbc49c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:04.915925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479989ca-d26f-460c-a8c9-5993cebbc49c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:04.916664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479989ca-d26f-460c-a8c9-5993cebbc49c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:04.917330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479989ca-d26f-460c-a8c9-5993cebbc49c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:04.919838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f939801-327d-4ba9-985b-c99d1dae04dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:04.920297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f939801-327d-4ba9-985b-c99d1dae04dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:04.921138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f939801-327d-4ba9-985b-c99d1dae04dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:04.921698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f939801-327d-4ba9-985b-c99d1dae04dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:04.947965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-479989ca-d26f-460c-a8c9-5993cebbc49c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043815 Apr 11 19:56:04.948732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 728/1399] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:04.951458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f939801-327d-4ba9-985b-c99d1dae04dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Apr 11 19:56:04.952031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 672/1400] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:05.115517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d2afd0c1-66f4-4513-a946-40cb0c8f121b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:05.116483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d2afd0c1-66f4-4513-a946-40cb0c8f121b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:05.124382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2afd0c1-66f4-4513-a946-40cb0c8f121b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:05.125337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2afd0c1-66f4-4513-a946-40cb0c8f121b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:05.126309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2afd0c1-66f4-4513-a946-40cb0c8f121b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:05.126870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2afd0c1-66f4-4513-a946-40cb0c8f121b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:05.158111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d2afd0c1-66f4-4513-a946-40cb0c8f121b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 Apr 11 19:56:05.158671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 729/1401] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:05.344926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-518603ad-e8ca-49fb-953c-59bebdf701ab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:05.345827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-518603ad-e8ca-49fb-953c-59bebdf701ab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:05.353331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-518603ad-e8ca-49fb-953c-59bebdf701ab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:05.353799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-518603ad-e8ca-49fb-953c-59bebdf701ab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:05.354620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-518603ad-e8ca-49fb-953c-59bebdf701ab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:05.355072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-518603ad-e8ca-49fb-953c-59bebdf701ab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:05.418214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-518603ad-e8ca-49fb-953c-59bebdf701ab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:05.425968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-518603ad-e8ca-49fb-953c-59bebdf701ab tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087307 Apr 11 19:56:05.426532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 673/1402] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:05 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:05.961486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-881fca3b-6a41-452b-90fc-ad48601d7755 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:05.962400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-881fca3b-6a41-452b-90fc-ad48601d7755 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:05.963559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e59d1bd-bd18-4070-a681-ec2720285aa3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:05.964488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e59d1bd-bd18-4070-a681-ec2720285aa3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:05.969964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-881fca3b-6a41-452b-90fc-ad48601d7755 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:05.970410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-881fca3b-6a41-452b-90fc-ad48601d7755 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:05.971273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-881fca3b-6a41-452b-90fc-ad48601d7755 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:05.971386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e59d1bd-bd18-4070-a681-ec2720285aa3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:05.971702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-881fca3b-6a41-452b-90fc-ad48601d7755 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:05.971817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e59d1bd-bd18-4070-a681-ec2720285aa3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:05.972563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e59d1bd-bd18-4070-a681-ec2720285aa3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:05.973027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e59d1bd-bd18-4070-a681-ec2720285aa3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:06.002361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e59d1bd-bd18-4070-a681-ec2720285aa3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042777 Apr 11 19:56:06.002930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 674/1403] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:06.004451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-881fca3b-6a41-452b-90fc-ad48601d7755 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047790 Apr 11 19:56:06.005196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 730/1404] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:56:06.170966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c3dd66fd-0f17-4976-908a-2410507320b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:06.172119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c3dd66fd-0f17-4976-908a-2410507320b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:06.180570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3dd66fd-0f17-4976-908a-2410507320b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:06.181095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3dd66fd-0f17-4976-908a-2410507320b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:06.182007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3dd66fd-0f17-4976-908a-2410507320b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:06.182502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3dd66fd-0f17-4976-908a-2410507320b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:06.218735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c3dd66fd-0f17-4976-908a-2410507320b4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051905 Apr 11 19:56:06.219227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 675/1405] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:56:06.443152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90838f31-760a-4a3a-bf09-88cb3e3588b1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:06.443767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90838f31-760a-4a3a-bf09-88cb3e3588b1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:06.450210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90838f31-760a-4a3a-bf09-88cb3e3588b1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:06.450659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90838f31-760a-4a3a-bf09-88cb3e3588b1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:06.451416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90838f31-760a-4a3a-bf09-88cb3e3588b1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:06.451845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90838f31-760a-4a3a-bf09-88cb3e3588b1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:06.516344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90838f31-760a-4a3a-bf09-88cb3e3588b1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:06.524549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90838f31-760a-4a3a-bf09-88cb3e3588b1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085319 Apr 11 19:56:06.525138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 731/1406] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:06 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:07.017189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5423fc75-8232-4b89-ab29-14cafe7b8605 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:07.017844 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-483bcd65-0bbb-44c0-ab18-f674220de158 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:07.018215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5423fc75-8232-4b89-ab29-14cafe7b8605 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:07.018947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-483bcd65-0bbb-44c0-ab18-f674220de158 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:07.026269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5423fc75-8232-4b89-ab29-14cafe7b8605 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:07.026715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5423fc75-8232-4b89-ab29-14cafe7b8605 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:07.027122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-483bcd65-0bbb-44c0-ab18-f674220de158 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:07.027485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5423fc75-8232-4b89-ab29-14cafe7b8605 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:07.027644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-483bcd65-0bbb-44c0-ab18-f674220de158 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:07.027917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5423fc75-8232-4b89-ab29-14cafe7b8605 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:07.028311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-483bcd65-0bbb-44c0-ab18-f674220de158 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:07.028749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-483bcd65-0bbb-44c0-ab18-f674220de158 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:07.057762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-483bcd65-0bbb-44c0-ab18-f674220de158 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045368 Apr 11 19:56:07.058026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5423fc75-8232-4b89-ab29-14cafe7b8605 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046652 Apr 11 19:56:07.058520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 732/1407] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:07.058653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 676/1408] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:07.231765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ad63c96a-3a82-4ad7-b41c-71b3a11126a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:07.232697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ad63c96a-3a82-4ad7-b41c-71b3a11126a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:07.239628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad63c96a-3a82-4ad7-b41c-71b3a11126a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:07.240079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad63c96a-3a82-4ad7-b41c-71b3a11126a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:07.240831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad63c96a-3a82-4ad7-b41c-71b3a11126a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:07.241303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad63c96a-3a82-4ad7-b41c-71b3a11126a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:07.271189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ad63c96a-3a82-4ad7-b41c-71b3a11126a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Apr 11 19:56:07.271674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 733/1409] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:07.546436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79405c3c-a887-46f9-984e-30ee0e2afded tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:07.547214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-79405c3c-a887-46f9-984e-30ee0e2afded tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:07.557199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79405c3c-a887-46f9-984e-30ee0e2afded tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:07.557939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79405c3c-a887-46f9-984e-30ee0e2afded tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:07.559169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79405c3c-a887-46f9-984e-30ee0e2afded tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:07.559888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79405c3c-a887-46f9-984e-30ee0e2afded tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:07.570462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:56:07.570720 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 19:56:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 19:56:07.638354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79405c3c-a887-46f9-984e-30ee0e2afded tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:07.646034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79405c3c-a887-46f9-984e-30ee0e2afded tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.106754 Apr 11 19:56:07.646590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 677/1410] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:07 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:08.073295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b028a56-903c-4ba6-ad3d-7f56799faec9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:08.073998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3467f70f-4d59-42d2-8807-e071756c9fe2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:08.074377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3467f70f-4d59-42d2-8807-e071756c9fe2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:08.074485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b028a56-903c-4ba6-ad3d-7f56799faec9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:08.080939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b028a56-903c-4ba6-ad3d-7f56799faec9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:08.081109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3467f70f-4d59-42d2-8807-e071756c9fe2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:08.081389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b028a56-903c-4ba6-ad3d-7f56799faec9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:08.081558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3467f70f-4d59-42d2-8807-e071756c9fe2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:08.082154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b028a56-903c-4ba6-ad3d-7f56799faec9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:08.082299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3467f70f-4d59-42d2-8807-e071756c9fe2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:08.082589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b028a56-903c-4ba6-ad3d-7f56799faec9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:08.082744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3467f70f-4d59-42d2-8807-e071756c9fe2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:08.111990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b028a56-903c-4ba6-ad3d-7f56799faec9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044618 Apr 11 19:56:08.112297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3467f70f-4d59-42d2-8807-e071756c9fe2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045100 Apr 11 19:56:08.112732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 678/1411] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:56:08.112946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 734/1412] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:08.286557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-748fea80-b40c-445a-af83-0cb55f08949c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:08.288093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-748fea80-b40c-445a-af83-0cb55f08949c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:08.295703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-748fea80-b40c-445a-af83-0cb55f08949c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:08.296140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-748fea80-b40c-445a-af83-0cb55f08949c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:08.296893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-748fea80-b40c-445a-af83-0cb55f08949c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:08.297349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-748fea80-b40c-445a-af83-0cb55f08949c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:08.327396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-748fea80-b40c-445a-af83-0cb55f08949c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047406 Apr 11 19:56:08.327845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 679/1413] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:08.663751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4eac614-23a1-46ed-9357-8042d405cae2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:08.664323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4eac614-23a1-46ed-9357-8042d405cae2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:08.671058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4eac614-23a1-46ed-9357-8042d405cae2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:08.671520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4eac614-23a1-46ed-9357-8042d405cae2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:08.672313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4eac614-23a1-46ed-9357-8042d405cae2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:08.672758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4eac614-23a1-46ed-9357-8042d405cae2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:08.744641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4eac614-23a1-46ed-9357-8042d405cae2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:08.752602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4eac614-23a1-46ed-9357-8042d405cae2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093284 Apr 11 19:56:08.753189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 735/1414] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:08 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:09.124305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dbc49267-4b4f-4ca8-a5dc-59f36ad7eb2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:09.125460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-812c0c2b-c534-447c-a833-e6ce98ca7e59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:09.125846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dbc49267-4b4f-4ca8-a5dc-59f36ad7eb2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:09.125955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-812c0c2b-c534-447c-a833-e6ce98ca7e59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:09.132234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812c0c2b-c534-447c-a833-e6ce98ca7e59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:09.132425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbc49267-4b4f-4ca8-a5dc-59f36ad7eb2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:09.132684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812c0c2b-c534-447c-a833-e6ce98ca7e59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:09.132843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbc49267-4b4f-4ca8-a5dc-59f36ad7eb2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:09.133491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812c0c2b-c534-447c-a833-e6ce98ca7e59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:09.133605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbc49267-4b4f-4ca8-a5dc-59f36ad7eb2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:09.133923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812c0c2b-c534-447c-a833-e6ce98ca7e59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:09.134041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbc49267-4b4f-4ca8-a5dc-59f36ad7eb2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:09.164588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dbc49267-4b4f-4ca8-a5dc-59f36ad7eb2f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Apr 11 19:56:09.165207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 680/1415] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:09.165343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-812c0c2b-c534-447c-a833-e6ce98ca7e59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044793 Apr 11 19:56:09.165806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 736/1416] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:09.343450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c6f3ecc-2118-4291-99f9-db93cc7730bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:09.345314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c6f3ecc-2118-4291-99f9-db93cc7730bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:09.355431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ecc-2118-4291-99f9-db93cc7730bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:09.356185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ecc-2118-4291-99f9-db93cc7730bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:09.357458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ecc-2118-4291-99f9-db93cc7730bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:09.358143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6f3ecc-2118-4291-99f9-db93cc7730bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:09.392872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c6f3ecc-2118-4291-99f9-db93cc7730bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055740 Apr 11 19:56:09.393380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 681/1417] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:09.773358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dfc0d4ec-d128-4122-b186-fb155c8fa007 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:09.774172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dfc0d4ec-d128-4122-b186-fb155c8fa007 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:09.782193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfc0d4ec-d128-4122-b186-fb155c8fa007 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:09.782748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfc0d4ec-d128-4122-b186-fb155c8fa007 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:09.783713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfc0d4ec-d128-4122-b186-fb155c8fa007 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:09.784243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfc0d4ec-d128-4122-b186-fb155c8fa007 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:09.847026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dfc0d4ec-d128-4122-b186-fb155c8fa007 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:09.854781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dfc0d4ec-d128-4122-b186-fb155c8fa007 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086289 Apr 11 19:56:09.855338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 737/1418] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:09 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:10.176337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4bbc9c92-ee5b-4908-8c0a-d7dde9100339 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:10.177251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0baa5149-758a-4e4d-9072-350829066df6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:10.177679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4bbc9c92-ee5b-4908-8c0a-d7dde9100339 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:10.178403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0baa5149-758a-4e4d-9072-350829066df6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:10.185319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bbc9c92-ee5b-4908-8c0a-d7dde9100339 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:10.185769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bbc9c92-ee5b-4908-8c0a-d7dde9100339 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:10.186540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bbc9c92-ee5b-4908-8c0a-d7dde9100339 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:10.186968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bbc9c92-ee5b-4908-8c0a-d7dde9100339 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:10.191119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0baa5149-758a-4e4d-9072-350829066df6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:10.191119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0baa5149-758a-4e4d-9072-350829066df6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:10.191780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0baa5149-758a-4e4d-9072-350829066df6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:10.192215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0baa5149-758a-4e4d-9072-350829066df6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:10.219961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4bbc9c92-ee5b-4908-8c0a-d7dde9100339 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047871 Apr 11 19:56:10.220514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 682/1419] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:10.224193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0baa5149-758a-4e4d-9072-350829066df6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051071 Apr 11 19:56:10.224897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 738/1420] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:10.407591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ab2e212b-2062-4588-a5fd-3fc57a6b5fca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:10.409164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ab2e212b-2062-4588-a5fd-3fc57a6b5fca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:10.417509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab2e212b-2062-4588-a5fd-3fc57a6b5fca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:10.418135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab2e212b-2062-4588-a5fd-3fc57a6b5fca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:10.419025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab2e212b-2062-4588-a5fd-3fc57a6b5fca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:10.419454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab2e212b-2062-4588-a5fd-3fc57a6b5fca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:10.447857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ab2e212b-2062-4588-a5fd-3fc57a6b5fca tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046575 Apr 11 19:56:10.448327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 683/1421] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:10.873219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b85cb046-c016-4bdd-b896-d04d183305c0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:10.873739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b85cb046-c016-4bdd-b896-d04d183305c0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:10.880278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85cb046-c016-4bdd-b896-d04d183305c0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:10.880730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85cb046-c016-4bdd-b896-d04d183305c0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:10.881522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85cb046-c016-4bdd-b896-d04d183305c0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:10.881958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85cb046-c016-4bdd-b896-d04d183305c0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:10.941553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b85cb046-c016-4bdd-b896-d04d183305c0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:10.949350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b85cb046-c016-4bdd-b896-d04d183305c0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081079 Apr 11 19:56:10.949952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 739/1422] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:10 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:11.232294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-90d2efbd-b975-46a0-a0c8-2aaa41ad8628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:11.233347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-90d2efbd-b975-46a0-a0c8-2aaa41ad8628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:11.235989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-949aa14b-5efc-448c-80c9-4343e528bfa7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:11.236922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-949aa14b-5efc-448c-80c9-4343e528bfa7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:11.240144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90d2efbd-b975-46a0-a0c8-2aaa41ad8628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:11.240578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90d2efbd-b975-46a0-a0c8-2aaa41ad8628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:11.241351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90d2efbd-b975-46a0-a0c8-2aaa41ad8628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:11.241791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90d2efbd-b975-46a0-a0c8-2aaa41ad8628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:11.242938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-949aa14b-5efc-448c-80c9-4343e528bfa7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:11.243407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-949aa14b-5efc-448c-80c9-4343e528bfa7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:11.244167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-949aa14b-5efc-448c-80c9-4343e528bfa7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:11.244603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-949aa14b-5efc-448c-80c9-4343e528bfa7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:11.274086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-90d2efbd-b975-46a0-a0c8-2aaa41ad8628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Apr 11 19:56:11.274658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 684/1423] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:11.275362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-949aa14b-5efc-448c-80c9-4343e528bfa7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043540 Apr 11 19:56:11.276322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 740/1424] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:11.461846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5e36259-fd69-4199-86bb-18f02ca9f6b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:11.462708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5e36259-fd69-4199-86bb-18f02ca9f6b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:11.470056 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5e36259-fd69-4199-86bb-18f02ca9f6b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:11.470496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5e36259-fd69-4199-86bb-18f02ca9f6b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:11.471245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5e36259-fd69-4199-86bb-18f02ca9f6b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:11.471675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5e36259-fd69-4199-86bb-18f02ca9f6b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:11.503121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5e36259-fd69-4199-86bb-18f02ca9f6b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046280 Apr 11 19:56:11.503678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 685/1425] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:11.971168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c85224c0-6212-463b-8c4f-2cfbb0151ae8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:11.972162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c85224c0-6212-463b-8c4f-2cfbb0151ae8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:11.982359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c85224c0-6212-463b-8c4f-2cfbb0151ae8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:11.982805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c85224c0-6212-463b-8c4f-2cfbb0151ae8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:11.983568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c85224c0-6212-463b-8c4f-2cfbb0151ae8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:11.983992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c85224c0-6212-463b-8c4f-2cfbb0151ae8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:12.049941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c85224c0-6212-463b-8c4f-2cfbb0151ae8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:12.057705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c85224c0-6212-463b-8c4f-2cfbb0151ae8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093076 Apr 11 19:56:12.058265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 741/1426] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:11 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:12.286849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-503dfbcf-7769-4958-912c-9338baf627bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:12.287686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd5e89e5-e6a1-4337-9569-b236354ecf2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:12.288054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-503dfbcf-7769-4958-912c-9338baf627bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:12.288799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd5e89e5-e6a1-4337-9569-b236354ecf2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:12.294485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-503dfbcf-7769-4958-912c-9338baf627bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:12.294941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-503dfbcf-7769-4958-912c-9338baf627bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:12.295529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd5e89e5-e6a1-4337-9569-b236354ecf2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:12.295769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-503dfbcf-7769-4958-912c-9338baf627bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:12.296095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd5e89e5-e6a1-4337-9569-b236354ecf2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:12.296230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-503dfbcf-7769-4958-912c-9338baf627bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:12.296888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd5e89e5-e6a1-4337-9569-b236354ecf2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:12.297339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd5e89e5-e6a1-4337-9569-b236354ecf2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:12.325331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-503dfbcf-7769-4958-912c-9338baf627bb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042514 Apr 11 19:56:12.325793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd5e89e5-e6a1-4337-9569-b236354ecf2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042468 Apr 11 19:56:12.326226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 686/1427] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:12.327375 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 742/1428] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:12.516009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b17af45-adf3-4550-8b6a-5cafdc649343 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:12.517202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b17af45-adf3-4550-8b6a-5cafdc649343 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:12.525396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b17af45-adf3-4550-8b6a-5cafdc649343 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:12.525993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b17af45-adf3-4550-8b6a-5cafdc649343 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:12.526979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b17af45-adf3-4550-8b6a-5cafdc649343 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:12.527586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b17af45-adf3-4550-8b6a-5cafdc649343 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:12.557123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b17af45-adf3-4550-8b6a-5cafdc649343 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046046 Apr 11 19:56:12.557686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 687/1429] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:13.075639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b654b7de-119e-42ca-9a3e-7b97ad541b41 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:13.076407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b654b7de-119e-42ca-9a3e-7b97ad541b41 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:13.084484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b654b7de-119e-42ca-9a3e-7b97ad541b41 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:13.084940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b654b7de-119e-42ca-9a3e-7b97ad541b41 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:13.085719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b654b7de-119e-42ca-9a3e-7b97ad541b41 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:13.086145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b654b7de-119e-42ca-9a3e-7b97ad541b41 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:13.150842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b654b7de-119e-42ca-9a3e-7b97ad541b41 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:13.158463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b654b7de-119e-42ca-9a3e-7b97ad541b41 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087193 Apr 11 19:56:13.159021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 743/1430] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:13 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:13.339404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-281f590d-5946-4fb6-abcf-0d60813f3afc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:13.339974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ee57994-b031-4b14-a9b0-99a734d17753 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:13.340343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-281f590d-5946-4fb6-abcf-0d60813f3afc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:13.340441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ee57994-b031-4b14-a9b0-99a734d17753 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:13.347221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-281f590d-5946-4fb6-abcf-0d60813f3afc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:13.347404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee57994-b031-4b14-a9b0-99a734d17753 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:13.347666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee57994-b031-4b14-a9b0-99a734d17753 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:13.347825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-281f590d-5946-4fb6-abcf-0d60813f3afc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:13.348421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee57994-b031-4b14-a9b0-99a734d17753 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:13.348585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-281f590d-5946-4fb6-abcf-0d60813f3afc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:13.348848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ee57994-b031-4b14-a9b0-99a734d17753 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:13.349035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-281f590d-5946-4fb6-abcf-0d60813f3afc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:13.379098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-281f590d-5946-4fb6-abcf-0d60813f3afc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Apr 11 19:56:13.379797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 688/1431] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:13.383323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ee57994-b031-4b14-a9b0-99a734d17753 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047820 Apr 11 19:56:13.383946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 744/1432] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:13.572311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-58c8754d-3e0a-4877-9390-5542d628521f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:13.573910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-58c8754d-3e0a-4877-9390-5542d628521f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:13.582797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58c8754d-3e0a-4877-9390-5542d628521f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:13.583330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58c8754d-3e0a-4877-9390-5542d628521f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:13.584354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58c8754d-3e0a-4877-9390-5542d628521f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:13.584935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58c8754d-3e0a-4877-9390-5542d628521f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:13.618617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-58c8754d-3e0a-4877-9390-5542d628521f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053391 Apr 11 19:56:13.619087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 689/1433] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:14.180090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8622d8fb-7251-4215-9879-1bf83ae6472b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:14.181359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8622d8fb-7251-4215-9879-1bf83ae6472b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:14.192317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8622d8fb-7251-4215-9879-1bf83ae6472b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:14.192317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8622d8fb-7251-4215-9879-1bf83ae6472b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:14.193037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8622d8fb-7251-4215-9879-1bf83ae6472b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:14.193464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8622d8fb-7251-4215-9879-1bf83ae6472b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:14.260170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8622d8fb-7251-4215-9879-1bf83ae6472b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:14.270821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8622d8fb-7251-4215-9879-1bf83ae6472b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098111 Apr 11 19:56:14.271415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 745/1434] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:14 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:14.391653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-99a21cad-9bbd-4512-8a82-fc4b686360f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:14.392694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-99a21cad-9bbd-4512-8a82-fc4b686360f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:14.395413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-db43f05b-d59a-48bc-a41d-36f3ec03ae8b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:14.396329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-db43f05b-d59a-48bc-a41d-36f3ec03ae8b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:14.399275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99a21cad-9bbd-4512-8a82-fc4b686360f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:14.399730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99a21cad-9bbd-4512-8a82-fc4b686360f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:14.400494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99a21cad-9bbd-4512-8a82-fc4b686360f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:14.400897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99a21cad-9bbd-4512-8a82-fc4b686360f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:14.402401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db43f05b-d59a-48bc-a41d-36f3ec03ae8b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:14.402845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db43f05b-d59a-48bc-a41d-36f3ec03ae8b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:14.403591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db43f05b-d59a-48bc-a41d-36f3ec03ae8b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:14.404018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db43f05b-d59a-48bc-a41d-36f3ec03ae8b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:14.430816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-99a21cad-9bbd-4512-8a82-fc4b686360f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043413 Apr 11 19:56:14.434565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 690/1435] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:14.438355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-db43f05b-d59a-48bc-a41d-36f3ec03ae8b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046428 Apr 11 19:56:14.443496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 746/1436] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:56:14.630892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2bf3dc22-f2c5-4c0f-9364-bf3fd8c0da47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:14.631900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2bf3dc22-f2c5-4c0f-9364-bf3fd8c0da47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:14.638611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc22-f2c5-4c0f-9364-bf3fd8c0da47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:14.639064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc22-f2c5-4c0f-9364-bf3fd8c0da47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:14.639827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc22-f2c5-4c0f-9364-bf3fd8c0da47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:14.640259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2bf3dc22-f2c5-4c0f-9364-bf3fd8c0da47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:14.671158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2bf3dc22-f2c5-4c0f-9364-bf3fd8c0da47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Apr 11 19:56:14.671751 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 691/1437] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:15.288135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fe5bd2c3-7367-4ccc-b4ab-a35d22e3d58e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:15.288744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fe5bd2c3-7367-4ccc-b4ab-a35d22e3d58e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:15.295656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe5bd2c3-7367-4ccc-b4ab-a35d22e3d58e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:15.296105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe5bd2c3-7367-4ccc-b4ab-a35d22e3d58e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:15.296870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe5bd2c3-7367-4ccc-b4ab-a35d22e3d58e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:15.297329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe5bd2c3-7367-4ccc-b4ab-a35d22e3d58e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:15.365179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fe5bd2c3-7367-4ccc-b4ab-a35d22e3d58e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:15.378209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fe5bd2c3-7367-4ccc-b4ab-a35d22e3d58e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.094138 Apr 11 19:56:15.378879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 747/1438] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:15 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:15.443487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ca2228d-c53b-4431-916b-de52ab0ca1f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:15.444331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ca2228d-c53b-4431-916b-de52ab0ca1f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:15.450672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ca2228d-c53b-4431-916b-de52ab0ca1f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:15.451113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ca2228d-c53b-4431-916b-de52ab0ca1f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:15.451389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-375d1d5a-7869-49e3-95f4-3f77ba4a7154 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:15.451866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ca2228d-c53b-4431-916b-de52ab0ca1f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:15.452291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ca2228d-c53b-4431-916b-de52ab0ca1f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:15.452425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-375d1d5a-7869-49e3-95f4-3f77ba4a7154 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:15.458735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-375d1d5a-7869-49e3-95f4-3f77ba4a7154 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:15.459289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-375d1d5a-7869-49e3-95f4-3f77ba4a7154 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:15.460049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-375d1d5a-7869-49e3-95f4-3f77ba4a7154 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:15.460477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-375d1d5a-7869-49e3-95f4-3f77ba4a7154 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:15.482122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ca2228d-c53b-4431-916b-de52ab0ca1f0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042857 Apr 11 19:56:15.482693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 692/1439] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:15.489701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-375d1d5a-7869-49e3-95f4-3f77ba4a7154 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042321 Apr 11 19:56:15.490272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 748/1440] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:15.685276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-36c98a05-b499-421d-b40a-8f451d412953 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:15.686235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-36c98a05-b499-421d-b40a-8f451d412953 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:15.693119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36c98a05-b499-421d-b40a-8f451d412953 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:15.693625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36c98a05-b499-421d-b40a-8f451d412953 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:15.694320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36c98a05-b499-421d-b40a-8f451d412953 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:15.694742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36c98a05-b499-421d-b40a-8f451d412953 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:15.724016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-36c98a05-b499-421d-b40a-8f451d412953 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Apr 11 19:56:15.724580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 693/1441] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:16.396419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e78e0ab4-0097-4bf9-bb60-b3b49a5757a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:16.396935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e78e0ab4-0097-4bf9-bb60-b3b49a5757a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:16.403116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e78e0ab4-0097-4bf9-bb60-b3b49a5757a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:16.403559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e78e0ab4-0097-4bf9-bb60-b3b49a5757a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:16.404311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e78e0ab4-0097-4bf9-bb60-b3b49a5757a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:16.404730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e78e0ab4-0097-4bf9-bb60-b3b49a5757a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:16.463888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e78e0ab4-0097-4bf9-bb60-b3b49a5757a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:16.471449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e78e0ab4-0097-4bf9-bb60-b3b49a5757a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.079132 Apr 11 19:56:16.472604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 749/1442] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:16 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:16.494207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-12a1bedd-8847-4eaf-9af1-ad98fb906c53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:16.495121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-12a1bedd-8847-4eaf-9af1-ad98fb906c53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:16.501617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ecb29f4-ad2a-418e-96ab-d7b92160967f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:16.502297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12a1bedd-8847-4eaf-9af1-ad98fb906c53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:16.502541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ecb29f4-ad2a-418e-96ab-d7b92160967f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:16.502698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12a1bedd-8847-4eaf-9af1-ad98fb906c53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:16.503474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12a1bedd-8847-4eaf-9af1-ad98fb906c53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:16.503910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12a1bedd-8847-4eaf-9af1-ad98fb906c53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:16.508354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ecb29f4-ad2a-418e-96ab-d7b92160967f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:16.508788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ecb29f4-ad2a-418e-96ab-d7b92160967f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:16.509568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ecb29f4-ad2a-418e-96ab-d7b92160967f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:16.509970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ecb29f4-ad2a-418e-96ab-d7b92160967f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:16.533722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-12a1bedd-8847-4eaf-9af1-ad98fb906c53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Apr 11 19:56:16.534590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 694/1443] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:16.538082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ecb29f4-ad2a-418e-96ab-d7b92160967f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040569 Apr 11 19:56:16.538633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 750/1444] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:56:16.740277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1032dbe-0cf8-41d0-b29c-599d0a889d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:16.741607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1032dbe-0cf8-41d0-b29c-599d0a889d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:16.750100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1032dbe-0cf8-41d0-b29c-599d0a889d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:16.750695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1032dbe-0cf8-41d0-b29c-599d0a889d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:16.751551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1032dbe-0cf8-41d0-b29c-599d0a889d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:16.751975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1032dbe-0cf8-41d0-b29c-599d0a889d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:16.783963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1032dbe-0cf8-41d0-b29c-599d0a889d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049897 Apr 11 19:56:16.784518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 695/1445] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:17.490515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-093e6d89-b97e-4733-9be0-04958787a468 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:17.491313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-093e6d89-b97e-4733-9be0-04958787a468 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:17.501440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-093e6d89-b97e-4733-9be0-04958787a468 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:17.502119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-093e6d89-b97e-4733-9be0-04958787a468 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:17.503262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-093e6d89-b97e-4733-9be0-04958787a468 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:17.503926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-093e6d89-b97e-4733-9be0-04958787a468 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:17.548626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e51db485-aba7-4ef0-b537-36f39d6a763a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:17.549663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e51db485-aba7-4ef0-b537-36f39d6a763a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:17.556883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e51db485-aba7-4ef0-b537-36f39d6a763a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:17.557416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e51db485-aba7-4ef0-b537-36f39d6a763a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:17.558269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e51db485-aba7-4ef0-b537-36f39d6a763a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:17.558783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e51db485-aba7-4ef0-b537-36f39d6a763a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:17.576258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-093e6d89-b97e-4733-9be0-04958787a468 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:17.583752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-093e6d89-b97e-4733-9be0-04958787a468 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098252 Apr 11 19:56:17.584353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 751/1446] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:17 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:17.589587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-675b5416-2096-44e2-bbae-84d5d9d94d31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:17.590479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-675b5416-2096-44e2-bbae-84d5d9d94d31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:17.594027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e51db485-aba7-4ef0-b537-36f39d6a763a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049957 Apr 11 19:56:17.594771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 696/1447] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:17.596543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-675b5416-2096-44e2-bbae-84d5d9d94d31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:17.597159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-675b5416-2096-44e2-bbae-84d5d9d94d31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:17.597939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-675b5416-2096-44e2-bbae-84d5d9d94d31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:17.598371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-675b5416-2096-44e2-bbae-84d5d9d94d31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:17.627541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-675b5416-2096-44e2-bbae-84d5d9d94d31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042212 Apr 11 19:56:17.628133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 752/1448] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:17.798123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-18a5036a-1d99-4b71-bfb2-3066b354094c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:17.799544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-18a5036a-1d99-4b71-bfb2-3066b354094c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:17.808845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18a5036a-1d99-4b71-bfb2-3066b354094c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:17.809484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18a5036a-1d99-4b71-bfb2-3066b354094c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:17.810485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18a5036a-1d99-4b71-bfb2-3066b354094c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:17.811214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18a5036a-1d99-4b71-bfb2-3066b354094c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:17.842700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-18a5036a-1d99-4b71-bfb2-3066b354094c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050106 Apr 11 19:56:17.843258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 697/1449] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:18.605282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-20f14a90-ee12-42ed-9f50-6b5f04e44557 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:18.605938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-850d0cec-7caf-48d3-ab40-3d0427bd9707 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:18.606323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-20f14a90-ee12-42ed-9f50-6b5f04e44557 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:18.606574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-850d0cec-7caf-48d3-ab40-3d0427bd9707 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:18.612483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20f14a90-ee12-42ed-9f50-6b5f04e44557 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:18.612941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20f14a90-ee12-42ed-9f50-6b5f04e44557 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:18.613113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-850d0cec-7caf-48d3-ab40-3d0427bd9707 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:18.613592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-850d0cec-7caf-48d3-ab40-3d0427bd9707 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:18.613800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20f14a90-ee12-42ed-9f50-6b5f04e44557 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:18.614167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20f14a90-ee12-42ed-9f50-6b5f04e44557 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:18.614510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-850d0cec-7caf-48d3-ab40-3d0427bd9707 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:18.614976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-850d0cec-7caf-48d3-ab40-3d0427bd9707 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:18.647935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-850d0cec-7caf-48d3-ab40-3d0427bd9707 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045929 Apr 11 19:56:18.648530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 698/1450] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:18.653334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b9a7a5b8-7bfd-41a0-bf97-0a77ec6769cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:18.654262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b9a7a5b8-7bfd-41a0-bf97-0a77ec6769cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:18.661118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9a7a5b8-7bfd-41a0-bf97-0a77ec6769cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:18.661559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9a7a5b8-7bfd-41a0-bf97-0a77ec6769cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:18.662327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9a7a5b8-7bfd-41a0-bf97-0a77ec6769cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:18.662750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9a7a5b8-7bfd-41a0-bf97-0a77ec6769cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:18.678900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20f14a90-ee12-42ed-9f50-6b5f04e44557 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:18.687429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-20f14a90-ee12-42ed-9f50-6b5f04e44557 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086057 Apr 11 19:56:18.687997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 753/1451] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:18 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:18.704525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9a7a5b8-7bfd-41a0-bf97-0a77ec6769cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054913 Apr 11 19:56:18.705110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 699/1452] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:18.856048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-12e61ea0-54eb-4d74-ba7b-adef99793bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:18.856890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-12e61ea0-54eb-4d74-ba7b-adef99793bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:18.863436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12e61ea0-54eb-4d74-ba7b-adef99793bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:18.863857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12e61ea0-54eb-4d74-ba7b-adef99793bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:18.864610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12e61ea0-54eb-4d74-ba7b-adef99793bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:18.865074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12e61ea0-54eb-4d74-ba7b-adef99793bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:18.898813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-12e61ea0-54eb-4d74-ba7b-adef99793bda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Apr 11 19:56:18.899359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 754/1453] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:19.659028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-861b0c7a-2cce-4091-bcb7-18d3e9ef0187 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:19.659861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-861b0c7a-2cce-4091-bcb7-18d3e9ef0187 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:19.669473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-861b0c7a-2cce-4091-bcb7-18d3e9ef0187 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:19.670135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-861b0c7a-2cce-4091-bcb7-18d3e9ef0187 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:19.671296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-861b0c7a-2cce-4091-bcb7-18d3e9ef0187 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:19.671944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-861b0c7a-2cce-4091-bcb7-18d3e9ef0187 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:19.705048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09580f8b-d7f2-4adb-ad7c-99437e81be82 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:19.705708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09580f8b-d7f2-4adb-ad7c-99437e81be82 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:19.712631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09580f8b-d7f2-4adb-ad7c-99437e81be82 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:19.713447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09580f8b-d7f2-4adb-ad7c-99437e81be82 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:19.714372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09580f8b-d7f2-4adb-ad7c-99437e81be82 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:19.715035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09580f8b-d7f2-4adb-ad7c-99437e81be82 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:19.717074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-861b0c7a-2cce-4091-bcb7-18d3e9ef0187 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061901 Apr 11 19:56:19.718138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 700/1454] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:19.723513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f69ddcc6-639c-4077-8382-a272263592a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:19.724508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f69ddcc6-639c-4077-8382-a272263592a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:19.730481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f69ddcc6-639c-4077-8382-a272263592a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:19.730923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f69ddcc6-639c-4077-8382-a272263592a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:19.731681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f69ddcc6-639c-4077-8382-a272263592a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:19.732794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f69ddcc6-639c-4077-8382-a272263592a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:19.777472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f69ddcc6-639c-4077-8382-a272263592a9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057877 Apr 11 19:56:19.778593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 701/1455] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:19.780644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09580f8b-d7f2-4adb-ad7c-99437e81be82 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:19.788203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09580f8b-d7f2-4adb-ad7c-99437e81be82 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087154 Apr 11 19:56:19.788767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 755/1456] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:19 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:56:19.911420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d8dd018-eb90-4d65-905f-04c6c10b4736 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:19.912319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d8dd018-eb90-4d65-905f-04c6c10b4736 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:19.918723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d8dd018-eb90-4d65-905f-04c6c10b4736 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:19.919246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d8dd018-eb90-4d65-905f-04c6c10b4736 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:19.920186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d8dd018-eb90-4d65-905f-04c6c10b4736 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:19.920675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d8dd018-eb90-4d65-905f-04c6c10b4736 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:19.949131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d8dd018-eb90-4d65-905f-04c6c10b4736 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042200 Apr 11 19:56:19.949694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 702/1457] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:56:20.730643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bde69f45-2676-453d-811c-8e1a04da43c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:20.731505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bde69f45-2676-453d-811c-8e1a04da43c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:20.738200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bde69f45-2676-453d-811c-8e1a04da43c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:20.738649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bde69f45-2676-453d-811c-8e1a04da43c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:20.739416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bde69f45-2676-453d-811c-8e1a04da43c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:20.739847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bde69f45-2676-453d-811c-8e1a04da43c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:20.769705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bde69f45-2676-453d-811c-8e1a04da43c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043115 Apr 11 19:56:20.770494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 756/1458] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:20.789991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c8380830-df44-47ec-88b5-c713009dce6e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:20.790937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c8380830-df44-47ec-88b5-c713009dce6e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:20.797650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8380830-df44-47ec-88b5-c713009dce6e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:20.798073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8380830-df44-47ec-88b5-c713009dce6e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:20.798858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8380830-df44-47ec-88b5-c713009dce6e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:20.799396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8380830-df44-47ec-88b5-c713009dce6e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:20.806354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75db64c4-145e-4f3b-a24d-02e047c7e7ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:20.807383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75db64c4-145e-4f3b-a24d-02e047c7e7ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:20.816858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75db64c4-145e-4f3b-a24d-02e047c7e7ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:20.817625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75db64c4-145e-4f3b-a24d-02e047c7e7ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:20.818875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75db64c4-145e-4f3b-a24d-02e047c7e7ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:20.819598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75db64c4-145e-4f3b-a24d-02e047c7e7ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:20.843831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c8380830-df44-47ec-88b5-c713009dce6e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057603 Apr 11 19:56:20.844766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 703/1459] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:20.892657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-75db64c4-145e-4f3b-a24d-02e047c7e7ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:20.904020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75db64c4-145e-4f3b-a24d-02e047c7e7ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.102403 Apr 11 19:56:20.904967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 757/1460] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:20 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:20.961802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-de487859-b36a-4ee6-ac80-d98d1a9624f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:20.962770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-de487859-b36a-4ee6-ac80-d98d1a9624f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:20.969866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de487859-b36a-4ee6-ac80-d98d1a9624f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:20.970727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de487859-b36a-4ee6-ac80-d98d1a9624f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:20.971731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de487859-b36a-4ee6-ac80-d98d1a9624f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:20.972272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de487859-b36a-4ee6-ac80-d98d1a9624f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:21.004838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-de487859-b36a-4ee6-ac80-d98d1a9624f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Apr 11 19:56:21.005471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 704/1461] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:21.781958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ccf45eaf-c1b8-43c1-8258-943646d42621 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:21.782913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ccf45eaf-c1b8-43c1-8258-943646d42621 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:21.789949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccf45eaf-c1b8-43c1-8258-943646d42621 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:21.790400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccf45eaf-c1b8-43c1-8258-943646d42621 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:21.791158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccf45eaf-c1b8-43c1-8258-943646d42621 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:21.791614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccf45eaf-c1b8-43c1-8258-943646d42621 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:21.821606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ccf45eaf-c1b8-43c1-8258-943646d42621 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Apr 11 19:56:21.822147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 758/1462] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:21.856388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6e322bc-bc10-4acf-a682-bcb2316047d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:21.857343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6e322bc-bc10-4acf-a682-bcb2316047d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:21.864066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6e322bc-bc10-4acf-a682-bcb2316047d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:21.864516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6e322bc-bc10-4acf-a682-bcb2316047d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:21.865312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6e322bc-bc10-4acf-a682-bcb2316047d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:21.865746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6e322bc-bc10-4acf-a682-bcb2316047d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:21.894358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6e322bc-bc10-4acf-a682-bcb2316047d9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042006 Apr 11 19:56:21.894952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 705/1463] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:21.921347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1545a35f-be03-46b5-8863-e73ca7d9f0d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:21.921949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1545a35f-be03-46b5-8863-e73ca7d9f0d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:21.928094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1545a35f-be03-46b5-8863-e73ca7d9f0d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:21.928562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1545a35f-be03-46b5-8863-e73ca7d9f0d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:21.929319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1545a35f-be03-46b5-8863-e73ca7d9f0d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:21.929765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1545a35f-be03-46b5-8863-e73ca7d9f0d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:21.988592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1545a35f-be03-46b5-8863-e73ca7d9f0d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:21.996536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1545a35f-be03-46b5-8863-e73ca7d9f0d7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.079007 Apr 11 19:56:21.997139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 759/1464] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:21 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:22.015980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4db0c64b-6c79-4d69-b214-c897f78fd6ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:22.016947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4db0c64b-6c79-4d69-b214-c897f78fd6ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:22.023371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4db0c64b-6c79-4d69-b214-c897f78fd6ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:22.023839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4db0c64b-6c79-4d69-b214-c897f78fd6ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:22.024596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4db0c64b-6c79-4d69-b214-c897f78fd6ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:22.025055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4db0c64b-6c79-4d69-b214-c897f78fd6ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:22.054171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4db0c64b-6c79-4d69-b214-c897f78fd6ce tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042133 Apr 11 19:56:22.054644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 706/1465] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:22.833898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6fb8695c-ce0a-419f-8455-f3849ea53ebb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:22.834720 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6fb8695c-ce0a-419f-8455-f3849ea53ebb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:22.841227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fb8695c-ce0a-419f-8455-f3849ea53ebb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:22.841670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fb8695c-ce0a-419f-8455-f3849ea53ebb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:22.842421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fb8695c-ce0a-419f-8455-f3849ea53ebb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:22.842846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fb8695c-ce0a-419f-8455-f3849ea53ebb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:22.871706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6fb8695c-ce0a-419f-8455-f3849ea53ebb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041942 Apr 11 19:56:22.872259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 760/1466] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:22.905846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a73ef4d9-606a-4732-8acc-9c085600bee3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:22.906766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a73ef4d9-606a-4732-8acc-9c085600bee3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:22.913356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a73ef4d9-606a-4732-8acc-9c085600bee3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:22.913806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a73ef4d9-606a-4732-8acc-9c085600bee3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:22.914568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a73ef4d9-606a-4732-8acc-9c085600bee3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:22.914999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a73ef4d9-606a-4732-8acc-9c085600bee3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:22.944112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a73ef4d9-606a-4732-8acc-9c085600bee3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042186 Apr 11 19:56:22.944651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 707/1467] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:23.014230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-827e436b-e5b7-4830-b61b-252a23ba98c7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:23.014839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-827e436b-e5b7-4830-b61b-252a23ba98c7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:23.021270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827e436b-e5b7-4830-b61b-252a23ba98c7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:23.021719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827e436b-e5b7-4830-b61b-252a23ba98c7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:23.022477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827e436b-e5b7-4830-b61b-252a23ba98c7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:23.022902 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827e436b-e5b7-4830-b61b-252a23ba98c7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:23.066809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1546d1d-587d-4308-b5d8-75972ce72fdb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:23.067763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f1546d1d-587d-4308-b5d8-75972ce72fdb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:23.074492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1546d1d-587d-4308-b5d8-75972ce72fdb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:23.074942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1546d1d-587d-4308-b5d8-75972ce72fdb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:23.075848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1546d1d-587d-4308-b5d8-75972ce72fdb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:23.076280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1546d1d-587d-4308-b5d8-75972ce72fdb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:23.087015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-827e436b-e5b7-4830-b61b-252a23ba98c7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:23.096695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-827e436b-e5b7-4830-b61b-252a23ba98c7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086319 Apr 11 19:56:23.097766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 761/1468] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:23 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:23.106470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f1546d1d-587d-4308-b5d8-75972ce72fdb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043755 Apr 11 19:56:23.107036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 708/1469] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:23.465487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:56:23.465718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 19:56:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 19:56:23.884437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-88410ef8-d44b-4f01-b636-c234686648d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:23.885420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-88410ef8-d44b-4f01-b636-c234686648d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:23.892261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88410ef8-d44b-4f01-b636-c234686648d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:23.892714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88410ef8-d44b-4f01-b636-c234686648d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:23.893516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88410ef8-d44b-4f01-b636-c234686648d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:23.893955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88410ef8-d44b-4f01-b636-c234686648d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:23.923606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-88410ef8-d44b-4f01-b636-c234686648d3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043451 Apr 11 19:56:23.924138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 762/1470] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:23.956032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f635bd96-e177-4a52-b530-335c29bb4ab9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:23.957042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f635bd96-e177-4a52-b530-335c29bb4ab9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:23.963808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f635bd96-e177-4a52-b530-335c29bb4ab9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:23.964237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f635bd96-e177-4a52-b530-335c29bb4ab9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:23.965063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f635bd96-e177-4a52-b530-335c29bb4ab9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:23.965500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f635bd96-e177-4a52-b530-335c29bb4ab9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:23.995667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f635bd96-e177-4a52-b530-335c29bb4ab9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043733 Apr 11 19:56:23.996227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 709/1471] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:24.114056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e53443fe-88dd-46a8-968b-8638a053263f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:24.114695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e53443fe-88dd-46a8-968b-8638a053263f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:24.119482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4f184b4d-6e83-4a1c-a28a-3b7c1f8c7923 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:24.120507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4f184b4d-6e83-4a1c-a28a-3b7c1f8c7923 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:24.120920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e53443fe-88dd-46a8-968b-8638a053263f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:24.121368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e53443fe-88dd-46a8-968b-8638a053263f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:24.122138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e53443fe-88dd-46a8-968b-8638a053263f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:24.122569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e53443fe-88dd-46a8-968b-8638a053263f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:24.128158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f184b4d-6e83-4a1c-a28a-3b7c1f8c7923 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:24.128798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f184b4d-6e83-4a1c-a28a-3b7c1f8c7923 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:24.129682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f184b4d-6e83-4a1c-a28a-3b7c1f8c7923 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:24.130177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f184b4d-6e83-4a1c-a28a-3b7c1f8c7923 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:24.159347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4f184b4d-6e83-4a1c-a28a-3b7c1f8c7923 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Apr 11 19:56:24.159818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 710/1472] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:56:24.185081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e53443fe-88dd-46a8-968b-8638a053263f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:24.194467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e53443fe-88dd-46a8-968b-8638a053263f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084290 Apr 11 19:56:24.195041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 763/1473] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:24 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:24.935773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-650286bc-1737-47ac-96e1-f0337ca3107d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:24.936690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-650286bc-1737-47ac-96e1-f0337ca3107d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:24.943262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650286bc-1737-47ac-96e1-f0337ca3107d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:24.943713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650286bc-1737-47ac-96e1-f0337ca3107d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:24.944483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650286bc-1737-47ac-96e1-f0337ca3107d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:24.944934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650286bc-1737-47ac-96e1-f0337ca3107d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:24.974916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-650286bc-1737-47ac-96e1-f0337ca3107d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Apr 11 19:56:24.975612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 711/1474] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:25.007881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c425cc2f-e887-4845-92e6-2c567444c3a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:25.008827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c425cc2f-e887-4845-92e6-2c567444c3a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:25.015562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c425cc2f-e887-4845-92e6-2c567444c3a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:25.016012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c425cc2f-e887-4845-92e6-2c567444c3a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:25.016812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c425cc2f-e887-4845-92e6-2c567444c3a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:25.017267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c425cc2f-e887-4845-92e6-2c567444c3a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:25.047244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c425cc2f-e887-4845-92e6-2c567444c3a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043358 Apr 11 19:56:25.047810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 764/1475] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:25.171538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f3f3787-e83d-418d-92ab-f6ca1f02cac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:25.172471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f3f3787-e83d-418d-92ab-f6ca1f02cac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:25.179120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f3f3787-e83d-418d-92ab-f6ca1f02cac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:25.179567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f3f3787-e83d-418d-92ab-f6ca1f02cac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:25.180335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f3f3787-e83d-418d-92ab-f6ca1f02cac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:25.180767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f3f3787-e83d-418d-92ab-f6ca1f02cac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:25.211582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f3f3787-e83d-418d-92ab-f6ca1f02cac9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043834 Apr 11 19:56:25.211885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-37fed1f9-b800-44c2-a91b-4d4c4f4da549 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:25.212056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-37fed1f9-b800-44c2-a91b-4d4c4f4da549 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:25.212196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 712/1476] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:25.218516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37fed1f9-b800-44c2-a91b-4d4c4f4da549 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:25.218971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37fed1f9-b800-44c2-a91b-4d4c4f4da549 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:25.219748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37fed1f9-b800-44c2-a91b-4d4c4f4da549 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:25.220178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37fed1f9-b800-44c2-a91b-4d4c4f4da549 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:25.280695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37fed1f9-b800-44c2-a91b-4d4c4f4da549 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:25.288604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-37fed1f9-b800-44c2-a91b-4d4c4f4da549 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081057 Apr 11 19:56:25.289177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 765/1477] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:25 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:25.987017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-251d2c6d-5c72-4676-898b-aa333b6171ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:25.987946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-251d2c6d-5c72-4676-898b-aa333b6171ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:25.994607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-251d2c6d-5c72-4676-898b-aa333b6171ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:25.995054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-251d2c6d-5c72-4676-898b-aa333b6171ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:25.995816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-251d2c6d-5c72-4676-898b-aa333b6171ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:25.996252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-251d2c6d-5c72-4676-898b-aa333b6171ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:26.028285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-251d2c6d-5c72-4676-898b-aa333b6171ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045268 Apr 11 19:56:26.028852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 713/1478] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:26.059995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44004fc0-7c73-49ee-b228-480772f04244 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:26.060935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44004fc0-7c73-49ee-b228-480772f04244 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:26.067767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44004fc0-7c73-49ee-b228-480772f04244 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:26.068222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44004fc0-7c73-49ee-b228-480772f04244 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:26.069025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44004fc0-7c73-49ee-b228-480772f04244 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:26.069461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44004fc0-7c73-49ee-b228-480772f04244 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:26.099332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44004fc0-7c73-49ee-b228-480772f04244 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043471 Apr 11 19:56:26.099892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 766/1479] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:26.223686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf33cb98-5418-4929-8e5f-e946d02a0e46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:26.224542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf33cb98-5418-4929-8e5f-e946d02a0e46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:26.231148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf33cb98-5418-4929-8e5f-e946d02a0e46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:26.231602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf33cb98-5418-4929-8e5f-e946d02a0e46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:26.232408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf33cb98-5418-4929-8e5f-e946d02a0e46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:26.232844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf33cb98-5418-4929-8e5f-e946d02a0e46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:26.262485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf33cb98-5418-4929-8e5f-e946d02a0e46 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Apr 11 19:56:26.263053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 714/1480] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:26.305433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d236ded0-0501-460b-b009-cd2a14cfe9d1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:26.306042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d236ded0-0501-460b-b009-cd2a14cfe9d1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:26.312227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d236ded0-0501-460b-b009-cd2a14cfe9d1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:26.312679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d236ded0-0501-460b-b009-cd2a14cfe9d1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:26.313474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d236ded0-0501-460b-b009-cd2a14cfe9d1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:26.313905 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d236ded0-0501-460b-b009-cd2a14cfe9d1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:26.374120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d236ded0-0501-460b-b009-cd2a14cfe9d1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:26.382158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d236ded0-0501-460b-b009-cd2a14cfe9d1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080560 Apr 11 19:56:26.382713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 767/1481] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:26 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:27.042544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a2d7d1c-d2da-4003-b6f7-6caede80623e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:27.043783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a2d7d1c-d2da-4003-b6f7-6caede80623e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:27.050960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a2d7d1c-d2da-4003-b6f7-6caede80623e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:27.051395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a2d7d1c-d2da-4003-b6f7-6caede80623e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:27.052175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a2d7d1c-d2da-4003-b6f7-6caede80623e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:27.052608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a2d7d1c-d2da-4003-b6f7-6caede80623e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:27.086294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a2d7d1c-d2da-4003-b6f7-6caede80623e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049952 Apr 11 19:56:27.086859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 715/1482] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:27.111449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-607bd9f0-9172-4798-9ebe-de5e4c521fca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:27.112439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-607bd9f0-9172-4798-9ebe-de5e4c521fca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:27.119076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-607bd9f0-9172-4798-9ebe-de5e4c521fca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:27.119542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-607bd9f0-9172-4798-9ebe-de5e4c521fca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:27.120300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-607bd9f0-9172-4798-9ebe-de5e4c521fca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:27.121175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-607bd9f0-9172-4798-9ebe-de5e4c521fca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:27.150324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-607bd9f0-9172-4798-9ebe-de5e4c521fca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043001 Apr 11 19:56:27.150875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 768/1483] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:27.274951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-339459aa-c198-4417-bfc1-bab01e5fb81c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:27.275787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-339459aa-c198-4417-bfc1-bab01e5fb81c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:27.282325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-339459aa-c198-4417-bfc1-bab01e5fb81c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:27.282774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-339459aa-c198-4417-bfc1-bab01e5fb81c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:27.283534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-339459aa-c198-4417-bfc1-bab01e5fb81c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:27.283976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-339459aa-c198-4417-bfc1-bab01e5fb81c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:27.313090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-339459aa-c198-4417-bfc1-bab01e5fb81c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042170 Apr 11 19:56:27.313654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 716/1484] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:27.399159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2b15fdd-3f2d-4899-a94a-932d498afd42 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:27.399795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2b15fdd-3f2d-4899-a94a-932d498afd42 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:27.406195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2b15fdd-3f2d-4899-a94a-932d498afd42 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:27.406643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2b15fdd-3f2d-4899-a94a-932d498afd42 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:27.407395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2b15fdd-3f2d-4899-a94a-932d498afd42 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:27.407826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2b15fdd-3f2d-4899-a94a-932d498afd42 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:27.472416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c2b15fdd-3f2d-4899-a94a-932d498afd42 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:27.480127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2b15fdd-3f2d-4899-a94a-932d498afd42 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084968 Apr 11 19:56:27.480738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 769/1485] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:27 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:28.098734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0404c771-5f38-4934-a9ff-15fbc0910847 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:28.099678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0404c771-5f38-4934-a9ff-15fbc0910847 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:28.107457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0404c771-5f38-4934-a9ff-15fbc0910847 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:28.107995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0404c771-5f38-4934-a9ff-15fbc0910847 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:28.108771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0404c771-5f38-4934-a9ff-15fbc0910847 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:28.109241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0404c771-5f38-4934-a9ff-15fbc0910847 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:28.142249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0404c771-5f38-4934-a9ff-15fbc0910847 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047602 Apr 11 19:56:28.142810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 717/1486] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:28.164488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-908531a7-61bd-4b1b-bbb8-5519a734001e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:28.165527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-908531a7-61bd-4b1b-bbb8-5519a734001e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:28.172349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-908531a7-61bd-4b1b-bbb8-5519a734001e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:28.172791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-908531a7-61bd-4b1b-bbb8-5519a734001e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:28.173599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-908531a7-61bd-4b1b-bbb8-5519a734001e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:28.174029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-908531a7-61bd-4b1b-bbb8-5519a734001e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:28.205968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-908531a7-61bd-4b1b-bbb8-5519a734001e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045501 Apr 11 19:56:28.206558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 770/1487] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:28.325465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5e0a7cef-3a3e-4d0b-8ddb-6ad247f48c47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:28.326423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5e0a7cef-3a3e-4d0b-8ddb-6ad247f48c47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:28.332933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e0a7cef-3a3e-4d0b-8ddb-6ad247f48c47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:28.333396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e0a7cef-3a3e-4d0b-8ddb-6ad247f48c47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:28.334159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e0a7cef-3a3e-4d0b-8ddb-6ad247f48c47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:28.334588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e0a7cef-3a3e-4d0b-8ddb-6ad247f48c47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:28.363601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5e0a7cef-3a3e-4d0b-8ddb-6ad247f48c47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Apr 11 19:56:28.364154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 718/1488] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:28.497542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-349940be-8b9c-44ba-8431-f912cb909ad1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:28.498147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-349940be-8b9c-44ba-8431-f912cb909ad1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:28.505182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-349940be-8b9c-44ba-8431-f912cb909ad1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:28.505602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-349940be-8b9c-44ba-8431-f912cb909ad1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:28.506384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-349940be-8b9c-44ba-8431-f912cb909ad1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:28.506845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-349940be-8b9c-44ba-8431-f912cb909ad1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:28.568244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-349940be-8b9c-44ba-8431-f912cb909ad1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:28.576007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-349940be-8b9c-44ba-8431-f912cb909ad1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082422 Apr 11 19:56:28.576575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 771/1489] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:28 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:29.154849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ff4c77a3-b1f9-42c9-a6b4-396880bf25f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:29.155678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ff4c77a3-b1f9-42c9-a6b4-396880bf25f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:29.162497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff4c77a3-b1f9-42c9-a6b4-396880bf25f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:29.162943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff4c77a3-b1f9-42c9-a6b4-396880bf25f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:29.163704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff4c77a3-b1f9-42c9-a6b4-396880bf25f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:29.164135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff4c77a3-b1f9-42c9-a6b4-396880bf25f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:29.195516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ff4c77a3-b1f9-42c9-a6b4-396880bf25f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Apr 11 19:56:29.196103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 719/1490] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:29.218169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9345bf4-1271-46b0-a154-174623705c6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:29.219248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9345bf4-1271-46b0-a154-174623705c6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:29.226368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9345bf4-1271-46b0-a154-174623705c6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:29.226887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9345bf4-1271-46b0-a154-174623705c6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:29.227703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9345bf4-1271-46b0-a154-174623705c6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:29.228179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9345bf4-1271-46b0-a154-174623705c6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:29.257945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9345bf4-1271-46b0-a154-174623705c6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043851 Apr 11 19:56:29.258480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 772/1491] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:29.376357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-068e41a4-0c58-41ae-9132-3cee3bf55fdd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:29.377324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-068e41a4-0c58-41ae-9132-3cee3bf55fdd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:29.383878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-068e41a4-0c58-41ae-9132-3cee3bf55fdd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:29.384317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-068e41a4-0c58-41ae-9132-3cee3bf55fdd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:29.385128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-068e41a4-0c58-41ae-9132-3cee3bf55fdd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:29.385588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-068e41a4-0c58-41ae-9132-3cee3bf55fdd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:29.415261 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-068e41a4-0c58-41ae-9132-3cee3bf55fdd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043293 Apr 11 19:56:29.415744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 720/1492] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:29.593463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1a3d922d-9c39-40cf-ad7a-4009f881a54f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:29.594071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1a3d922d-9c39-40cf-ad7a-4009f881a54f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:29.600626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a3d922d-9c39-40cf-ad7a-4009f881a54f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:29.601101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a3d922d-9c39-40cf-ad7a-4009f881a54f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:29.601862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a3d922d-9c39-40cf-ad7a-4009f881a54f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:29.602288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a3d922d-9c39-40cf-ad7a-4009f881a54f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:29.663322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1a3d922d-9c39-40cf-ad7a-4009f881a54f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:29.671014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1a3d922d-9c39-40cf-ad7a-4009f881a54f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081353 Apr 11 19:56:29.671503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 773/1493] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:29 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:30.207493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-14a98b4b-9a06-4ee0-8047-7e5c18fc719d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:30.208418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-14a98b4b-9a06-4ee0-8047-7e5c18fc719d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:30.215413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14a98b4b-9a06-4ee0-8047-7e5c18fc719d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:30.215856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14a98b4b-9a06-4ee0-8047-7e5c18fc719d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:30.216596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14a98b4b-9a06-4ee0-8047-7e5c18fc719d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:30.217058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14a98b4b-9a06-4ee0-8047-7e5c18fc719d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:30.245461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-14a98b4b-9a06-4ee0-8047-7e5c18fc719d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041995 Apr 11 19:56:30.246016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 721/1494] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:30.270205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9820b798-8c1a-40e0-967a-c00bb6840ef7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:30.271114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9820b798-8c1a-40e0-967a-c00bb6840ef7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:30.277827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9820b798-8c1a-40e0-967a-c00bb6840ef7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:30.278273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9820b798-8c1a-40e0-967a-c00bb6840ef7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:30.279022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9820b798-8c1a-40e0-967a-c00bb6840ef7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:30.279448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9820b798-8c1a-40e0-967a-c00bb6840ef7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:30.310109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9820b798-8c1a-40e0-967a-c00bb6840ef7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043972 Apr 11 19:56:30.310647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 774/1495] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:30.427428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94f4337b-baf6-4d48-8972-8401b1ab6948 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:30.428376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94f4337b-baf6-4d48-8972-8401b1ab6948 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:30.434779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94f4337b-baf6-4d48-8972-8401b1ab6948 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:30.435224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94f4337b-baf6-4d48-8972-8401b1ab6948 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:30.435996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94f4337b-baf6-4d48-8972-8401b1ab6948 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:30.436447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94f4337b-baf6-4d48-8972-8401b1ab6948 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:30.465318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94f4337b-baf6-4d48-8972-8401b1ab6948 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041770 Apr 11 19:56:30.465776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 722/1496] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:30.687864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d8ce3acd-b7a4-4ebd-abd7-e07f83222686 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:30.688479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d8ce3acd-b7a4-4ebd-abd7-e07f83222686 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:30.694881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d8ce3acd-b7a4-4ebd-abd7-e07f83222686 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:30.695328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d8ce3acd-b7a4-4ebd-abd7-e07f83222686 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:30.696091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d8ce3acd-b7a4-4ebd-abd7-e07f83222686 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:30.696522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d8ce3acd-b7a4-4ebd-abd7-e07f83222686 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:30.758457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d8ce3acd-b7a4-4ebd-abd7-e07f83222686 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:30.773040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d8ce3acd-b7a4-4ebd-abd7-e07f83222686 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088960 Apr 11 19:56:30.773658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 775/1497] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:30 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:31.257840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4c7034a-3f68-4f1f-893e-913892c0f9e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:31.258869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4c7034a-3f68-4f1f-893e-913892c0f9e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:31.265797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4c7034a-3f68-4f1f-893e-913892c0f9e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:31.266240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4c7034a-3f68-4f1f-893e-913892c0f9e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:31.266975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4c7034a-3f68-4f1f-893e-913892c0f9e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:31.267428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4c7034a-3f68-4f1f-893e-913892c0f9e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:31.297464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4c7034a-3f68-4f1f-893e-913892c0f9e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043564 Apr 11 19:56:31.298013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 723/1498] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:31.322084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d305773-7099-4049-b8da-8cb0e4964d52 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:31.323204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d305773-7099-4049-b8da-8cb0e4964d52 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:31.329703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d305773-7099-4049-b8da-8cb0e4964d52 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:31.330151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d305773-7099-4049-b8da-8cb0e4964d52 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:31.330910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d305773-7099-4049-b8da-8cb0e4964d52 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:31.331340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d305773-7099-4049-b8da-8cb0e4964d52 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:31.360239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d305773-7099-4049-b8da-8cb0e4964d52 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042079 Apr 11 19:56:31.360799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 776/1499] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:31.477517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b527859c-a479-4bbc-a7cb-b5df3f61b0b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:31.478348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b527859c-a479-4bbc-a7cb-b5df3f61b0b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:31.484818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b527859c-a479-4bbc-a7cb-b5df3f61b0b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:31.485289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b527859c-a479-4bbc-a7cb-b5df3f61b0b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:31.486040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b527859c-a479-4bbc-a7cb-b5df3f61b0b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:31.486472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b527859c-a479-4bbc-a7cb-b5df3f61b0b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:31.515589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b527859c-a479-4bbc-a7cb-b5df3f61b0b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 Apr 11 19:56:31.516348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 724/1500] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:31.790053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-576c76ef-7c7d-4365-9cdd-8a80aba9b50e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:31.790600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-576c76ef-7c7d-4365-9cdd-8a80aba9b50e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:31.797058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-576c76ef-7c7d-4365-9cdd-8a80aba9b50e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:31.797501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-576c76ef-7c7d-4365-9cdd-8a80aba9b50e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:31.798234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-576c76ef-7c7d-4365-9cdd-8a80aba9b50e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:31.798681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-576c76ef-7c7d-4365-9cdd-8a80aba9b50e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:31.861582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-576c76ef-7c7d-4365-9cdd-8a80aba9b50e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:31.869607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-576c76ef-7c7d-4365-9cdd-8a80aba9b50e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083513 Apr 11 19:56:31.870183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 777/1501] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:31 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:32.309782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-288fcad5-7c45-4dbf-bbc5-a968565013be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:32.310712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-288fcad5-7c45-4dbf-bbc5-a968565013be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:32.317475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-288fcad5-7c45-4dbf-bbc5-a968565013be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:32.317917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-288fcad5-7c45-4dbf-bbc5-a968565013be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:32.318679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-288fcad5-7c45-4dbf-bbc5-a968565013be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:32.319109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-288fcad5-7c45-4dbf-bbc5-a968565013be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:32.348429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-288fcad5-7c45-4dbf-bbc5-a968565013be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 Apr 11 19:56:32.349093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 725/1502] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:32.371913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-00a711ae-80c4-4c7e-9e2f-3b712cb1c881 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:32.372833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-00a711ae-80c4-4c7e-9e2f-3b712cb1c881 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:32.379882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00a711ae-80c4-4c7e-9e2f-3b712cb1c881 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:32.380329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00a711ae-80c4-4c7e-9e2f-3b712cb1c881 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:32.381124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00a711ae-80c4-4c7e-9e2f-3b712cb1c881 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:32.381554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00a711ae-80c4-4c7e-9e2f-3b712cb1c881 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:32.411296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-00a711ae-80c4-4c7e-9e2f-3b712cb1c881 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043371 Apr 11 19:56:32.411863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 778/1503] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:32.528086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ae5fd2e-c1b8-461d-8d03-905c9e924ab4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:32.528929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ae5fd2e-c1b8-461d-8d03-905c9e924ab4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:32.535282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae5fd2e-c1b8-461d-8d03-905c9e924ab4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:32.535715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae5fd2e-c1b8-461d-8d03-905c9e924ab4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:32.536482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae5fd2e-c1b8-461d-8d03-905c9e924ab4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:32.536932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae5fd2e-c1b8-461d-8d03-905c9e924ab4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:32.567872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ae5fd2e-c1b8-461d-8d03-905c9e924ab4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Apr 11 19:56:32.568264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 726/1504] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:32.887491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b444ece6-bfbe-4851-95e9-20d0d9c42ccd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:32.888012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b444ece6-bfbe-4851-95e9-20d0d9c42ccd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:32.894545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b444ece6-bfbe-4851-95e9-20d0d9c42ccd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:32.894996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b444ece6-bfbe-4851-95e9-20d0d9c42ccd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:32.895758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b444ece6-bfbe-4851-95e9-20d0d9c42ccd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:32.896189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b444ece6-bfbe-4851-95e9-20d0d9c42ccd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:32.956285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b444ece6-bfbe-4851-95e9-20d0d9c42ccd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:32.964247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b444ece6-bfbe-4851-95e9-20d0d9c42ccd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080749 Apr 11 19:56:32.964816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 779/1505] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:32 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:33.360638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d38a4709-2a0a-426c-a429-a8923dec2492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:33.361621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d38a4709-2a0a-426c-a429-a8923dec2492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:33.368390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d38a4709-2a0a-426c-a429-a8923dec2492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:33.368837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d38a4709-2a0a-426c-a429-a8923dec2492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:33.369627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d38a4709-2a0a-426c-a429-a8923dec2492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:33.370060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d38a4709-2a0a-426c-a429-a8923dec2492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:33.400028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d38a4709-2a0a-426c-a429-a8923dec2492 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043372 Apr 11 19:56:33.400593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 727/1506] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:33.422896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a8a59ac-5586-4ca8-9d23-1ca0d37de0e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:33.423819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a8a59ac-5586-4ca8-9d23-1ca0d37de0e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:33.430641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a8a59ac-5586-4ca8-9d23-1ca0d37de0e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:33.431086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a8a59ac-5586-4ca8-9d23-1ca0d37de0e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:33.431855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a8a59ac-5586-4ca8-9d23-1ca0d37de0e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:33.432280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a8a59ac-5586-4ca8-9d23-1ca0d37de0e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:33.461679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a8a59ac-5586-4ca8-9d23-1ca0d37de0e0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042652 Apr 11 19:56:33.462151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 780/1507] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:33.579935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d715380-4af6-4edb-ba5d-7d535010ea7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:33.580934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d715380-4af6-4edb-ba5d-7d535010ea7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:33.587396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d715380-4af6-4edb-ba5d-7d535010ea7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:33.587839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d715380-4af6-4edb-ba5d-7d535010ea7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:33.588598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d715380-4af6-4edb-ba5d-7d535010ea7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:33.589051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d715380-4af6-4edb-ba5d-7d535010ea7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:33.626604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d715380-4af6-4edb-ba5d-7d535010ea7c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050577 Apr 11 19:56:33.627177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 728/1508] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:33.981574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7ea2cd41-ddb8-4ac5-ac51-45b0dcf6d0f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:33.982182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7ea2cd41-ddb8-4ac5-ac51-45b0dcf6d0f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:33.988735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ea2cd41-ddb8-4ac5-ac51-45b0dcf6d0f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:33.989214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ea2cd41-ddb8-4ac5-ac51-45b0dcf6d0f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:33.989968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ea2cd41-ddb8-4ac5-ac51-45b0dcf6d0f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:33.990406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ea2cd41-ddb8-4ac5-ac51-45b0dcf6d0f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:34.050514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7ea2cd41-ddb8-4ac5-ac51-45b0dcf6d0f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:34.058640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7ea2cd41-ddb8-4ac5-ac51-45b0dcf6d0f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081034 Apr 11 19:56:34.059210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 781/1509] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:33 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:34.412426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4e872ef6-3856-4957-88ee-2b78d546219c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:34.413317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4e872ef6-3856-4957-88ee-2b78d546219c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:34.419986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e872ef6-3856-4957-88ee-2b78d546219c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:34.420427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e872ef6-3856-4957-88ee-2b78d546219c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:34.421223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e872ef6-3856-4957-88ee-2b78d546219c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:34.421651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e872ef6-3856-4957-88ee-2b78d546219c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:34.451345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4e872ef6-3856-4957-88ee-2b78d546219c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Apr 11 19:56:34.451915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 729/1510] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:34.473595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9b7168fe-9c04-4b84-8a3d-0b4892ab0f29 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:34.474514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9b7168fe-9c04-4b84-8a3d-0b4892ab0f29 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:34.481059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b7168fe-9c04-4b84-8a3d-0b4892ab0f29 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:34.481509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b7168fe-9c04-4b84-8a3d-0b4892ab0f29 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:34.482268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b7168fe-9c04-4b84-8a3d-0b4892ab0f29 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:34.482701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b7168fe-9c04-4b84-8a3d-0b4892ab0f29 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:34.511886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9b7168fe-9c04-4b84-8a3d-0b4892ab0f29 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042274 Apr 11 19:56:34.512412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 782/1511] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:34.638886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dc39ce78-dd93-4128-85cc-191340eafe9d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:34.639913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dc39ce78-dd93-4128-85cc-191340eafe9d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:34.646310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc39ce78-dd93-4128-85cc-191340eafe9d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:34.646753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc39ce78-dd93-4128-85cc-191340eafe9d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:34.647541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc39ce78-dd93-4128-85cc-191340eafe9d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:34.647972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc39ce78-dd93-4128-85cc-191340eafe9d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:34.680325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dc39ce78-dd93-4128-85cc-191340eafe9d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Apr 11 19:56:34.680895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 730/1512] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:35.075615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-55982c21-c064-44aa-8a95-422375bb35a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:35.076123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-55982c21-c064-44aa-8a95-422375bb35a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:35.082757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55982c21-c064-44aa-8a95-422375bb35a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:35.083222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55982c21-c064-44aa-8a95-422375bb35a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:35.083965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55982c21-c064-44aa-8a95-422375bb35a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:35.084396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55982c21-c064-44aa-8a95-422375bb35a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:35.144307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-55982c21-c064-44aa-8a95-422375bb35a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:35.152139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-55982c21-c064-44aa-8a95-422375bb35a6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080557 Apr 11 19:56:35.152671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 783/1513] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:35 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:35.463305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5e87bd6a-5df2-405e-835c-3a725d588a5f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:35.464230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5e87bd6a-5df2-405e-835c-3a725d588a5f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:35.471336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e87bd6a-5df2-405e-835c-3a725d588a5f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:35.471782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e87bd6a-5df2-405e-835c-3a725d588a5f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:35.472555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e87bd6a-5df2-405e-835c-3a725d588a5f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:35.473011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e87bd6a-5df2-405e-835c-3a725d588a5f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:35.504019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5e87bd6a-5df2-405e-835c-3a725d588a5f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Apr 11 19:56:35.504575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 731/1514] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:35.523970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af7184fd-3a0c-4302-bf79-a050b0cbc259 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:35.524884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-af7184fd-3a0c-4302-bf79-a050b0cbc259 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:35.531329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af7184fd-3a0c-4302-bf79-a050b0cbc259 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:35.531771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af7184fd-3a0c-4302-bf79-a050b0cbc259 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:35.532534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af7184fd-3a0c-4302-bf79-a050b0cbc259 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:35.532995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af7184fd-3a0c-4302-bf79-a050b0cbc259 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:35.561341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-af7184fd-3a0c-4302-bf79-a050b0cbc259 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041258 Apr 11 19:56:35.561903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 784/1515] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:35.692458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-238d9bda-7a6e-4b37-8819-b7e55c32aed5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:35.693720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-238d9bda-7a6e-4b37-8819-b7e55c32aed5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:35.700838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-238d9bda-7a6e-4b37-8819-b7e55c32aed5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:35.701457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-238d9bda-7a6e-4b37-8819-b7e55c32aed5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:35.702227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-238d9bda-7a6e-4b37-8819-b7e55c32aed5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:35.702657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-238d9bda-7a6e-4b37-8819-b7e55c32aed5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:35.734509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-238d9bda-7a6e-4b37-8819-b7e55c32aed5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046377 Apr 11 19:56:35.735083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 732/1516] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:36.169729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-adeef2a1-0005-4dd7-8f79-fdeac930ad6f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:36.170249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-adeef2a1-0005-4dd7-8f79-fdeac930ad6f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:36.177820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adeef2a1-0005-4dd7-8f79-fdeac930ad6f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:36.178352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adeef2a1-0005-4dd7-8f79-fdeac930ad6f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:36.179251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adeef2a1-0005-4dd7-8f79-fdeac930ad6f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:36.179675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adeef2a1-0005-4dd7-8f79-fdeac930ad6f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:36.245346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-adeef2a1-0005-4dd7-8f79-fdeac930ad6f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:36.253391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-adeef2a1-0005-4dd7-8f79-fdeac930ad6f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087849 Apr 11 19:56:36.253958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 785/1517] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:36 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:36.516039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df3ab3af-0b1e-4298-8e50-d2cd805e8649 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:36.517071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df3ab3af-0b1e-4298-8e50-d2cd805e8649 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:36.525393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df3ab3af-0b1e-4298-8e50-d2cd805e8649 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:36.525839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df3ab3af-0b1e-4298-8e50-d2cd805e8649 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:36.526605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df3ab3af-0b1e-4298-8e50-d2cd805e8649 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:36.527040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df3ab3af-0b1e-4298-8e50-d2cd805e8649 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:36.556870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df3ab3af-0b1e-4298-8e50-d2cd805e8649 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Apr 11 19:56:36.557457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 733/1518] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:36.573310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0bfe717e-6cf8-48dd-9cec-d0872f689e65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:36.574981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0bfe717e-6cf8-48dd-9cec-d0872f689e65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:36.581775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bfe717e-6cf8-48dd-9cec-d0872f689e65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:36.582214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bfe717e-6cf8-48dd-9cec-d0872f689e65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:36.582969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bfe717e-6cf8-48dd-9cec-d0872f689e65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:36.583395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bfe717e-6cf8-48dd-9cec-d0872f689e65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:36.613865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0bfe717e-6cf8-48dd-9cec-d0872f689e65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044625 Apr 11 19:56:36.614371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 786/1519] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:36.747087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37d4a6e4-786e-4b97-8569-e2bfc96acef4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:36.748014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37d4a6e4-786e-4b97-8569-e2bfc96acef4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:36.755424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37d4a6e4-786e-4b97-8569-e2bfc96acef4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:36.755874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37d4a6e4-786e-4b97-8569-e2bfc96acef4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:36.756641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37d4a6e4-786e-4b97-8569-e2bfc96acef4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:36.757112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37d4a6e4-786e-4b97-8569-e2bfc96acef4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:36.787365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37d4a6e4-786e-4b97-8569-e2bfc96acef4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Apr 11 19:56:36.787850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 734/1520] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:37.271424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5a4ca2e8-ce20-48cd-94b8-da96e56ee971 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:37.272024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5a4ca2e8-ce20-48cd-94b8-da96e56ee971 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:37.278687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a4ca2e8-ce20-48cd-94b8-da96e56ee971 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:37.279235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a4ca2e8-ce20-48cd-94b8-da96e56ee971 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:37.280000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a4ca2e8-ce20-48cd-94b8-da96e56ee971 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:37.280431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a4ca2e8-ce20-48cd-94b8-da96e56ee971 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:37.349141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5a4ca2e8-ce20-48cd-94b8-da96e56ee971 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:37.356704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5a4ca2e8-ce20-48cd-94b8-da96e56ee971 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.089765 Apr 11 19:56:37.357326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 787/1521] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:37 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:37.570401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf0e0eba-5c33-4299-8074-694bf4604429 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:37.571286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cf0e0eba-5c33-4299-8074-694bf4604429 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:37.578543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf0e0eba-5c33-4299-8074-694bf4604429 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:37.579173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf0e0eba-5c33-4299-8074-694bf4604429 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:37.579926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf0e0eba-5c33-4299-8074-694bf4604429 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:37.580349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf0e0eba-5c33-4299-8074-694bf4604429 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:37.610418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cf0e0eba-5c33-4299-8074-694bf4604429 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Apr 11 19:56:37.610991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 735/1522] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:37.627346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b495ae33-5d6b-4520-8ef5-981bc13a10b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:37.628378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b495ae33-5d6b-4520-8ef5-981bc13a10b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:37.634978 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b495ae33-5d6b-4520-8ef5-981bc13a10b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:37.635422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b495ae33-5d6b-4520-8ef5-981bc13a10b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:37.636189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b495ae33-5d6b-4520-8ef5-981bc13a10b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:37.636620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b495ae33-5d6b-4520-8ef5-981bc13a10b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:37.666359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b495ae33-5d6b-4520-8ef5-981bc13a10b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043598 Apr 11 19:56:37.666913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 788/1523] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:37.800540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-28a2657c-ec3f-40a8-b22f-dfc355c2b4ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:37.801506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-28a2657c-ec3f-40a8-b22f-dfc355c2b4ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:37.808624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28a2657c-ec3f-40a8-b22f-dfc355c2b4ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:37.809104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28a2657c-ec3f-40a8-b22f-dfc355c2b4ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:37.809871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28a2657c-ec3f-40a8-b22f-dfc355c2b4ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:37.810305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28a2657c-ec3f-40a8-b22f-dfc355c2b4ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:37.843991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-28a2657c-ec3f-40a8-b22f-dfc355c2b4ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Apr 11 19:56:37.844569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 736/1524] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:37 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:38.373938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27785048-84bf-465b-aab4-1fe0fe807083 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:38.374602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27785048-84bf-465b-aab4-1fe0fe807083 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:38.381813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27785048-84bf-465b-aab4-1fe0fe807083 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:38.382258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27785048-84bf-465b-aab4-1fe0fe807083 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:38.383016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27785048-84bf-465b-aab4-1fe0fe807083 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:38.383443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27785048-84bf-465b-aab4-1fe0fe807083 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:38.444952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27785048-84bf-465b-aab4-1fe0fe807083 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:38.452785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27785048-84bf-465b-aab4-1fe0fe807083 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082674 Apr 11 19:56:38.453400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 789/1525] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:38 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:38.624373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe613e80-90ea-484c-9a5e-bdfa41d96c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:38.626208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe613e80-90ea-484c-9a5e-bdfa41d96c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:38.635998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe613e80-90ea-484c-9a5e-bdfa41d96c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:38.636703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe613e80-90ea-484c-9a5e-bdfa41d96c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:38.637975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe613e80-90ea-484c-9a5e-bdfa41d96c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:38.638686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe613e80-90ea-484c-9a5e-bdfa41d96c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:38.669500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe613e80-90ea-484c-9a5e-bdfa41d96c32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051016 Apr 11 19:56:38.670053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 737/1526] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:38.678848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8a9f716e-3bd8-42e7-9073-8ce8f70dba4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:38.679804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8a9f716e-3bd8-42e7-9073-8ce8f70dba4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:38.686653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a9f716e-3bd8-42e7-9073-8ce8f70dba4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:38.687104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a9f716e-3bd8-42e7-9073-8ce8f70dba4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:38.687868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a9f716e-3bd8-42e7-9073-8ce8f70dba4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:38.688302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a9f716e-3bd8-42e7-9073-8ce8f70dba4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:38.718199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8a9f716e-3bd8-42e7-9073-8ce8f70dba4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043399 Apr 11 19:56:38.718998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 790/1527] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:38.860223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a67eb77e-fcba-419f-bc28-84a376cec1bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:38.861779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a67eb77e-fcba-419f-bc28-84a376cec1bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:38.868982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a67eb77e-fcba-419f-bc28-84a376cec1bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:38.869431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a67eb77e-fcba-419f-bc28-84a376cec1bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:38.870195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a67eb77e-fcba-419f-bc28-84a376cec1bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:38.870623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a67eb77e-fcba-419f-bc28-84a376cec1bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:38.900447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a67eb77e-fcba-419f-bc28-84a376cec1bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Apr 11 19:56:38.901024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 738/1528] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:39.471551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a3f05b11-a755-4b8b-8941-5b412e0bf3ed tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:39.472158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a3f05b11-a755-4b8b-8941-5b412e0bf3ed tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:39.481916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3f05b11-a755-4b8b-8941-5b412e0bf3ed tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:39.482648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3f05b11-a755-4b8b-8941-5b412e0bf3ed tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:39.483884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3f05b11-a755-4b8b-8941-5b412e0bf3ed tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:39.484587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3f05b11-a755-4b8b-8941-5b412e0bf3ed tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:39.547494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3f05b11-a755-4b8b-8941-5b412e0bf3ed tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:39.556200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a3f05b11-a755-4b8b-8941-5b412e0bf3ed tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090122 Apr 11 19:56:39.556734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 791/1529] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:39 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:39.685840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2d6edec5-890e-4abe-a9ff-9b8283b8aa26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:39.687427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2d6edec5-890e-4abe-a9ff-9b8283b8aa26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:39.695143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d6edec5-890e-4abe-a9ff-9b8283b8aa26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:39.695588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d6edec5-890e-4abe-a9ff-9b8283b8aa26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:39.696346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d6edec5-890e-4abe-a9ff-9b8283b8aa26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:39.696778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d6edec5-890e-4abe-a9ff-9b8283b8aa26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:39.726002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2d6edec5-890e-4abe-a9ff-9b8283b8aa26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046779 Apr 11 19:56:39.726483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 739/1530] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:39.729478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f5a41d67-af61-47a8-a15c-f2eb4273aa93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:39.730648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f5a41d67-af61-47a8-a15c-f2eb4273aa93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:39.740240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5a41d67-af61-47a8-a15c-f2eb4273aa93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:39.740692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5a41d67-af61-47a8-a15c-f2eb4273aa93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:39.741650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5a41d67-af61-47a8-a15c-f2eb4273aa93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:39.742224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5a41d67-af61-47a8-a15c-f2eb4273aa93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:39.774768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f5a41d67-af61-47a8-a15c-f2eb4273aa93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049248 Apr 11 19:56:39.775310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 792/1531] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:39.917999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-833a3581-3b77-42db-9965-1d74e9f11a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:39.919532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-833a3581-3b77-42db-9965-1d74e9f11a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:39.929815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-833a3581-3b77-42db-9965-1d74e9f11a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:39.930558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-833a3581-3b77-42db-9965-1d74e9f11a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:39.931795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-833a3581-3b77-42db-9965-1d74e9f11a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:39.932492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-833a3581-3b77-42db-9965-1d74e9f11a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:39.964523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-833a3581-3b77-42db-9965-1d74e9f11a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053211 Apr 11 19:56:39.965114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 740/1532] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:40.577109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fe514494-2355-4e60-aacb-5dd540aba72a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:40.578134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fe514494-2355-4e60-aacb-5dd540aba72a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:40.588267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe514494-2355-4e60-aacb-5dd540aba72a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:40.589029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe514494-2355-4e60-aacb-5dd540aba72a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:40.590306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe514494-2355-4e60-aacb-5dd540aba72a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:40.590982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe514494-2355-4e60-aacb-5dd540aba72a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:40.660805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fe514494-2355-4e60-aacb-5dd540aba72a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:40.668510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fe514494-2355-4e60-aacb-5dd540aba72a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.097771 Apr 11 19:56:40.669114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 793/1533] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:40 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:40.741847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42b9fefe-3fe8-4d3e-97cf-fe51f4f22108 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:40.743365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42b9fefe-3fe8-4d3e-97cf-fe51f4f22108 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:40.753847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42b9fefe-3fe8-4d3e-97cf-fe51f4f22108 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:40.754292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42b9fefe-3fe8-4d3e-97cf-fe51f4f22108 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:40.755056 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42b9fefe-3fe8-4d3e-97cf-fe51f4f22108 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:40.755484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42b9fefe-3fe8-4d3e-97cf-fe51f4f22108 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:40.784966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42b9fefe-3fe8-4d3e-97cf-fe51f4f22108 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049275 Apr 11 19:56:40.785846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 741/1534] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:40.787000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-159cabd4-0bb5-49be-820e-0573692cae8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:40.787945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-159cabd4-0bb5-49be-820e-0573692cae8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:40.794663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-159cabd4-0bb5-49be-820e-0573692cae8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:40.795110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-159cabd4-0bb5-49be-820e-0573692cae8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:40.795857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-159cabd4-0bb5-49be-820e-0573692cae8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:40.796314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-159cabd4-0bb5-49be-820e-0573692cae8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:40.827632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-159cabd4-0bb5-49be-820e-0573692cae8e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044774 Apr 11 19:56:40.828061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 794/1535] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:40.979667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4a1e525a-09ae-4d88-9d61-1a3f165d46b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:40.981268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4a1e525a-09ae-4d88-9d61-1a3f165d46b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:40.989930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a1e525a-09ae-4d88-9d61-1a3f165d46b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:40.990376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a1e525a-09ae-4d88-9d61-1a3f165d46b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:40.991171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a1e525a-09ae-4d88-9d61-1a3f165d46b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:40.991598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a1e525a-09ae-4d88-9d61-1a3f165d46b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:41.020427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4a1e525a-09ae-4d88-9d61-1a3f165d46b9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Apr 11 19:56:41.020972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 742/1536] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:41.686310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9dc1236c-8201-46c9-a3b3-5e3f9e94a198 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:41.686925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9dc1236c-8201-46c9-a3b3-5e3f9e94a198 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:41.693242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dc1236c-8201-46c9-a3b3-5e3f9e94a198 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:41.693573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dc1236c-8201-46c9-a3b3-5e3f9e94a198 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:41.694345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dc1236c-8201-46c9-a3b3-5e3f9e94a198 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:41.694778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dc1236c-8201-46c9-a3b3-5e3f9e94a198 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:41.754824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9dc1236c-8201-46c9-a3b3-5e3f9e94a198 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:41.763001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9dc1236c-8201-46c9-a3b3-5e3f9e94a198 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080632 Apr 11 19:56:41.763586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 795/1537] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:41 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:41.795803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d5285475-7f3d-4d1b-9eaf-05846f47c7a0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:41.796751 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d5285475-7f3d-4d1b-9eaf-05846f47c7a0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:41.803277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5285475-7f3d-4d1b-9eaf-05846f47c7a0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:41.803725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5285475-7f3d-4d1b-9eaf-05846f47c7a0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:41.804484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5285475-7f3d-4d1b-9eaf-05846f47c7a0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:41.804925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5285475-7f3d-4d1b-9eaf-05846f47c7a0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:41.832965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d5285475-7f3d-4d1b-9eaf-05846f47c7a0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041114 Apr 11 19:56:41.833508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 743/1538] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:41.842052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99efc7c5-101e-4038-ab4e-7b3d5a8b79ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:41.842973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99efc7c5-101e-4038-ab4e-7b3d5a8b79ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:41.849380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99efc7c5-101e-4038-ab4e-7b3d5a8b79ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:41.849897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99efc7c5-101e-4038-ab4e-7b3d5a8b79ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:41.850692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99efc7c5-101e-4038-ab4e-7b3d5a8b79ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:41.851041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99efc7c5-101e-4038-ab4e-7b3d5a8b79ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:41.880579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99efc7c5-101e-4038-ab4e-7b3d5a8b79ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042873 Apr 11 19:56:41.881198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 796/1539] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:42.037671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e1e5b68b-eb50-4a50-af28-9c18ac2a6071 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:42.038887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e1e5b68b-eb50-4a50-af28-9c18ac2a6071 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:42.046508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1e5b68b-eb50-4a50-af28-9c18ac2a6071 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:42.047040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1e5b68b-eb50-4a50-af28-9c18ac2a6071 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:42.047939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1e5b68b-eb50-4a50-af28-9c18ac2a6071 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:42.048480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1e5b68b-eb50-4a50-af28-9c18ac2a6071 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:42.080938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e1e5b68b-eb50-4a50-af28-9c18ac2a6071 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050143 Apr 11 19:56:42.081520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 744/1540] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:42.784111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8eb5479-7131-4322-b797-eea304d9f150 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:42.784864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8eb5479-7131-4322-b797-eea304d9f150 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:42.792573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8eb5479-7131-4322-b797-eea304d9f150 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:42.793151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8eb5479-7131-4322-b797-eea304d9f150 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:42.794046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8eb5479-7131-4322-b797-eea304d9f150 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:42.794626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8eb5479-7131-4322-b797-eea304d9f150 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:42.844672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a296a781-e836-418c-9a0c-df984f89ca08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:42.845610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a296a781-e836-418c-9a0c-df984f89ca08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:42.852077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a296a781-e836-418c-9a0c-df984f89ca08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:42.852510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a296a781-e836-418c-9a0c-df984f89ca08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:42.853307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a296a781-e836-418c-9a0c-df984f89ca08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:42.853739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a296a781-e836-418c-9a0c-df984f89ca08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:42.859736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f8eb5479-7131-4322-b797-eea304d9f150 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:42.869502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8eb5479-7131-4322-b797-eea304d9f150 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.091659 Apr 11 19:56:42.870251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 797/1541] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:42 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:42.884360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a296a781-e836-418c-9a0c-df984f89ca08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Apr 11 19:56:42.884928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 745/1542] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:42.898550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66e81042-026c-4c0e-a441-d0ba5d5a9bb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:42.899488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66e81042-026c-4c0e-a441-d0ba5d5a9bb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:42.905933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66e81042-026c-4c0e-a441-d0ba5d5a9bb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:42.906385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66e81042-026c-4c0e-a441-d0ba5d5a9bb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:42.907148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66e81042-026c-4c0e-a441-d0ba5d5a9bb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:42.907582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66e81042-026c-4c0e-a441-d0ba5d5a9bb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:42.936632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66e81042-026c-4c0e-a441-d0ba5d5a9bb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042087 Apr 11 19:56:42.937232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 798/1543] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:43.092924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6034f269-af1d-4ad6-931e-cce88b8f7dc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:43.093947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6034f269-af1d-4ad6-931e-cce88b8f7dc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:43.100945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6034f269-af1d-4ad6-931e-cce88b8f7dc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:43.101321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6034f269-af1d-4ad6-931e-cce88b8f7dc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:43.102074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6034f269-af1d-4ad6-931e-cce88b8f7dc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:43.102499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6034f269-af1d-4ad6-931e-cce88b8f7dc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:43.130672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6034f269-af1d-4ad6-931e-cce88b8f7dc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Apr 11 19:56:43.131487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 746/1544] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:43.889113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e649b718-00bc-45d8-a969-f6b6a598d080 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:43.890020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e649b718-00bc-45d8-a969-f6b6a598d080 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:43.897084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6fc0df9c-efa4-4f4d-9659-2d60b4fcd950 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:43.897707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e649b718-00bc-45d8-a969-f6b6a598d080 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:43.898014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6fc0df9c-efa4-4f4d-9659-2d60b4fcd950 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:43.898131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e649b718-00bc-45d8-a969-f6b6a598d080 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:43.898866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e649b718-00bc-45d8-a969-f6b6a598d080 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:43.899307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e649b718-00bc-45d8-a969-f6b6a598d080 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:43.904380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc0df9c-efa4-4f4d-9659-2d60b4fcd950 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:43.904818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc0df9c-efa4-4f4d-9659-2d60b4fcd950 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:43.905614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc0df9c-efa4-4f4d-9659-2d60b4fcd950 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:43.906048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc0df9c-efa4-4f4d-9659-2d60b4fcd950 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:43.935695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6fc0df9c-efa4-4f4d-9659-2d60b4fcd950 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 Apr 11 19:56:43.936386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 747/1545] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:43.947568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-836eeae5-7b31-4297-8678-c8f9e0ac398e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:43.948504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-836eeae5-7b31-4297-8678-c8f9e0ac398e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:43.954807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-836eeae5-7b31-4297-8678-c8f9e0ac398e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:43.955246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-836eeae5-7b31-4297-8678-c8f9e0ac398e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:43.956043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-836eeae5-7b31-4297-8678-c8f9e0ac398e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:43.956465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-836eeae5-7b31-4297-8678-c8f9e0ac398e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:43.965168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e649b718-00bc-45d8-a969-f6b6a598d080 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:43.973151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e649b718-00bc-45d8-a969-f6b6a598d080 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.089777 Apr 11 19:56:43.973716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 799/1546] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:43 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:43.985824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-836eeae5-7b31-4297-8678-c8f9e0ac398e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042053 Apr 11 19:56:43.986370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 748/1547] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:56:44.146238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e2bea31-f9ab-4f8c-93b3-d30e1d0f2932 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:44.147064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e2bea31-f9ab-4f8c-93b3-d30e1d0f2932 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:44.153097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e2bea31-f9ab-4f8c-93b3-d30e1d0f2932 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:44.153567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e2bea31-f9ab-4f8c-93b3-d30e1d0f2932 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:44.154319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e2bea31-f9ab-4f8c-93b3-d30e1d0f2932 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:44.154738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e2bea31-f9ab-4f8c-93b3-d30e1d0f2932 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:44.185855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e2bea31-f9ab-4f8c-93b3-d30e1d0f2932 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Apr 11 19:56:44.186904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 800/1548] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:44.952014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-053d1615-7285-4764-b371-d412761ca3db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:44.953564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-053d1615-7285-4764-b371-d412761ca3db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:44.964620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-053d1615-7285-4764-b371-d412761ca3db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:44.965423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-053d1615-7285-4764-b371-d412761ca3db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:44.966681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-053d1615-7285-4764-b371-d412761ca3db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:44.967403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-053d1615-7285-4764-b371-d412761ca3db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:44.989124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b48abff3-33f5-4fcf-9e4d-f26fe125fa85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:44.989862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b48abff3-33f5-4fcf-9e4d-f26fe125fa85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:44.996314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b48abff3-33f5-4fcf-9e4d-f26fe125fa85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:44.996761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b48abff3-33f5-4fcf-9e4d-f26fe125fa85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:44.997633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b48abff3-33f5-4fcf-9e4d-f26fe125fa85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:44.998063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b48abff3-33f5-4fcf-9e4d-f26fe125fa85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:45.000086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-053d1615-7285-4764-b371-d412761ca3db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054417 Apr 11 19:56:45.000866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 749/1549] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:45.007238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d46b709-31c0-4ec2-9ea5-891422dc833f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:45.008195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d46b709-31c0-4ec2-9ea5-891422dc833f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:45.014451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d46b709-31c0-4ec2-9ea5-891422dc833f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:45.014896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d46b709-31c0-4ec2-9ea5-891422dc833f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:45.016182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d46b709-31c0-4ec2-9ea5-891422dc833f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:45.016182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d46b709-31c0-4ec2-9ea5-891422dc833f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:45.047096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d46b709-31c0-4ec2-9ea5-891422dc833f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044614 Apr 11 19:56:45.047632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 750/1550] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:45.061801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b48abff3-33f5-4fcf-9e4d-f26fe125fa85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:45.069534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b48abff3-33f5-4fcf-9e4d-f26fe125fa85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084321 Apr 11 19:56:45.070089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 801/1551] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:44 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:45.200743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-feeaccca-e4f1-4da8-8585-6ba4bf7178fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:45.202180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-feeaccca-e4f1-4da8-8585-6ba4bf7178fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:45.210498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-feeaccca-e4f1-4da8-8585-6ba4bf7178fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:45.211055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-feeaccca-e4f1-4da8-8585-6ba4bf7178fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:45.211807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-feeaccca-e4f1-4da8-8585-6ba4bf7178fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:45.212240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-feeaccca-e4f1-4da8-8585-6ba4bf7178fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:45.240869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-feeaccca-e4f1-4da8-8585-6ba4bf7178fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045719 Apr 11 19:56:45.241453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 751/1552] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:46.011874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3224e4ad-3643-494b-83fd-8ca1d75a9de2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:46.012825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3224e4ad-3643-494b-83fd-8ca1d75a9de2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:46.019748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3224e4ad-3643-494b-83fd-8ca1d75a9de2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:46.020200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3224e4ad-3643-494b-83fd-8ca1d75a9de2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:46.021020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3224e4ad-3643-494b-83fd-8ca1d75a9de2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:46.021454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3224e4ad-3643-494b-83fd-8ca1d75a9de2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:46.051112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3224e4ad-3643-494b-83fd-8ca1d75a9de2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043215 Apr 11 19:56:46.051655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 802/1553] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:46.059019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-530a7d5e-680e-44fc-90bc-b8ea04805a10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:46.059997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-530a7d5e-680e-44fc-90bc-b8ea04805a10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:46.066291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-530a7d5e-680e-44fc-90bc-b8ea04805a10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:46.066746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-530a7d5e-680e-44fc-90bc-b8ea04805a10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:46.067496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-530a7d5e-680e-44fc-90bc-b8ea04805a10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:46.067923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-530a7d5e-680e-44fc-90bc-b8ea04805a10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:46.087153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbc0d0db-25c7-4681-a381-81e3d501fee5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:46.087773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbc0d0db-25c7-4681-a381-81e3d501fee5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:46.093811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbc0d0db-25c7-4681-a381-81e3d501fee5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:46.094259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbc0d0db-25c7-4681-a381-81e3d501fee5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:46.095015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbc0d0db-25c7-4681-a381-81e3d501fee5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:46.095441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbc0d0db-25c7-4681-a381-81e3d501fee5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:46.101736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-530a7d5e-680e-44fc-90bc-b8ea04805a10 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046706 Apr 11 19:56:46.102534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 752/1554] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:46.163637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbc0d0db-25c7-4681-a381-81e3d501fee5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:46.171987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbc0d0db-25c7-4681-a381-81e3d501fee5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088677 Apr 11 19:56:46.172565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 803/1555] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:46 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:46.256305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5bc1de7f-4f67-45e3-8e1e-1838335080fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:46.257476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5bc1de7f-4f67-45e3-8e1e-1838335080fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:46.267773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bc1de7f-4f67-45e3-8e1e-1838335080fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:46.268378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bc1de7f-4f67-45e3-8e1e-1838335080fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:46.269173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bc1de7f-4f67-45e3-8e1e-1838335080fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:46.269599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bc1de7f-4f67-45e3-8e1e-1838335080fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:46.304565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5bc1de7f-4f67-45e3-8e1e-1838335080fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054755 Apr 11 19:56:46.305136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 753/1556] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:47.063479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5cb3584-ac63-4f0f-9644-80f736aeb7b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:47.064505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5cb3584-ac63-4f0f-9644-80f736aeb7b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:47.071542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5cb3584-ac63-4f0f-9644-80f736aeb7b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:47.071861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5cb3584-ac63-4f0f-9644-80f736aeb7b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:47.073092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5cb3584-ac63-4f0f-9644-80f736aeb7b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:47.073525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5cb3584-ac63-4f0f-9644-80f736aeb7b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:47.105162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5cb3584-ac63-4f0f-9644-80f736aeb7b3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Apr 11 19:56:47.105733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 804/1557] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:47.113256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7bbb5068-3edc-42d2-bac3-47b15662b104 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:47.114158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7bbb5068-3edc-42d2-bac3-47b15662b104 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:47.120340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7bbb5068-3edc-42d2-bac3-47b15662b104 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:47.120792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7bbb5068-3edc-42d2-bac3-47b15662b104 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:47.121590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7bbb5068-3edc-42d2-bac3-47b15662b104 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:47.122027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7bbb5068-3edc-42d2-bac3-47b15662b104 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:47.158260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7bbb5068-3edc-42d2-bac3-47b15662b104 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049091 Apr 11 19:56:47.158844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 754/1558] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:47.192306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a7d259d-e4e9-4185-8a9e-fd425821ec1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:47.192940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6a7d259d-e4e9-4185-8a9e-fd425821ec1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:47.199511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a7d259d-e4e9-4185-8a9e-fd425821ec1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:47.200052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a7d259d-e4e9-4185-8a9e-fd425821ec1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:47.200853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a7d259d-e4e9-4185-8a9e-fd425821ec1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:47.201406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a7d259d-e4e9-4185-8a9e-fd425821ec1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:47.277688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a7d259d-e4e9-4185-8a9e-fd425821ec1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:47.286421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6a7d259d-e4e9-4185-8a9e-fd425821ec1b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098128 Apr 11 19:56:47.286962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 805/1559] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:47 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:47.316067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dfe9cb39-5d49-43df-82dc-f3e33272b13f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:47.316913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dfe9cb39-5d49-43df-82dc-f3e33272b13f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:47.323731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfe9cb39-5d49-43df-82dc-f3e33272b13f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:47.324176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfe9cb39-5d49-43df-82dc-f3e33272b13f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:47.324959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfe9cb39-5d49-43df-82dc-f3e33272b13f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:47.325570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfe9cb39-5d49-43df-82dc-f3e33272b13f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:47.354999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dfe9cb39-5d49-43df-82dc-f3e33272b13f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Apr 11 19:56:47.355592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 755/1560] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:48.121083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-33036a51-e747-40e5-b1a2-74df7bf65843 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:48.122569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-33036a51-e747-40e5-b1a2-74df7bf65843 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:48.131438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33036a51-e747-40e5-b1a2-74df7bf65843 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:48.131886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33036a51-e747-40e5-b1a2-74df7bf65843 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:48.132644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33036a51-e747-40e5-b1a2-74df7bf65843 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:48.133114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33036a51-e747-40e5-b1a2-74df7bf65843 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:48.162991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-33036a51-e747-40e5-b1a2-74df7bf65843 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048527 Apr 11 19:56:48.163542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 806/1561] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:48.169870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c4faf292-014c-4fb7-8ab7-3c89f6d4379d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:48.170788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c4faf292-014c-4fb7-8ab7-3c89f6d4379d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:48.176937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4faf292-014c-4fb7-8ab7-3c89f6d4379d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:48.177390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4faf292-014c-4fb7-8ab7-3c89f6d4379d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:48.178143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4faf292-014c-4fb7-8ab7-3c89f6d4379d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:48.178571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4faf292-014c-4fb7-8ab7-3c89f6d4379d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:48.208826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c4faf292-014c-4fb7-8ab7-3c89f6d4379d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042951 Apr 11 19:56:48.209418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 756/1562] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:48.308644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d61d97c-ac6d-4d27-84af-ef85a9ccbcbc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:48.309711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d61d97c-ac6d-4d27-84af-ef85a9ccbcbc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:48.318244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d61d97c-ac6d-4d27-84af-ef85a9ccbcbc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:48.318690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d61d97c-ac6d-4d27-84af-ef85a9ccbcbc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:48.319455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d61d97c-ac6d-4d27-84af-ef85a9ccbcbc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:48.319880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d61d97c-ac6d-4d27-84af-ef85a9ccbcbc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:48.367660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c4353501-66b1-4907-94f8-e18803e8c170 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:48.368589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c4353501-66b1-4907-94f8-e18803e8c170 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:48.375606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4353501-66b1-4907-94f8-e18803e8c170 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:48.375986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4353501-66b1-4907-94f8-e18803e8c170 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:48.376744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4353501-66b1-4907-94f8-e18803e8c170 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:48.377205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4353501-66b1-4907-94f8-e18803e8c170 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:48.385198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d61d97c-ac6d-4d27-84af-ef85a9ccbcbc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:48.392856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d61d97c-ac6d-4d27-84af-ef85a9ccbcbc tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090709 Apr 11 19:56:48.393500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 807/1563] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:48 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:48.406170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c4353501-66b1-4907-94f8-e18803e8c170 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 Apr 11 19:56:48.406730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 757/1564] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:56:49.175959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9173828d-7d1d-45a5-81be-c49bb7a85257 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:49.176884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9173828d-7d1d-45a5-81be-c49bb7a85257 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:49.183616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9173828d-7d1d-45a5-81be-c49bb7a85257 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:49.184054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9173828d-7d1d-45a5-81be-c49bb7a85257 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:49.184817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9173828d-7d1d-45a5-81be-c49bb7a85257 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:49.185270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9173828d-7d1d-45a5-81be-c49bb7a85257 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:49.220938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-633cc2cf-f522-42ac-bba1-4bf5175f3cb1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:49.221777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9173828d-7d1d-45a5-81be-c49bb7a85257 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050695 Apr 11 19:56:49.221950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-633cc2cf-f522-42ac-bba1-4bf5175f3cb1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:49.222352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 808/1565] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:49.228329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633cc2cf-f522-42ac-bba1-4bf5175f3cb1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:49.228824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633cc2cf-f522-42ac-bba1-4bf5175f3cb1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:49.229608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633cc2cf-f522-42ac-bba1-4bf5175f3cb1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:49.230038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633cc2cf-f522-42ac-bba1-4bf5175f3cb1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:49.259649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-633cc2cf-f522-42ac-bba1-4bf5175f3cb1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043643 Apr 11 19:56:49.260219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 758/1566] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:49.410866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d911ea8-22eb-4eb4-9cca-2acf3b6c3b83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:49.411456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d911ea8-22eb-4eb4-9cca-2acf3b6c3b83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:49.418023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9001ea96-23b5-4fb8-a960-c35c09cb1637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:49.418235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d911ea8-22eb-4eb4-9cca-2acf3b6c3b83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:49.418554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d911ea8-22eb-4eb4-9cca-2acf3b6c3b83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:49.419089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9001ea96-23b5-4fb8-a960-c35c09cb1637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:49.419285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d911ea8-22eb-4eb4-9cca-2acf3b6c3b83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:49.419731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d911ea8-22eb-4eb4-9cca-2acf3b6c3b83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:49.426447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9001ea96-23b5-4fb8-a960-c35c09cb1637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:49.426825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9001ea96-23b5-4fb8-a960-c35c09cb1637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:49.427599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9001ea96-23b5-4fb8-a960-c35c09cb1637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:49.428036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9001ea96-23b5-4fb8-a960-c35c09cb1637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:49.459943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9001ea96-23b5-4fb8-a960-c35c09cb1637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Apr 11 19:56:49.460525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 759/1567] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:49.485836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d911ea8-22eb-4eb4-9cca-2acf3b6c3b83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:49.493620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d911ea8-22eb-4eb4-9cca-2acf3b6c3b83 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086782 Apr 11 19:56:49.494156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 809/1568] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:49 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:50.233347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1114820a-a71f-4e96-a865-a2b8a183ca85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:50.234277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1114820a-a71f-4e96-a865-a2b8a183ca85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:50.240646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1114820a-a71f-4e96-a865-a2b8a183ca85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:50.241121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1114820a-a71f-4e96-a865-a2b8a183ca85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:50.241879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1114820a-a71f-4e96-a865-a2b8a183ca85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:50.242304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1114820a-a71f-4e96-a865-a2b8a183ca85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:50.271806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3b614494-206b-4c7e-accd-ebd1ee1cbd43 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:50.272724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3b614494-206b-4c7e-accd-ebd1ee1cbd43 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:50.272883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1114820a-a71f-4e96-a865-a2b8a183ca85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Apr 11 19:56:50.273416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 760/1569] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:50.279088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b614494-206b-4c7e-accd-ebd1ee1cbd43 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:50.279526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b614494-206b-4c7e-accd-ebd1ee1cbd43 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:50.280311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b614494-206b-4c7e-accd-ebd1ee1cbd43 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:50.280728 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b614494-206b-4c7e-accd-ebd1ee1cbd43 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:50.308714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3b614494-206b-4c7e-accd-ebd1ee1cbd43 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040928 Apr 11 19:56:50.309372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 810/1570] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:50.472336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d50d7a62-748c-4d2d-adcc-210d4b88f18b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:50.473204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d50d7a62-748c-4d2d-adcc-210d4b88f18b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:50.479973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d50d7a62-748c-4d2d-adcc-210d4b88f18b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:50.480416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d50d7a62-748c-4d2d-adcc-210d4b88f18b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:50.481209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d50d7a62-748c-4d2d-adcc-210d4b88f18b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:50.481637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d50d7a62-748c-4d2d-adcc-210d4b88f18b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:50.511553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-474e73c5-a1ee-4b1a-b9fd-8a4c3740eb6a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:50.512169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-474e73c5-a1ee-4b1a-b9fd-8a4c3740eb6a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:50.514862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d50d7a62-748c-4d2d-adcc-210d4b88f18b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046837 Apr 11 19:56:50.515435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 761/1571] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:50.518261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-474e73c5-a1ee-4b1a-b9fd-8a4c3740eb6a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:50.518703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-474e73c5-a1ee-4b1a-b9fd-8a4c3740eb6a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:50.519474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-474e73c5-a1ee-4b1a-b9fd-8a4c3740eb6a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:50.519903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-474e73c5-a1ee-4b1a-b9fd-8a4c3740eb6a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:50.589657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-474e73c5-a1ee-4b1a-b9fd-8a4c3740eb6a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:50.599791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-474e73c5-a1ee-4b1a-b9fd-8a4c3740eb6a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092044 Apr 11 19:56:50.600828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 811/1572] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:50 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:51.286352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-760fe452-7764-4d4f-8801-5ed959e1a27b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:51.287275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-760fe452-7764-4d4f-8801-5ed959e1a27b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:51.293777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-760fe452-7764-4d4f-8801-5ed959e1a27b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:51.294224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-760fe452-7764-4d4f-8801-5ed959e1a27b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:51.294985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-760fe452-7764-4d4f-8801-5ed959e1a27b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:51.295439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-760fe452-7764-4d4f-8801-5ed959e1a27b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:51.320947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8db57dcc-4325-4eef-ac15-f48400d776de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:51.321879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8db57dcc-4325-4eef-ac15-f48400d776de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:51.325791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-760fe452-7764-4d4f-8801-5ed959e1a27b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043471 Apr 11 19:56:51.326359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 762/1573] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:51.328355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8db57dcc-4325-4eef-ac15-f48400d776de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:51.328822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8db57dcc-4325-4eef-ac15-f48400d776de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:51.329590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8db57dcc-4325-4eef-ac15-f48400d776de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:51.330177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8db57dcc-4325-4eef-ac15-f48400d776de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:51.358484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8db57dcc-4325-4eef-ac15-f48400d776de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041652 Apr 11 19:56:51.359032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 812/1574] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:51.530913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2fbff8ba-4472-4377-a07f-534a04df30e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:51.532279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2fbff8ba-4472-4377-a07f-534a04df30e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:51.542975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fbff8ba-4472-4377-a07f-534a04df30e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:51.543708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fbff8ba-4472-4377-a07f-534a04df30e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:51.544987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fbff8ba-4472-4377-a07f-534a04df30e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:51.545671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fbff8ba-4472-4377-a07f-534a04df30e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:51.576576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2fbff8ba-4472-4377-a07f-534a04df30e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052414 Apr 11 19:56:51.577154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 763/1575] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:51.623200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-65778adb-0932-4b04-b763-8c0f74810ed4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:51.624015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-65778adb-0932-4b04-b763-8c0f74810ed4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:51.633865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65778adb-0932-4b04-b763-8c0f74810ed4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:51.634439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65778adb-0932-4b04-b763-8c0f74810ed4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:51.635560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65778adb-0932-4b04-b763-8c0f74810ed4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:51.636194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65778adb-0932-4b04-b763-8c0f74810ed4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:51.709176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-65778adb-0932-4b04-b763-8c0f74810ed4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:51.717119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-65778adb-0932-4b04-b763-8c0f74810ed4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.100018 Apr 11 19:56:51.717680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 813/1576] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:51 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:52.337884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa9e1f4b-0533-4c13-a694-4d9a3db6b1b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:52.338806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa9e1f4b-0533-4c13-a694-4d9a3db6b1b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:52.345673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa9e1f4b-0533-4c13-a694-4d9a3db6b1b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:52.346120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa9e1f4b-0533-4c13-a694-4d9a3db6b1b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:52.346875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa9e1f4b-0533-4c13-a694-4d9a3db6b1b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:52.347309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa9e1f4b-0533-4c13-a694-4d9a3db6b1b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:52.370053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-815db5cf-483b-4f8a-b969-82c684c8ccbb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:52.370966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-815db5cf-483b-4f8a-b969-82c684c8ccbb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:52.377012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa9e1f4b-0533-4c13-a694-4d9a3db6b1b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Apr 11 19:56:52.377578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 764/1577] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:52.377826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-815db5cf-483b-4f8a-b969-82c684c8ccbb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:52.378274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-815db5cf-483b-4f8a-b969-82c684c8ccbb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:52.379032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-815db5cf-483b-4f8a-b969-82c684c8ccbb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:52.379449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-815db5cf-483b-4f8a-b969-82c684c8ccbb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:52.408700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-815db5cf-483b-4f8a-b969-82c684c8ccbb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042607 Apr 11 19:56:52.409272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 814/1578] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:52.591951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5084aafc-f756-4a85-8695-f72e3a1e03bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:52.593479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5084aafc-f756-4a85-8695-f72e3a1e03bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:52.601030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5084aafc-f756-4a85-8695-f72e3a1e03bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:52.601468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5084aafc-f756-4a85-8695-f72e3a1e03bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:52.602218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5084aafc-f756-4a85-8695-f72e3a1e03bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:52.602647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5084aafc-f756-4a85-8695-f72e3a1e03bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:52.631295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5084aafc-f756-4a85-8695-f72e3a1e03bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Apr 11 19:56:52.631843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 765/1579] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:52.737551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-438f8a2f-b7b6-4e1f-a641-5440b17d8725 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:52.738305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-438f8a2f-b7b6-4e1f-a641-5440b17d8725 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:52.747184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438f8a2f-b7b6-4e1f-a641-5440b17d8725 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:52.747839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438f8a2f-b7b6-4e1f-a641-5440b17d8725 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:52.748977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438f8a2f-b7b6-4e1f-a641-5440b17d8725 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:52.749535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-438f8a2f-b7b6-4e1f-a641-5440b17d8725 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:52.811484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-438f8a2f-b7b6-4e1f-a641-5440b17d8725 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:52.819585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-438f8a2f-b7b6-4e1f-a641-5440b17d8725 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088560 Apr 11 19:56:52.820140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 815/1580] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:52 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:53.392665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4f7627bf-f9c6-4dd6-a82e-8c6a5fecac5a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:53.394140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4f7627bf-f9c6-4dd6-a82e-8c6a5fecac5a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:53.404421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f7627bf-f9c6-4dd6-a82e-8c6a5fecac5a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:53.405229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f7627bf-f9c6-4dd6-a82e-8c6a5fecac5a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:53.406491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f7627bf-f9c6-4dd6-a82e-8c6a5fecac5a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:53.407212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f7627bf-f9c6-4dd6-a82e-8c6a5fecac5a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:53.419990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7d3e91c5-d752-498e-8d4c-7346cd51450d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:53.420943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7d3e91c5-d752-498e-8d4c-7346cd51450d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:53.427254 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d3e91c5-d752-498e-8d4c-7346cd51450d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:53.427700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d3e91c5-d752-498e-8d4c-7346cd51450d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:53.428455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d3e91c5-d752-498e-8d4c-7346cd51450d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:53.428881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d3e91c5-d752-498e-8d4c-7346cd51450d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:53.437194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4f7627bf-f9c6-4dd6-a82e-8c6a5fecac5a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051152 Apr 11 19:56:53.437795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 766/1581] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:53.457599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7d3e91c5-d752-498e-8d4c-7346cd51450d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041557 Apr 11 19:56:53.458147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 816/1582] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:53.644835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-36536fe4-c482-4ff7-8a1e-267b8d6aafc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:53.646061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-36536fe4-c482-4ff7-8a1e-267b8d6aafc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:53.655226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36536fe4-c482-4ff7-8a1e-267b8d6aafc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:53.655784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36536fe4-c482-4ff7-8a1e-267b8d6aafc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:53.657083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36536fe4-c482-4ff7-8a1e-267b8d6aafc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:53.657731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36536fe4-c482-4ff7-8a1e-267b8d6aafc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:53.697714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-36536fe4-c482-4ff7-8a1e-267b8d6aafc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057732 Apr 11 19:56:53.698546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 767/1583] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:53.840549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b43011e9-2044-4544-ab77-f0038537f7c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:53.841457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b43011e9-2044-4544-ab77-f0038537f7c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:53.851531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b43011e9-2044-4544-ab77-f0038537f7c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:53.852272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b43011e9-2044-4544-ab77-f0038537f7c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:53.853563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b43011e9-2044-4544-ab77-f0038537f7c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:53.854268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b43011e9-2044-4544-ab77-f0038537f7c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:53.922802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b43011e9-2044-4544-ab77-f0038537f7c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:53.930753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b43011e9-2044-4544-ab77-f0038537f7c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.096679 Apr 11 19:56:53.931306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 817/1584] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:53 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:54.449682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5eff1a02-abfd-460a-a137-d2de8465d891 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:54.450685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5eff1a02-abfd-460a-a137-d2de8465d891 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:54.457694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5eff1a02-abfd-460a-a137-d2de8465d891 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:54.458163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5eff1a02-abfd-460a-a137-d2de8465d891 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:54.458900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5eff1a02-abfd-460a-a137-d2de8465d891 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:54.459320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5eff1a02-abfd-460a-a137-d2de8465d891 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:54.468477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a81478c0-cf48-4da3-8e52-6c360af5f94f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:54.469434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a81478c0-cf48-4da3-8e52-6c360af5f94f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:54.476016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a81478c0-cf48-4da3-8e52-6c360af5f94f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:54.476466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a81478c0-cf48-4da3-8e52-6c360af5f94f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:54.477260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a81478c0-cf48-4da3-8e52-6c360af5f94f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:54.477684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a81478c0-cf48-4da3-8e52-6c360af5f94f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:54.490675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5eff1a02-abfd-460a-a137-d2de8465d891 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Apr 11 19:56:54.491254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 768/1585] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:54.516214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a81478c0-cf48-4da3-8e52-6c360af5f94f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051440 Apr 11 19:56:54.517040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 818/1586] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:54.712087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-14ddfc9d-ddb4-4af9-bbd4-c27c78226eb5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:54.712941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-14ddfc9d-ddb4-4af9-bbd4-c27c78226eb5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:54.721468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14ddfc9d-ddb4-4af9-bbd4-c27c78226eb5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:54.721917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14ddfc9d-ddb4-4af9-bbd4-c27c78226eb5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:54.722689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14ddfc9d-ddb4-4af9-bbd4-c27c78226eb5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:54.723125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14ddfc9d-ddb4-4af9-bbd4-c27c78226eb5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:54.753117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-14ddfc9d-ddb4-4af9-bbd4-c27c78226eb5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Apr 11 19:56:54.753681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 769/1587] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:54.949206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1ffb8ac8-81e0-4cf5-aee8-b0a1e967a965 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:54.949958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1ffb8ac8-81e0-4cf5-aee8-b0a1e967a965 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:54.957657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ffb8ac8-81e0-4cf5-aee8-b0a1e967a965 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:54.958213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ffb8ac8-81e0-4cf5-aee8-b0a1e967a965 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:54.959143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ffb8ac8-81e0-4cf5-aee8-b0a1e967a965 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:54.959672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ffb8ac8-81e0-4cf5-aee8-b0a1e967a965 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:55.032353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ffb8ac8-81e0-4cf5-aee8-b0a1e967a965 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:55.043622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1ffb8ac8-81e0-4cf5-aee8-b0a1e967a965 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098989 Apr 11 19:56:55.044527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 819/1588] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:54 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:55.508011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8d89cd67-9ed9-40be-b484-2089a6aabdab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:55.509532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8d89cd67-9ed9-40be-b484-2089a6aabdab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:55.519942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d89cd67-9ed9-40be-b484-2089a6aabdab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:55.520675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d89cd67-9ed9-40be-b484-2089a6aabdab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:55.521950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d89cd67-9ed9-40be-b484-2089a6aabdab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:55.522651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d89cd67-9ed9-40be-b484-2089a6aabdab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:55.532400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-34286f49-7da4-4086-84bf-1cf5d9ad39e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:55.533845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-34286f49-7da4-4086-84bf-1cf5d9ad39e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:55.540454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34286f49-7da4-4086-84bf-1cf5d9ad39e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:55.540926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34286f49-7da4-4086-84bf-1cf5d9ad39e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:55.541682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34286f49-7da4-4086-84bf-1cf5d9ad39e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:55.542142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34286f49-7da4-4086-84bf-1cf5d9ad39e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:55.558844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8d89cd67-9ed9-40be-b484-2089a6aabdab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057857 Apr 11 19:56:55.559416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 770/1589] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:55.571337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-34286f49-7da4-4086-84bf-1cf5d9ad39e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046022 Apr 11 19:56:55.572027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 820/1590] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:55.769761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37945170-a05e-4916-8c95-eb4eac82ec2d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:55.771131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37945170-a05e-4916-8c95-eb4eac82ec2d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:55.783984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37945170-a05e-4916-8c95-eb4eac82ec2d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:55.784434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37945170-a05e-4916-8c95-eb4eac82ec2d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:55.785257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37945170-a05e-4916-8c95-eb4eac82ec2d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:55.785687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37945170-a05e-4916-8c95-eb4eac82ec2d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:55.818453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37945170-a05e-4916-8c95-eb4eac82ec2d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055914 Apr 11 19:56:55.819348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 771/1591] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:56.061937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c892c036-f817-4a86-b5e0-281db60d3cec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:56.062444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c892c036-f817-4a86-b5e0-281db60d3cec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:56.069025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c892c036-f817-4a86-b5e0-281db60d3cec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:56.069571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c892c036-f817-4a86-b5e0-281db60d3cec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:56.070420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c892c036-f817-4a86-b5e0-281db60d3cec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:56.070987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c892c036-f817-4a86-b5e0-281db60d3cec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:56.136119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c892c036-f817-4a86-b5e0-281db60d3cec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:56.145606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c892c036-f817-4a86-b5e0-281db60d3cec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087632 Apr 11 19:56:56.146180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 821/1592] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:56 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:56.575103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9abde852-0d2a-47e8-aff1-1fd3c2d7fbbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:56.576646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9abde852-0d2a-47e8-aff1-1fd3c2d7fbbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:56.584562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9abde852-0d2a-47e8-aff1-1fd3c2d7fbbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:56.584731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c26c7f4-1cf5-4e29-842e-6720c12abaf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:56.585186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9abde852-0d2a-47e8-aff1-1fd3c2d7fbbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:56.585746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c26c7f4-1cf5-4e29-842e-6720c12abaf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:56.585991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9abde852-0d2a-47e8-aff1-1fd3c2d7fbbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:56.586375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9abde852-0d2a-47e8-aff1-1fd3c2d7fbbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:56.592456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c26c7f4-1cf5-4e29-842e-6720c12abaf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:56.592926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c26c7f4-1cf5-4e29-842e-6720c12abaf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:56.593702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c26c7f4-1cf5-4e29-842e-6720c12abaf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:56.594128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c26c7f4-1cf5-4e29-842e-6720c12abaf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:56.616299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9abde852-0d2a-47e8-aff1-1fd3c2d7fbbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047813 Apr 11 19:56:56.616859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 772/1593] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:56.623462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c26c7f4-1cf5-4e29-842e-6720c12abaf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042833 Apr 11 19:56:56.624015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 822/1594] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:56.835527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c9ccadb-9c95-4bb5-ad61-721f35b36da8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:56.836978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c9ccadb-9c95-4bb5-ad61-721f35b36da8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:56.847467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c9ccadb-9c95-4bb5-ad61-721f35b36da8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:56.848208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c9ccadb-9c95-4bb5-ad61-721f35b36da8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:56.849497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c9ccadb-9c95-4bb5-ad61-721f35b36da8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:56.850212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c9ccadb-9c95-4bb5-ad61-721f35b36da8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:56.883267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c9ccadb-9c95-4bb5-ad61-721f35b36da8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054778 Apr 11 19:56:56.884117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 773/1595] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:57.163539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-38e5d080-50d0-44c5-a588-08f151ed0924 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:57.164028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-38e5d080-50d0-44c5-a588-08f151ed0924 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:57.170214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38e5d080-50d0-44c5-a588-08f151ed0924 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:57.170636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38e5d080-50d0-44c5-a588-08f151ed0924 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:57.171390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38e5d080-50d0-44c5-a588-08f151ed0924 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:57.171809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38e5d080-50d0-44c5-a588-08f151ed0924 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:57.235604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-38e5d080-50d0-44c5-a588-08f151ed0924 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:57.243711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-38e5d080-50d0-44c5-a588-08f151ed0924 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083954 Apr 11 19:56:57.244362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 823/1596] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:57 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:57.629938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-799a18ca-7cb7-42b3-8022-78960ab01fad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:57.631090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-799a18ca-7cb7-42b3-8022-78960ab01fad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:57.636178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a3a83c7-6c5d-4a76-95fe-6632da9687b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:57.637567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-799a18ca-7cb7-42b3-8022-78960ab01fad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:57.637901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a3a83c7-6c5d-4a76-95fe-6632da9687b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:57.638045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-799a18ca-7cb7-42b3-8022-78960ab01fad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:57.638781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-799a18ca-7cb7-42b3-8022-78960ab01fad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:57.639210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-799a18ca-7cb7-42b3-8022-78960ab01fad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:57.645933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a3a83c7-6c5d-4a76-95fe-6632da9687b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:57.646396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a3a83c7-6c5d-4a76-95fe-6632da9687b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:57.647170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a3a83c7-6c5d-4a76-95fe-6632da9687b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:57.647588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a3a83c7-6c5d-4a76-95fe-6632da9687b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:57.671740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-799a18ca-7cb7-42b3-8022-78960ab01fad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047946 Apr 11 19:56:57.672344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 774/1597] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:57.679963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a3a83c7-6c5d-4a76-95fe-6632da9687b9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047774 Apr 11 19:56:57.680529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 824/1598] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:57.896848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c042ed36-ed9f-4764-bb7d-9a1262236daa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:57.897737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c042ed36-ed9f-4764-bb7d-9a1262236daa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:57.904516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c042ed36-ed9f-4764-bb7d-9a1262236daa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:57.904998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c042ed36-ed9f-4764-bb7d-9a1262236daa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:57.906016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c042ed36-ed9f-4764-bb7d-9a1262236daa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:57.906744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c042ed36-ed9f-4764-bb7d-9a1262236daa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:57.938491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c042ed36-ed9f-4764-bb7d-9a1262236daa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046613 Apr 11 19:56:57.939084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 775/1599] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:58.262217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c52d5b50-e7bf-4375-8b7d-41c265204b85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:58.262830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c52d5b50-e7bf-4375-8b7d-41c265204b85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:58.269499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c52d5b50-e7bf-4375-8b7d-41c265204b85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:58.269980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c52d5b50-e7bf-4375-8b7d-41c265204b85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:58.270753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c52d5b50-e7bf-4375-8b7d-41c265204b85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:58.271183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c52d5b50-e7bf-4375-8b7d-41c265204b85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:58.339773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c52d5b50-e7bf-4375-8b7d-41c265204b85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:58.347461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c52d5b50-e7bf-4375-8b7d-41c265204b85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.089320 Apr 11 19:56:58.348020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 825/1600] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:58 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:58.685850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ad5e6ce5-cd7e-40a3-9843-421e13921583 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:58.686758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ad5e6ce5-cd7e-40a3-9843-421e13921583 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:58.691882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8bb6b59c-ed3d-4d4d-828e-56457c184437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:58.692821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8bb6b59c-ed3d-4d4d-828e-56457c184437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:58.693315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad5e6ce5-cd7e-40a3-9843-421e13921583 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:58.693846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad5e6ce5-cd7e-40a3-9843-421e13921583 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:58.696355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad5e6ce5-cd7e-40a3-9843-421e13921583 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:58.696355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad5e6ce5-cd7e-40a3-9843-421e13921583 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:58.699356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8bb6b59c-ed3d-4d4d-828e-56457c184437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:58.699809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8bb6b59c-ed3d-4d4d-828e-56457c184437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:58.700571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8bb6b59c-ed3d-4d4d-828e-56457c184437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:58.701026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8bb6b59c-ed3d-4d4d-828e-56457c184437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:58.725448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ad5e6ce5-cd7e-40a3-9843-421e13921583 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Apr 11 19:56:58.725448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 776/1601] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:58.730443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8bb6b59c-ed3d-4d4d-828e-56457c184437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042536 Apr 11 19:56:58.731001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 826/1602] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:56:58.951032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-776dc808-aa62-4ca3-9b8d-57977fed1383 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:58.951989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-776dc808-aa62-4ca3-9b8d-57977fed1383 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:58.959455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-776dc808-aa62-4ca3-9b8d-57977fed1383 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:58.959913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-776dc808-aa62-4ca3-9b8d-57977fed1383 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:58.960687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-776dc808-aa62-4ca3-9b8d-57977fed1383 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:58.961163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-776dc808-aa62-4ca3-9b8d-57977fed1383 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:58.994504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-776dc808-aa62-4ca3-9b8d-57977fed1383 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047521 Apr 11 19:56:58.995042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 777/1603] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:59.368547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff355929-7238-4156-9b47-b08608133d43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:59.369587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff355929-7238-4156-9b47-b08608133d43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:59.378875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff355929-7238-4156-9b47-b08608133d43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:59.379326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff355929-7238-4156-9b47-b08608133d43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:59.380086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff355929-7238-4156-9b47-b08608133d43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:59.380512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff355929-7238-4156-9b47-b08608133d43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:59.452929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff355929-7238-4156-9b47-b08608133d43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:56:59.463424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff355929-7238-4156-9b47-b08608133d43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.101210 Apr 11 19:56:59.464206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 827/1604] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:56:59 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:56:59.740428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a191d08-4e6d-45c8-8923-14cac817a944 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:59.741850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a191d08-4e6d-45c8-8923-14cac817a944 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:59.747033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f01366c8-720c-4806-9a95-682265242f1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:56:59.748512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f01366c8-720c-4806-9a95-682265242f1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:56:59.752448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a191d08-4e6d-45c8-8923-14cac817a944 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:59.753256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a191d08-4e6d-45c8-8923-14cac817a944 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:59.754496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a191d08-4e6d-45c8-8923-14cac817a944 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:59.755198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a191d08-4e6d-45c8-8923-14cac817a944 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:59.759355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f01366c8-720c-4806-9a95-682265242f1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:59.760090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f01366c8-720c-4806-9a95-682265242f1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:59.761377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f01366c8-720c-4806-9a95-682265242f1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:56:59.762094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f01366c8-720c-4806-9a95-682265242f1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:56:59.789471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a191d08-4e6d-45c8-8923-14cac817a944 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056031 Apr 11 19:56:59.790324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 778/1605] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:56:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:56:59.793341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f01366c8-720c-4806-9a95-682265242f1f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053228 Apr 11 19:56:59.793903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 828/1606] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:56:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:00.009885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-633679e1-83fc-4525-9238-fef74d86fc81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:00.011254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-633679e1-83fc-4525-9238-fef74d86fc81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:00.021887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633679e1-83fc-4525-9238-fef74d86fc81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:00.022640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633679e1-83fc-4525-9238-fef74d86fc81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:00.023906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633679e1-83fc-4525-9238-fef74d86fc81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:00.024673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633679e1-83fc-4525-9238-fef74d86fc81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:00.058009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-633679e1-83fc-4525-9238-fef74d86fc81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054955 Apr 11 19:57:00.058592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 779/1607] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:00.484806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99c6e337-5df1-45a3-a349-ebeed9e8bba6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:00.485851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99c6e337-5df1-45a3-a349-ebeed9e8bba6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:00.492763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99c6e337-5df1-45a3-a349-ebeed9e8bba6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:00.493260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99c6e337-5df1-45a3-a349-ebeed9e8bba6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:00.494055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99c6e337-5df1-45a3-a349-ebeed9e8bba6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:00.494506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99c6e337-5df1-45a3-a349-ebeed9e8bba6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:00.566238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99c6e337-5df1-45a3-a349-ebeed9e8bba6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:00.573882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99c6e337-5df1-45a3-a349-ebeed9e8bba6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.095471 Apr 11 19:57:00.574454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 829/1608] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:00 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:00.805600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a7ae5d08-2ca1-44a4-a84a-a8b46a20c2f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:00.807143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a7ae5d08-2ca1-44a4-a84a-a8b46a20c2f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:00.809162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-164c1af9-220d-44e8-9d79-70053f7ca183 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:00.810647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-164c1af9-220d-44e8-9d79-70053f7ca183 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:00.817073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7ae5d08-2ca1-44a4-a84a-a8b46a20c2f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:00.817526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7ae5d08-2ca1-44a4-a84a-a8b46a20c2f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:00.818293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7ae5d08-2ca1-44a4-a84a-a8b46a20c2f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:00.818544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-164c1af9-220d-44e8-9d79-70053f7ca183 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:00.818708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7ae5d08-2ca1-44a4-a84a-a8b46a20c2f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:00.818996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-164c1af9-220d-44e8-9d79-70053f7ca183 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:00.819754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-164c1af9-220d-44e8-9d79-70053f7ca183 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:00.820181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-164c1af9-220d-44e8-9d79-70053f7ca183 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:00.848452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a7ae5d08-2ca1-44a4-a84a-a8b46a20c2f3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049799 Apr 11 19:57:00.848795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-164c1af9-220d-44e8-9d79-70053f7ca183 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046338 Apr 11 19:57:00.849330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 780/1609] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:00.849507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 830/1610] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:01.075506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64c8eb61-33b5-4001-99bb-4786281ea0da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:01.077003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64c8eb61-33b5-4001-99bb-4786281ea0da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:01.085003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64c8eb61-33b5-4001-99bb-4786281ea0da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:01.085451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64c8eb61-33b5-4001-99bb-4786281ea0da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:01.086215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64c8eb61-33b5-4001-99bb-4786281ea0da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:01.086646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64c8eb61-33b5-4001-99bb-4786281ea0da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:01.115434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64c8eb61-33b5-4001-99bb-4786281ea0da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046748 Apr 11 19:57:01.115979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 781/1611] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:01.595215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-557b12b4-4dee-496e-95ba-449c43937fce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:01.596169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-557b12b4-4dee-496e-95ba-449c43937fce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:01.603036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-557b12b4-4dee-496e-95ba-449c43937fce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:01.603487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-557b12b4-4dee-496e-95ba-449c43937fce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:01.604250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-557b12b4-4dee-496e-95ba-449c43937fce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:01.604682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-557b12b4-4dee-496e-95ba-449c43937fce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:01.666593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-557b12b4-4dee-496e-95ba-449c43937fce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:01.674549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-557b12b4-4dee-496e-95ba-449c43937fce tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085830 Apr 11 19:57:01.675114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 831/1612] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:01 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:01.863524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4dec4184-c682-4e14-b348-ed785a72bb2b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:01.864068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fd15f236-fcd8-45ac-87f6-1764723c0dfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:01.864466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4dec4184-c682-4e14-b348-ed785a72bb2b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:01.864688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fd15f236-fcd8-45ac-87f6-1764723c0dfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:01.870965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd15f236-fcd8-45ac-87f6-1764723c0dfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:01.871164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4dec4184-c682-4e14-b348-ed785a72bb2b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:01.871412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd15f236-fcd8-45ac-87f6-1764723c0dfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:01.871569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4dec4184-c682-4e14-b348-ed785a72bb2b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:01.872212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd15f236-fcd8-45ac-87f6-1764723c0dfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:01.872454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4dec4184-c682-4e14-b348-ed785a72bb2b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:01.872642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd15f236-fcd8-45ac-87f6-1764723c0dfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:01.872799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4dec4184-c682-4e14-b348-ed785a72bb2b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:01.902149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4dec4184-c682-4e14-b348-ed785a72bb2b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Apr 11 19:57:01.902444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fd15f236-fcd8-45ac-87f6-1764723c0dfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043922 Apr 11 19:57:01.902714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 782/1613] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:01.903217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 832/1614] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:02.131741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d735a42-d7f1-42d1-b486-1e4c5604068c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:02.133113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d735a42-d7f1-42d1-b486-1e4c5604068c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:02.143340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d735a42-d7f1-42d1-b486-1e4c5604068c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:02.143793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d735a42-d7f1-42d1-b486-1e4c5604068c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:02.144545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d735a42-d7f1-42d1-b486-1e4c5604068c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:02.145012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d735a42-d7f1-42d1-b486-1e4c5604068c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:02.173915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d735a42-d7f1-42d1-b486-1e4c5604068c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049120 Apr 11 19:57:02.174481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 783/1615] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:02.695673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-11dfa1cf-9bdc-44cd-ae04-004da57b69ff tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:02.696661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-11dfa1cf-9bdc-44cd-ae04-004da57b69ff tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:02.706189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11dfa1cf-9bdc-44cd-ae04-004da57b69ff tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:02.706630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11dfa1cf-9bdc-44cd-ae04-004da57b69ff tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:02.707375 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11dfa1cf-9bdc-44cd-ae04-004da57b69ff tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:02.707799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11dfa1cf-9bdc-44cd-ae04-004da57b69ff tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:02.783683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-11dfa1cf-9bdc-44cd-ae04-004da57b69ff tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:02.791205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-11dfa1cf-9bdc-44cd-ae04-004da57b69ff tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.102254 Apr 11 19:57:02.791753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 833/1616] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:02 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:02.917759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5b763be9-b03a-44b7-a8c5-937d6de35f56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:02.918604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1955acce-2ba0-4835-93bf-b21e4b388464 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:02.919205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5b763be9-b03a-44b7-a8c5-937d6de35f56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:02.919359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1955acce-2ba0-4835-93bf-b21e4b388464 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:02.927196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b763be9-b03a-44b7-a8c5-937d6de35f56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:02.927484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1955acce-2ba0-4835-93bf-b21e4b388464 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:02.927661 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b763be9-b03a-44b7-a8c5-937d6de35f56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:02.927931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1955acce-2ba0-4835-93bf-b21e4b388464 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:02.928401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b763be9-b03a-44b7-a8c5-937d6de35f56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:02.928692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1955acce-2ba0-4835-93bf-b21e4b388464 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:02.928837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b763be9-b03a-44b7-a8c5-937d6de35f56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:02.929285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1955acce-2ba0-4835-93bf-b21e4b388464 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:02.958213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5b763be9-b03a-44b7-a8c5-937d6de35f56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047163 Apr 11 19:57:02.958687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1955acce-2ba0-4835-93bf-b21e4b388464 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047518 Apr 11 19:57:02.958826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 784/1617] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:02.959269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 834/1618] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:03.189972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-78f76b8c-97f1-4375-9ae3-77c444e4988d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:03.190905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-78f76b8c-97f1-4375-9ae3-77c444e4988d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:03.197663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78f76b8c-97f1-4375-9ae3-77c444e4988d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:03.198113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78f76b8c-97f1-4375-9ae3-77c444e4988d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:03.198887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78f76b8c-97f1-4375-9ae3-77c444e4988d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:03.199309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78f76b8c-97f1-4375-9ae3-77c444e4988d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:03.227254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-78f76b8c-97f1-4375-9ae3-77c444e4988d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Apr 11 19:57:03.227816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 785/1619] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:03.812423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3f9f9191-cf0b-4512-8b54-c06a870d30f4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:03.813514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3f9f9191-cf0b-4512-8b54-c06a870d30f4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:03.820246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f9f9191-cf0b-4512-8b54-c06a870d30f4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:03.820678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f9f9191-cf0b-4512-8b54-c06a870d30f4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:03.821473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f9f9191-cf0b-4512-8b54-c06a870d30f4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:03.821880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f9f9191-cf0b-4512-8b54-c06a870d30f4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:03.890848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f9f9191-cf0b-4512-8b54-c06a870d30f4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:03.898684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3f9f9191-cf0b-4512-8b54-c06a870d30f4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092891 Apr 11 19:57:03.899216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 835/1620] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:03 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:03.972432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-473320b9-b66c-4a51-9911-8b6a0b7fc678 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:03.973047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fe93d0f7-95f1-4f3a-8caf-fd736964b731 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:03.973542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-473320b9-b66c-4a51-9911-8b6a0b7fc678 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:03.973699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fe93d0f7-95f1-4f3a-8caf-fd736964b731 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:03.980345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-473320b9-b66c-4a51-9911-8b6a0b7fc678 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:03.980797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-473320b9-b66c-4a51-9911-8b6a0b7fc678 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:03.981169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe93d0f7-95f1-4f3a-8caf-fd736964b731 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:03.981584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-473320b9-b66c-4a51-9911-8b6a0b7fc678 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:03.981689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe93d0f7-95f1-4f3a-8caf-fd736964b731 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:03.982024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-473320b9-b66c-4a51-9911-8b6a0b7fc678 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:03.982434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe93d0f7-95f1-4f3a-8caf-fd736964b731 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:03.982870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe93d0f7-95f1-4f3a-8caf-fd736964b731 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:04.016741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-473320b9-b66c-4a51-9911-8b6a0b7fc678 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049618 Apr 11 19:57:04.017293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fe93d0f7-95f1-4f3a-8caf-fd736964b731 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049422 Apr 11 19:57:04.021097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 786/1621] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:04.021376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 836/1622] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:04.239873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fce4b617-a740-49d2-804b-54b6418b1301 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:04.240794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fce4b617-a740-49d2-804b-54b6418b1301 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:04.247619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fce4b617-a740-49d2-804b-54b6418b1301 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:04.248090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fce4b617-a740-49d2-804b-54b6418b1301 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:04.248830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fce4b617-a740-49d2-804b-54b6418b1301 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:04.249280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fce4b617-a740-49d2-804b-54b6418b1301 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:04.278330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fce4b617-a740-49d2-804b-54b6418b1301 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Apr 11 19:57:04.278860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 787/1623] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:04.919764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-79743c0a-fc66-4e29-aeaa-964e784af659 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:04.920288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-79743c0a-fc66-4e29-aeaa-964e784af659 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:04.926731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79743c0a-fc66-4e29-aeaa-964e784af659 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:04.927180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79743c0a-fc66-4e29-aeaa-964e784af659 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:04.927944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79743c0a-fc66-4e29-aeaa-964e784af659 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:04.928372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79743c0a-fc66-4e29-aeaa-964e784af659 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:04.989065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-79743c0a-fc66-4e29-aeaa-964e784af659 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:04.997087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-79743c0a-fc66-4e29-aeaa-964e784af659 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081317 Apr 11 19:57:04.997673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 837/1624] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:04 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:05.030570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-582ddaeb-fe11-4c43-8fea-6c8e7ef86dc5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:05.031676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-12a4f230-25c3-422a-b0b5-179e6789a033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:05.032022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-582ddaeb-fe11-4c43-8fea-6c8e7ef86dc5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:05.033079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-12a4f230-25c3-422a-b0b5-179e6789a033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:05.041148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-582ddaeb-fe11-4c43-8fea-6c8e7ef86dc5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:05.041847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-582ddaeb-fe11-4c43-8fea-6c8e7ef86dc5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:05.042013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12a4f230-25c3-422a-b0b5-179e6789a033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:05.042669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12a4f230-25c3-422a-b0b5-179e6789a033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:05.043069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-582ddaeb-fe11-4c43-8fea-6c8e7ef86dc5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:05.043800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-582ddaeb-fe11-4c43-8fea-6c8e7ef86dc5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:05.043946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12a4f230-25c3-422a-b0b5-179e6789a033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:05.044521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12a4f230-25c3-422a-b0b5-179e6789a033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:05.087182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-582ddaeb-fe11-4c43-8fea-6c8e7ef86dc5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063116 Apr 11 19:57:05.087753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 788/1625] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:57:05.088359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-12a4f230-25c3-422a-b0b5-179e6789a033 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063183 Apr 11 19:57:05.089022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 838/1626] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:05.293664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ff71ba8-8483-4753-aeab-ad3faf6ef26a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:05.295161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ff71ba8-8483-4753-aeab-ad3faf6ef26a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:05.305812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ff71ba8-8483-4753-aeab-ad3faf6ef26a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:05.306555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ff71ba8-8483-4753-aeab-ad3faf6ef26a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:05.307729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ff71ba8-8483-4753-aeab-ad3faf6ef26a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:05.308428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ff71ba8-8483-4753-aeab-ad3faf6ef26a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:05.338976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ff71ba8-8483-4753-aeab-ad3faf6ef26a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051696 Apr 11 19:57:05.339524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 789/1627] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:06.018604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-953f9fb1-4445-4bbf-a233-850c2d805758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:06.019596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-953f9fb1-4445-4bbf-a233-850c2d805758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:06.030231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-953f9fb1-4445-4bbf-a233-850c2d805758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:06.030964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-953f9fb1-4445-4bbf-a233-850c2d805758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:06.032204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-953f9fb1-4445-4bbf-a233-850c2d805758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:06.032953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-953f9fb1-4445-4bbf-a233-850c2d805758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:06.094229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-953f9fb1-4445-4bbf-a233-850c2d805758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:06.099081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-437070cd-973d-43bf-af18-4748bf732ffa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:06.100006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-437070cd-973d-43bf-af18-4748bf732ffa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:06.102143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-953f9fb1-4445-4bbf-a233-850c2d805758 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090140 Apr 11 19:57:06.102713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 839/1628] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:06 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:06.111298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-437070cd-973d-43bf-af18-4748bf732ffa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:06.111298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-437070cd-973d-43bf-af18-4748bf732ffa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:06.111519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-38698742-99fd-42ca-b29f-f896365411de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:06.111616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-437070cd-973d-43bf-af18-4748bf732ffa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:06.111616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-437070cd-973d-43bf-af18-4748bf732ffa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:06.111817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-38698742-99fd-42ca-b29f-f896365411de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:06.113889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38698742-99fd-42ca-b29f-f896365411de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:06.114323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38698742-99fd-42ca-b29f-f896365411de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:06.115358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38698742-99fd-42ca-b29f-f896365411de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:06.115489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38698742-99fd-42ca-b29f-f896365411de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:06.136375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-437070cd-973d-43bf-af18-4748bf732ffa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041167 Apr 11 19:57:06.136953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 790/1629] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:06.144637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-38698742-99fd-42ca-b29f-f896365411de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040894 Apr 11 19:57:06.145192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 840/1630] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:06.354947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f48b8a4b-5554-45b1-aa1e-f220ecc5dd47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:06.356365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f48b8a4b-5554-45b1-aa1e-f220ecc5dd47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:06.364849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f48b8a4b-5554-45b1-aa1e-f220ecc5dd47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:06.365329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f48b8a4b-5554-45b1-aa1e-f220ecc5dd47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:06.366093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f48b8a4b-5554-45b1-aa1e-f220ecc5dd47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:06.366529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f48b8a4b-5554-45b1-aa1e-f220ecc5dd47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:06.395391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f48b8a4b-5554-45b1-aa1e-f220ecc5dd47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047272 Apr 11 19:57:06.395980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 791/1631] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:07.125847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59348cd8-c52b-4862-bebf-12700c813406 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:07.127700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59348cd8-c52b-4862-bebf-12700c813406 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:07.138521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59348cd8-c52b-4862-bebf-12700c813406 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:07.139261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59348cd8-c52b-4862-bebf-12700c813406 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:07.140532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59348cd8-c52b-4862-bebf-12700c813406 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:07.141333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59348cd8-c52b-4862-bebf-12700c813406 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:07.148438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-afccb56b-f238-4014-997a-802b8df8a518 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:07.150932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-afccb56b-f238-4014-997a-802b8df8a518 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:07.156892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afccb56b-f238-4014-997a-802b8df8a518 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:07.157403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afccb56b-f238-4014-997a-802b8df8a518 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:07.158161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afccb56b-f238-4014-997a-802b8df8a518 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:07.158586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afccb56b-f238-4014-997a-802b8df8a518 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:07.188310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-afccb56b-f238-4014-997a-802b8df8a518 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Apr 11 19:57:07.188990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 792/1632] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:07.194160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82b0760d-221e-4e01-a4db-e2086f3b20d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:07.195079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82b0760d-221e-4e01-a4db-e2086f3b20d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:07.201154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82b0760d-221e-4e01-a4db-e2086f3b20d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:07.201614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82b0760d-221e-4e01-a4db-e2086f3b20d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:07.202381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82b0760d-221e-4e01-a4db-e2086f3b20d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:07.202819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82b0760d-221e-4e01-a4db-e2086f3b20d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:07.209211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-59348cd8-c52b-4862-bebf-12700c813406 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:07.216829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59348cd8-c52b-4862-bebf-12700c813406 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.100538 Apr 11 19:57:07.217454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 841/1633] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:07 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:07.232441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82b0760d-221e-4e01-a4db-e2086f3b20d0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041996 Apr 11 19:57:07.233029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 793/1634] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:07.411306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7073d22c-c027-469b-a6ea-dd62acb7b330 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:07.412665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7073d22c-c027-469b-a6ea-dd62acb7b330 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:07.422811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7073d22c-c027-469b-a6ea-dd62acb7b330 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:07.423554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7073d22c-c027-469b-a6ea-dd62acb7b330 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:07.424499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7073d22c-c027-469b-a6ea-dd62acb7b330 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:07.424938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7073d22c-c027-469b-a6ea-dd62acb7b330 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:07.452945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7073d22c-c027-469b-a6ea-dd62acb7b330 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048407 Apr 11 19:57:07.453522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 842/1635] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:08.202437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e6a67abc-fa32-4915-b5c1-4e246f75bde4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:08.203619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e6a67abc-fa32-4915-b5c1-4e246f75bde4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:08.213198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6a67abc-fa32-4915-b5c1-4e246f75bde4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:08.213821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6a67abc-fa32-4915-b5c1-4e246f75bde4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:08.214881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6a67abc-fa32-4915-b5c1-4e246f75bde4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:08.215500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6a67abc-fa32-4915-b5c1-4e246f75bde4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:08.233566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-171dc5aa-4c12-4163-a6fc-97354a14aea3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:08.234179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-171dc5aa-4c12-4163-a6fc-97354a14aea3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:08.240872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-171dc5aa-4c12-4163-a6fc-97354a14aea3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:08.241389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-171dc5aa-4c12-4163-a6fc-97354a14aea3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:08.242169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-171dc5aa-4c12-4163-a6fc-97354a14aea3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:08.242600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-171dc5aa-4c12-4163-a6fc-97354a14aea3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:08.248071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e6a67abc-fa32-4915-b5c1-4e246f75bde4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051670 Apr 11 19:57:08.248643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 794/1636] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:08.256030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9bc1cbd1-4398-4f0c-a0ef-49c3dd2f542d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:08.256959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9bc1cbd1-4398-4f0c-a0ef-49c3dd2f542d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:08.262790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9bc1cbd1-4398-4f0c-a0ef-49c3dd2f542d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:08.263233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9bc1cbd1-4398-4f0c-a0ef-49c3dd2f542d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:08.263984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9bc1cbd1-4398-4f0c-a0ef-49c3dd2f542d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:08.264410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9bc1cbd1-4398-4f0c-a0ef-49c3dd2f542d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:08.293276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9bc1cbd1-4398-4f0c-a0ef-49c3dd2f542d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043543 Apr 11 19:57:08.293844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 795/1637] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:08.302659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-171dc5aa-4c12-4163-a6fc-97354a14aea3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:08.310075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-171dc5aa-4c12-4163-a6fc-97354a14aea3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080333 Apr 11 19:57:08.310632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 843/1638] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:08 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:08.468677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ed33fa9-b4de-418a-95c0-71bfd35f7012 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:08.470294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ed33fa9-b4de-418a-95c0-71bfd35f7012 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:08.477384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ed33fa9-b4de-418a-95c0-71bfd35f7012 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:08.477871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ed33fa9-b4de-418a-95c0-71bfd35f7012 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:08.478700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ed33fa9-b4de-418a-95c0-71bfd35f7012 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:08.479197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ed33fa9-b4de-418a-95c0-71bfd35f7012 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:08.509786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ed33fa9-b4de-418a-95c0-71bfd35f7012 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047734 Apr 11 19:57:08.510330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 796/1639] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:09.264205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd5f7dbe-2ce9-4ff7-95b5-4cbe773486d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:09.265788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd5f7dbe-2ce9-4ff7-95b5-4cbe773486d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:09.276398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd5f7dbe-2ce9-4ff7-95b5-4cbe773486d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:09.277189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd5f7dbe-2ce9-4ff7-95b5-4cbe773486d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:09.278526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd5f7dbe-2ce9-4ff7-95b5-4cbe773486d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:09.279230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd5f7dbe-2ce9-4ff7-95b5-4cbe773486d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:09.304939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ad7e44cf-7e18-485c-a2f8-2a1f675df79a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:09.305888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ad7e44cf-7e18-485c-a2f8-2a1f675df79a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:09.309959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd5f7dbe-2ce9-4ff7-95b5-4cbe773486d0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052228 Apr 11 19:57:09.310684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 844/1640] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:09.312509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad7e44cf-7e18-485c-a2f8-2a1f675df79a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:09.312959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad7e44cf-7e18-485c-a2f8-2a1f675df79a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:09.313744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad7e44cf-7e18-485c-a2f8-2a1f675df79a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:09.314229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad7e44cf-7e18-485c-a2f8-2a1f675df79a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:09.326554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-937e0ca1-7202-45a9-bf74-793dcaf31315 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:09.327157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-937e0ca1-7202-45a9-bf74-793dcaf31315 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:09.333406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-937e0ca1-7202-45a9-bf74-793dcaf31315 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:09.333853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-937e0ca1-7202-45a9-bf74-793dcaf31315 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:09.334611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-937e0ca1-7202-45a9-bf74-793dcaf31315 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:09.335037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-937e0ca1-7202-45a9-bf74-793dcaf31315 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:09.343430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ad7e44cf-7e18-485c-a2f8-2a1f675df79a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042445 Apr 11 19:57:09.343991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 797/1641] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:09.396106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-937e0ca1-7202-45a9-bf74-793dcaf31315 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:09.403657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-937e0ca1-7202-45a9-bf74-793dcaf31315 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080750 Apr 11 19:57:09.404216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 845/1642] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:09 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:09.525264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-308ca95f-2554-4a4c-88e1-70a3fba1742d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:09.526645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-308ca95f-2554-4a4c-88e1-70a3fba1742d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:09.537200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-308ca95f-2554-4a4c-88e1-70a3fba1742d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:09.537911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-308ca95f-2554-4a4c-88e1-70a3fba1742d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:09.539167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-308ca95f-2554-4a4c-88e1-70a3fba1742d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:09.539904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-308ca95f-2554-4a4c-88e1-70a3fba1742d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:09.572738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-308ca95f-2554-4a4c-88e1-70a3fba1742d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054402 Apr 11 19:57:09.573328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 798/1643] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:10.325718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f807012d-82fc-4861-b00e-7950334bb741 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:10.327195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f807012d-82fc-4861-b00e-7950334bb741 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:10.334892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f807012d-82fc-4861-b00e-7950334bb741 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:10.335332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f807012d-82fc-4861-b00e-7950334bb741 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:10.336085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f807012d-82fc-4861-b00e-7950334bb741 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:10.336509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f807012d-82fc-4861-b00e-7950334bb741 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:10.355392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89622fed-3e78-4486-9617-2ff966c56ece tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:10.356321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89622fed-3e78-4486-9617-2ff966c56ece tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:10.362912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89622fed-3e78-4486-9617-2ff966c56ece tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:10.363354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89622fed-3e78-4486-9617-2ff966c56ece tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:10.364107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89622fed-3e78-4486-9617-2ff966c56ece tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:10.364533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89622fed-3e78-4486-9617-2ff966c56ece tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:10.365825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f807012d-82fc-4861-b00e-7950334bb741 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 Apr 11 19:57:10.366375 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 846/1644] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:10.393914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89622fed-3e78-4486-9617-2ff966c56ece tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042448 Apr 11 19:57:10.394428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 799/1645] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:10.427412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2b24961-350e-48fb-a686-d0ea02da4bbf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:10.428020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2b24961-350e-48fb-a686-d0ea02da4bbf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:10.434558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2b24961-350e-48fb-a686-d0ea02da4bbf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:10.435006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2b24961-350e-48fb-a686-d0ea02da4bbf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:10.435764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2b24961-350e-48fb-a686-d0ea02da4bbf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:10.436195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2b24961-350e-48fb-a686-d0ea02da4bbf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:10.496625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2b24961-350e-48fb-a686-d0ea02da4bbf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:10.504601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2b24961-350e-48fb-a686-d0ea02da4bbf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081498 Apr 11 19:57:10.505200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 847/1646] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:10 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:57:10.588494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-647632ce-528c-4393-9241-4ed576ba1d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:10.590016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-647632ce-528c-4393-9241-4ed576ba1d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:10.598570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-647632ce-528c-4393-9241-4ed576ba1d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:10.599017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-647632ce-528c-4393-9241-4ed576ba1d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:10.599766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-647632ce-528c-4393-9241-4ed576ba1d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:10.600193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-647632ce-528c-4393-9241-4ed576ba1d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:10.629063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-647632ce-528c-4393-9241-4ed576ba1d4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Apr 11 19:57:10.629607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 800/1647] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:11.382240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0e8537c6-df3b-4b0e-80fa-10865f059f9c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:11.383674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0e8537c6-df3b-4b0e-80fa-10865f059f9c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:11.394322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e8537c6-df3b-4b0e-80fa-10865f059f9c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:11.395066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e8537c6-df3b-4b0e-80fa-10865f059f9c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:11.396380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e8537c6-df3b-4b0e-80fa-10865f059f9c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:11.397203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e8537c6-df3b-4b0e-80fa-10865f059f9c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:11.410457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a2c06ada-0797-4d50-9e76-4e7208ff8f35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:11.411581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a2c06ada-0797-4d50-9e76-4e7208ff8f35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:11.418206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2c06ada-0797-4d50-9e76-4e7208ff8f35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:11.418659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2c06ada-0797-4d50-9e76-4e7208ff8f35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:11.419417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2c06ada-0797-4d50-9e76-4e7208ff8f35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:11.419852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2c06ada-0797-4d50-9e76-4e7208ff8f35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:11.431219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0e8537c6-df3b-4b0e-80fa-10865f059f9c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055602 Apr 11 19:57:11.431789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 848/1648] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:11.448740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a2c06ada-0797-4d50-9e76-4e7208ff8f35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043717 Apr 11 19:57:11.449251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 801/1649] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:11.530350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-47e5e482-23ba-4bfb-8320-b6c48fc13e2e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:11.531365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-47e5e482-23ba-4bfb-8320-b6c48fc13e2e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:11.538467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47e5e482-23ba-4bfb-8320-b6c48fc13e2e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:11.538924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47e5e482-23ba-4bfb-8320-b6c48fc13e2e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:11.539688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47e5e482-23ba-4bfb-8320-b6c48fc13e2e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:11.540243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47e5e482-23ba-4bfb-8320-b6c48fc13e2e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:11.602143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47e5e482-23ba-4bfb-8320-b6c48fc13e2e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:11.609899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-47e5e482-23ba-4bfb-8320-b6c48fc13e2e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085981 Apr 11 19:57:11.610462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 849/1650] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:11 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:11.643099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2ddf31dc-109c-4145-8a46-b2a55198dc7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:11.644037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2ddf31dc-109c-4145-8a46-b2a55198dc7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:11.650539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ddf31dc-109c-4145-8a46-b2a55198dc7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:11.650986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ddf31dc-109c-4145-8a46-b2a55198dc7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:11.651754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ddf31dc-109c-4145-8a46-b2a55198dc7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:11.652189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ddf31dc-109c-4145-8a46-b2a55198dc7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:11.680787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2ddf31dc-109c-4145-8a46-b2a55198dc7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043807 Apr 11 19:57:11.681373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 802/1651] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:12.447371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66c2fac7-0f53-46b5-aef7-5948cca67d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:12.448771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66c2fac7-0f53-46b5-aef7-5948cca67d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:12.457743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66c2fac7-0f53-46b5-aef7-5948cca67d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:12.458183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66c2fac7-0f53-46b5-aef7-5948cca67d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:12.458932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66c2fac7-0f53-46b5-aef7-5948cca67d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:12.459356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66c2fac7-0f53-46b5-aef7-5948cca67d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:12.460460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c71ca0e3-4891-4afe-845c-e034f4b41b65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:12.461399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c71ca0e3-4891-4afe-845c-e034f4b41b65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:12.467859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c71ca0e3-4891-4afe-845c-e034f4b41b65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:12.468320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c71ca0e3-4891-4afe-845c-e034f4b41b65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:12.469174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c71ca0e3-4891-4afe-845c-e034f4b41b65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:12.469606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c71ca0e3-4891-4afe-845c-e034f4b41b65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:12.488305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66c2fac7-0f53-46b5-aef7-5948cca67d5b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Apr 11 19:57:12.488821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 850/1652] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:12.499128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c71ca0e3-4891-4afe-845c-e034f4b41b65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042582 Apr 11 19:57:12.500008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 803/1653] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:12.631685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9b010743-4f96-4947-8b1f-6d1ca5430100 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:12.632293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9b010743-4f96-4947-8b1f-6d1ca5430100 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:12.638599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b010743-4f96-4947-8b1f-6d1ca5430100 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:12.639040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b010743-4f96-4947-8b1f-6d1ca5430100 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:12.639784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b010743-4f96-4947-8b1f-6d1ca5430100 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:12.640212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b010743-4f96-4947-8b1f-6d1ca5430100 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:12.692105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6124ded8-1242-43fd-bdc3-90c7cbccc652 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:12.693148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6124ded8-1242-43fd-bdc3-90c7cbccc652 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:12.699393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6124ded8-1242-43fd-bdc3-90c7cbccc652 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:12.699627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9b010743-4f96-4947-8b1f-6d1ca5430100 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:12.699808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6124ded8-1242-43fd-bdc3-90c7cbccc652 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:12.700535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6124ded8-1242-43fd-bdc3-90c7cbccc652 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:12.700950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6124ded8-1242-43fd-bdc3-90c7cbccc652 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:12.707280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9b010743-4f96-4947-8b1f-6d1ca5430100 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.079454 Apr 11 19:57:12.707835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 851/1654] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:12 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:12.729362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6124ded8-1242-43fd-bdc3-90c7cbccc652 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041275 Apr 11 19:57:12.729901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 804/1655] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:13.503953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e1587e6-52e5-481a-8856-1d313cce2faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:13.504802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e1587e6-52e5-481a-8856-1d313cce2faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:13.511245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a4538a8e-d651-40f6-b867-b86c9e8dc694 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:13.511738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e1587e6-52e5-481a-8856-1d313cce2faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:13.511903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e1587e6-52e5-481a-8856-1d313cce2faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:13.512166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a4538a8e-d651-40f6-b867-b86c9e8dc694 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:13.512698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e1587e6-52e5-481a-8856-1d313cce2faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:13.513165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e1587e6-52e5-481a-8856-1d313cce2faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:13.518714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4538a8e-d651-40f6-b867-b86c9e8dc694 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:13.519179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4538a8e-d651-40f6-b867-b86c9e8dc694 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:13.519922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4538a8e-d651-40f6-b867-b86c9e8dc694 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:13.520350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4538a8e-d651-40f6-b867-b86c9e8dc694 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:13.542344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e1587e6-52e5-481a-8856-1d313cce2faa tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044283 Apr 11 19:57:13.542914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 852/1656] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:13.548925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a4538a8e-d651-40f6-b867-b86c9e8dc694 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041604 Apr 11 19:57:13.549476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 805/1657] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:13.727538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75a62f5e-d4a4-492e-8fe3-12f4f038cbf4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:13.728535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75a62f5e-d4a4-492e-8fe3-12f4f038cbf4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:13.738620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75a62f5e-d4a4-492e-8fe3-12f4f038cbf4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:13.739364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75a62f5e-d4a4-492e-8fe3-12f4f038cbf4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:13.740680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75a62f5e-d4a4-492e-8fe3-12f4f038cbf4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:13.741455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75a62f5e-d4a4-492e-8fe3-12f4f038cbf4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:13.745294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd268930-d6bf-4f1e-8848-398247ea459a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:13.748997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd268930-d6bf-4f1e-8848-398247ea459a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:13.756371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd268930-d6bf-4f1e-8848-398247ea459a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:13.756564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd268930-d6bf-4f1e-8848-398247ea459a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:13.757543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd268930-d6bf-4f1e-8848-398247ea459a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:13.758128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd268930-d6bf-4f1e-8848-398247ea459a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:13.789259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd268930-d6bf-4f1e-8848-398247ea459a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050923 Apr 11 19:57:13.789830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 806/1658] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:13.806701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-75a62f5e-d4a4-492e-8fe3-12f4f038cbf4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:13.814230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75a62f5e-d4a4-492e-8fe3-12f4f038cbf4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092992 Apr 11 19:57:13.814791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 853/1659] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:13 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:14.558824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02b92e84-fe8f-46ff-80ff-13bb50b05bf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:14.560185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02b92e84-fe8f-46ff-80ff-13bb50b05bf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:14.564409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-336c8d64-4b04-4a9f-a7dc-74fff498c4ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:14.565498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-336c8d64-4b04-4a9f-a7dc-74fff498c4ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:14.568426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02b92e84-fe8f-46ff-80ff-13bb50b05bf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:14.568875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02b92e84-fe8f-46ff-80ff-13bb50b05bf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:14.569673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02b92e84-fe8f-46ff-80ff-13bb50b05bf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:14.570108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02b92e84-fe8f-46ff-80ff-13bb50b05bf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:14.571965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-336c8d64-4b04-4a9f-a7dc-74fff498c4ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:14.572387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-336c8d64-4b04-4a9f-a7dc-74fff498c4ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:14.573257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-336c8d64-4b04-4a9f-a7dc-74fff498c4ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:14.573685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-336c8d64-4b04-4a9f-a7dc-74fff498c4ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:14.601510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02b92e84-fe8f-46ff-80ff-13bb50b05bf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049850 Apr 11 19:57:14.602225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 807/1660] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:14.602690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-336c8d64-4b04-4a9f-a7dc-74fff498c4ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044873 Apr 11 19:57:14.603243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 854/1661] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:14.805198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a9d7c248-b42e-4a2d-b96c-d1abf1c86a16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:14.806678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a9d7c248-b42e-4a2d-b96c-d1abf1c86a16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:14.816761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9d7c248-b42e-4a2d-b96c-d1abf1c86a16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:14.817464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9d7c248-b42e-4a2d-b96c-d1abf1c86a16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:14.818703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9d7c248-b42e-4a2d-b96c-d1abf1c86a16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:14.819414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9d7c248-b42e-4a2d-b96c-d1abf1c86a16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:14.833195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8a6fb061-2a23-4279-bf0d-70cadba23f54 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:14.833797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8a6fb061-2a23-4279-bf0d-70cadba23f54 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:14.839996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a6fb061-2a23-4279-bf0d-70cadba23f54 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:14.840449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a6fb061-2a23-4279-bf0d-70cadba23f54 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:14.841233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a6fb061-2a23-4279-bf0d-70cadba23f54 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:14.841665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a6fb061-2a23-4279-bf0d-70cadba23f54 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:14.854492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a9d7c248-b42e-4a2d-b96c-d1abf1c86a16 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055966 Apr 11 19:57:14.855031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 808/1662] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:14.902508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a6fb061-2a23-4279-bf0d-70cadba23f54 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:14.914723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8a6fb061-2a23-4279-bf0d-70cadba23f54 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085763 Apr 11 19:57:14.915404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 855/1663] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:14 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:15.615511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-85ffc464-916e-40c6-8aea-391272f8b417 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:15.616065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0596379b-b8c4-4d13-9ece-589e612cc481 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:15.616426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-85ffc464-916e-40c6-8aea-391272f8b417 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:15.616521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0596379b-b8c4-4d13-9ece-589e612cc481 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:15.622881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85ffc464-916e-40c6-8aea-391272f8b417 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:15.623066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0596379b-b8c4-4d13-9ece-589e612cc481 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:15.623322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85ffc464-916e-40c6-8aea-391272f8b417 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:15.623479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0596379b-b8c4-4d13-9ece-589e612cc481 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:15.624082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85ffc464-916e-40c6-8aea-391272f8b417 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:15.624243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0596379b-b8c4-4d13-9ece-589e612cc481 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:15.624505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85ffc464-916e-40c6-8aea-391272f8b417 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:15.625006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0596379b-b8c4-4d13-9ece-589e612cc481 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:15.654317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0596379b-b8c4-4d13-9ece-589e612cc481 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043039 Apr 11 19:57:15.654578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-85ffc464-916e-40c6-8aea-391272f8b417 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Apr 11 19:57:15.655079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 809/1665] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:15.655236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 856/1665] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:15.870321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c0918a10-af69-4787-b6b3-adf2a3a9d77c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:15.871672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c0918a10-af69-4787-b6b3-adf2a3a9d77c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:15.880314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0918a10-af69-4787-b6b3-adf2a3a9d77c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:15.880760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0918a10-af69-4787-b6b3-adf2a3a9d77c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:15.881532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0918a10-af69-4787-b6b3-adf2a3a9d77c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:15.881987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0918a10-af69-4787-b6b3-adf2a3a9d77c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:15.913559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c0918a10-af69-4787-b6b3-adf2a3a9d77c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049824 Apr 11 19:57:15.914133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 810/1666] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:15.934791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc5d7eb0-2b44-4553-a179-1bea8b5acdb8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:15.935423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc5d7eb0-2b44-4553-a179-1bea8b5acdb8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:15.941579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc5d7eb0-2b44-4553-a179-1bea8b5acdb8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:15.942032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc5d7eb0-2b44-4553-a179-1bea8b5acdb8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:15.942791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc5d7eb0-2b44-4553-a179-1bea8b5acdb8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:15.943226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc5d7eb0-2b44-4553-a179-1bea8b5acdb8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:16.006272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc5d7eb0-2b44-4553-a179-1bea8b5acdb8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:16.013956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc5d7eb0-2b44-4553-a179-1bea8b5acdb8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083065 Apr 11 19:57:16.014520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 857/1667] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:15 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:16.670088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-87834736-5616-4c01-b3da-fae55f5ccf84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:16.670937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9e9e9f4a-b47b-4adc-a870-d110f01789cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:16.671587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-87834736-5616-4c01-b3da-fae55f5ccf84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:16.671882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9e9e9f4a-b47b-4adc-a870-d110f01789cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:16.682442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87834736-5616-4c01-b3da-fae55f5ccf84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:16.682762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e9e9f4a-b47b-4adc-a870-d110f01789cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:16.683175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87834736-5616-4c01-b3da-fae55f5ccf84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:16.683445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e9e9f4a-b47b-4adc-a870-d110f01789cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:16.684433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87834736-5616-4c01-b3da-fae55f5ccf84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:16.684681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e9e9f4a-b47b-4adc-a870-d110f01789cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:16.685221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87834736-5616-4c01-b3da-fae55f5ccf84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:16.685502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e9e9f4a-b47b-4adc-a870-d110f01789cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:16.716012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9e9e9f4a-b47b-4adc-a870-d110f01789cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052403 Apr 11 19:57:16.716271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-87834736-5616-4c01-b3da-fae55f5ccf84 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052464 Apr 11 19:57:16.716569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 858/1668] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:16.717262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 811/1669] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:16.928766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6c9296bb-41d7-4af5-8f19-f2db2ae8f823 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:16.930009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6c9296bb-41d7-4af5-8f19-f2db2ae8f823 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:16.938237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c9296bb-41d7-4af5-8f19-f2db2ae8f823 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:16.938826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c9296bb-41d7-4af5-8f19-f2db2ae8f823 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:16.939820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c9296bb-41d7-4af5-8f19-f2db2ae8f823 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:16.940383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c9296bb-41d7-4af5-8f19-f2db2ae8f823 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:16.971939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6c9296bb-41d7-4af5-8f19-f2db2ae8f823 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048815 Apr 11 19:57:16.972489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 859/1670] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:17.034869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-27a00e18-63b2-4345-b93a-4baa3143214a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:17.035868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-27a00e18-63b2-4345-b93a-4baa3143214a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:17.045976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27a00e18-63b2-4345-b93a-4baa3143214a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:17.046708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27a00e18-63b2-4345-b93a-4baa3143214a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:17.047968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27a00e18-63b2-4345-b93a-4baa3143214a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:17.048726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27a00e18-63b2-4345-b93a-4baa3143214a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:17.107329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-27a00e18-63b2-4345-b93a-4baa3143214a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:17.114869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-27a00e18-63b2-4345-b93a-4baa3143214a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086562 Apr 11 19:57:17.115434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 812/1671] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:17 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:17.732315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8126cee-3e08-43a4-a896-52bcbb7e0cb2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:17.733855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-88fe5466-9ead-4f91-bb1b-e52245476e1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:17.734610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8126cee-3e08-43a4-a896-52bcbb7e0cb2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:17.735357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-88fe5466-9ead-4f91-bb1b-e52245476e1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:17.741341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8126cee-3e08-43a4-a896-52bcbb7e0cb2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:17.741781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8126cee-3e08-43a4-a896-52bcbb7e0cb2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:17.742430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88fe5466-9ead-4f91-bb1b-e52245476e1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:17.742545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8126cee-3e08-43a4-a896-52bcbb7e0cb2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:17.742876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88fe5466-9ead-4f91-bb1b-e52245476e1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:17.743043 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8126cee-3e08-43a4-a896-52bcbb7e0cb2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:17.743660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88fe5466-9ead-4f91-bb1b-e52245476e1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:17.744092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88fe5466-9ead-4f91-bb1b-e52245476e1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:17.774106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-88fe5466-9ead-4f91-bb1b-e52245476e1a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046906 Apr 11 19:57:17.774875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 813/1672] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:17.777259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8126cee-3e08-43a4-a896-52bcbb7e0cb2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051702 Apr 11 19:57:17.777797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 860/1673] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:17.988363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fa2ec2a6-cd4f-4f93-b114-c1c4e99ebcee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:17.989780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fa2ec2a6-cd4f-4f93-b114-c1c4e99ebcee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:18.000277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa2ec2a6-cd4f-4f93-b114-c1c4e99ebcee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:18.001076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa2ec2a6-cd4f-4f93-b114-c1c4e99ebcee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:18.002127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa2ec2a6-cd4f-4f93-b114-c1c4e99ebcee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:18.002553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa2ec2a6-cd4f-4f93-b114-c1c4e99ebcee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:18.030202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fa2ec2a6-cd4f-4f93-b114-c1c4e99ebcee tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048476 Apr 11 19:57:18.030742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 814/1674] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:18.135463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d335b362-3b17-4526-b795-3d18f80a731f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:18.136450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d335b362-3b17-4526-b795-3d18f80a731f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:18.146515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d335b362-3b17-4526-b795-3d18f80a731f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:18.147628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d335b362-3b17-4526-b795-3d18f80a731f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:18.149533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d335b362-3b17-4526-b795-3d18f80a731f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:18.150602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d335b362-3b17-4526-b795-3d18f80a731f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:18.230966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d335b362-3b17-4526-b795-3d18f80a731f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:18.238909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d335b362-3b17-4526-b795-3d18f80a731f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.109779 Apr 11 19:57:18.239409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 861/1675] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:18 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:18.786600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fdecdf4c-e4a8-4280-8695-b2157be8b628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:18.787524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fdecdf4c-e4a8-4280-8695-b2157be8b628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:18.788937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-10d6877c-10fd-4899-b565-730c645b4497 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:18.789887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-10d6877c-10fd-4899-b565-730c645b4497 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:18.794219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fdecdf4c-e4a8-4280-8695-b2157be8b628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:18.794664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fdecdf4c-e4a8-4280-8695-b2157be8b628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:18.795435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fdecdf4c-e4a8-4280-8695-b2157be8b628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:18.795896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fdecdf4c-e4a8-4280-8695-b2157be8b628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:18.796502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10d6877c-10fd-4899-b565-730c645b4497 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:18.796937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10d6877c-10fd-4899-b565-730c645b4497 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:18.797723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10d6877c-10fd-4899-b565-730c645b4497 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:18.798144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10d6877c-10fd-4899-b565-730c645b4497 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:18.825176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fdecdf4c-e4a8-4280-8695-b2157be8b628 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042739 Apr 11 19:57:18.825741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 815/1676] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:18.826857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-10d6877c-10fd-4899-b565-730c645b4497 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041804 Apr 11 19:57:18.827419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 862/1677] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:19.042076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-15c5fa40-57bb-42de-9651-b4e2f5ef43e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:19.043085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-15c5fa40-57bb-42de-9651-b4e2f5ef43e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:19.049598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15c5fa40-57bb-42de-9651-b4e2f5ef43e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:19.050054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15c5fa40-57bb-42de-9651-b4e2f5ef43e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:19.050829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15c5fa40-57bb-42de-9651-b4e2f5ef43e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:19.051256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15c5fa40-57bb-42de-9651-b4e2f5ef43e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:19.080307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-15c5fa40-57bb-42de-9651-b4e2f5ef43e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042262 Apr 11 19:57:19.080864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 816/1678] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:19.259713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-63226f62-a2cb-4a80-822f-0a869d151134 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:19.260885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-63226f62-a2cb-4a80-822f-0a869d151134 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:19.271287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63226f62-a2cb-4a80-822f-0a869d151134 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:19.272081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63226f62-a2cb-4a80-822f-0a869d151134 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:19.273477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63226f62-a2cb-4a80-822f-0a869d151134 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:19.274074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63226f62-a2cb-4a80-822f-0a869d151134 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:19.342518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63226f62-a2cb-4a80-822f-0a869d151134 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:19.350901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-63226f62-a2cb-4a80-822f-0a869d151134 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.097615 Apr 11 19:57:19.351468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 863/1679] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:19 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:19.840581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-27c265e5-1e11-449b-846e-4593924389b5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:19.842118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-27c265e5-1e11-449b-846e-4593924389b5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:19.842549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9149ceea-6e14-462d-8767-69424cfecb97 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:19.844084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9149ceea-6e14-462d-8767-69424cfecb97 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:19.852787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27c265e5-1e11-449b-846e-4593924389b5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:19.853574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27c265e5-1e11-449b-846e-4593924389b5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:19.854549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9149ceea-6e14-462d-8767-69424cfecb97 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:19.854818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27c265e5-1e11-449b-846e-4593924389b5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:19.855329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9149ceea-6e14-462d-8767-69424cfecb97 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:19.855576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27c265e5-1e11-449b-846e-4593924389b5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:19.856570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9149ceea-6e14-462d-8767-69424cfecb97 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:19.857344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9149ceea-6e14-462d-8767-69424cfecb97 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:19.887138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-27c265e5-1e11-449b-846e-4593924389b5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053066 Apr 11 19:57:19.887707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 817/1680] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:19.888591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9149ceea-6e14-462d-8767-69424cfecb97 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052569 Apr 11 19:57:19.889202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 864/1681] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:20.096157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d973ea37-b936-42cc-b2e5-5a9dc9096779 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:20.097584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d973ea37-b936-42cc-b2e5-5a9dc9096779 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:20.107594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d973ea37-b936-42cc-b2e5-5a9dc9096779 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:20.108335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d973ea37-b936-42cc-b2e5-5a9dc9096779 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:20.109649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d973ea37-b936-42cc-b2e5-5a9dc9096779 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:20.110357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d973ea37-b936-42cc-b2e5-5a9dc9096779 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:20.140479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d973ea37-b936-42cc-b2e5-5a9dc9096779 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051005 Apr 11 19:57:20.141069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 818/1682] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:20.371883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1b28cc48-14a5-4c19-8fc5-9be97d50cd63 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:20.372773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1b28cc48-14a5-4c19-8fc5-9be97d50cd63 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:20.380936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b28cc48-14a5-4c19-8fc5-9be97d50cd63 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:20.381400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b28cc48-14a5-4c19-8fc5-9be97d50cd63 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:20.382153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b28cc48-14a5-4c19-8fc5-9be97d50cd63 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:20.382579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b28cc48-14a5-4c19-8fc5-9be97d50cd63 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:20.453410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1b28cc48-14a5-4c19-8fc5-9be97d50cd63 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:20.460927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1b28cc48-14a5-4c19-8fc5-9be97d50cd63 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.095592 Apr 11 19:57:20.461471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 865/1683] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:20 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:20.900072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e084f9bb-5457-4323-8c27-bec811d4cbd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:20.900780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-76775217-a713-418b-af91-028bf5b2ec69 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:20.901257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e084f9bb-5457-4323-8c27-bec811d4cbd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:20.902060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-76775217-a713-418b-af91-028bf5b2ec69 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:20.907792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e084f9bb-5457-4323-8c27-bec811d4cbd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:20.908239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e084f9bb-5457-4323-8c27-bec811d4cbd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:20.909012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e084f9bb-5457-4323-8c27-bec811d4cbd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:20.909608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e084f9bb-5457-4323-8c27-bec811d4cbd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:20.911783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76775217-a713-418b-af91-028bf5b2ec69 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:20.912443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76775217-a713-418b-af91-028bf5b2ec69 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:20.913586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76775217-a713-418b-af91-028bf5b2ec69 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:20.914240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76775217-a713-418b-af91-028bf5b2ec69 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:20.939027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e084f9bb-5457-4323-8c27-bec811d4cbd5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042787 Apr 11 19:57:20.939598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 866/1684] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:20.952346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-76775217-a713-418b-af91-028bf5b2ec69 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056914 Apr 11 19:57:20.952881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 819/1685] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:21.155886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8019495f-f181-4e18-a48c-d0114c070216 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:21.157304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8019495f-f181-4e18-a48c-d0114c070216 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:21.163562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8019495f-f181-4e18-a48c-d0114c070216 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:21.164019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8019495f-f181-4e18-a48c-d0114c070216 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:21.164771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8019495f-f181-4e18-a48c-d0114c070216 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:21.165227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8019495f-f181-4e18-a48c-d0114c070216 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:21.193918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8019495f-f181-4e18-a48c-d0114c070216 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Apr 11 19:57:21.194479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 867/1686] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:21.482094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a0fcf89f-562f-4d95-9a9b-333fbb7b39f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:21.483096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a0fcf89f-562f-4d95-9a9b-333fbb7b39f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:21.490681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0fcf89f-562f-4d95-9a9b-333fbb7b39f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:21.491133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0fcf89f-562f-4d95-9a9b-333fbb7b39f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:21.491930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0fcf89f-562f-4d95-9a9b-333fbb7b39f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:21.492365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0fcf89f-562f-4d95-9a9b-333fbb7b39f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:21.556461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a0fcf89f-562f-4d95-9a9b-333fbb7b39f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:21.564153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a0fcf89f-562f-4d95-9a9b-333fbb7b39f5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088783 Apr 11 19:57:21.564717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 820/1687] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:21 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:21.955828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-276cc49f-578a-41fb-9912-de0b63810708 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:21.957356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-276cc49f-578a-41fb-9912-de0b63810708 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:21.967849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f79fe40-9cc0-4e97-97c7-457f25327da3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:21.968630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-276cc49f-578a-41fb-9912-de0b63810708 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:21.969133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-276cc49f-578a-41fb-9912-de0b63810708 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:21.969408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f79fe40-9cc0-4e97-97c7-457f25327da3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:21.970458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-276cc49f-578a-41fb-9912-de0b63810708 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:21.970890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-276cc49f-578a-41fb-9912-de0b63810708 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:21.976482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f79fe40-9cc0-4e97-97c7-457f25327da3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:21.976934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f79fe40-9cc0-4e97-97c7-457f25327da3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:21.977703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f79fe40-9cc0-4e97-97c7-457f25327da3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:21.978206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f79fe40-9cc0-4e97-97c7-457f25327da3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:22.000115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-276cc49f-578a-41fb-9912-de0b63810708 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050717 Apr 11 19:57:22.000696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 868/1688] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:22.010070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f79fe40-9cc0-4e97-97c7-457f25327da3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048882 Apr 11 19:57:22.010635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 821/1689] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:22.208036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f3a0f79e-f456-4686-9a55-f47ecbdcb48b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:22.208925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f3a0f79e-f456-4686-9a55-f47ecbdcb48b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:22.215554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3a0f79e-f456-4686-9a55-f47ecbdcb48b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:22.216000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3a0f79e-f456-4686-9a55-f47ecbdcb48b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:22.216762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3a0f79e-f456-4686-9a55-f47ecbdcb48b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:22.217233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3a0f79e-f456-4686-9a55-f47ecbdcb48b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:22.246393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f3a0f79e-f456-4686-9a55-f47ecbdcb48b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 Apr 11 19:57:22.246945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 869/1690] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:22.585350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d174a016-7116-4fbc-847b-3775e973c006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:22.586223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d174a016-7116-4fbc-847b-3775e973c006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:22.596171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d174a016-7116-4fbc-847b-3775e973c006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:22.596618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d174a016-7116-4fbc-847b-3775e973c006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:22.597491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d174a016-7116-4fbc-847b-3775e973c006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:22.597988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d174a016-7116-4fbc-847b-3775e973c006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:22.660150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d174a016-7116-4fbc-847b-3775e973c006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:22.669691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d174a016-7116-4fbc-847b-3775e973c006 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090689 Apr 11 19:57:22.670575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 822/1691] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:22 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:23.012585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e4951e8e-be68-49c6-9d81-72a0edfa91ac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:23.013579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e4951e8e-be68-49c6-9d81-72a0edfa91ac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:23.020388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4951e8e-be68-49c6-9d81-72a0edfa91ac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:23.020835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4951e8e-be68-49c6-9d81-72a0edfa91ac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:23.021631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4951e8e-be68-49c6-9d81-72a0edfa91ac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:23.022063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4951e8e-be68-49c6-9d81-72a0edfa91ac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:23.022349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-13745a0b-532a-4f17-a0ce-2fccfbe0e4a8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:23.023345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-13745a0b-532a-4f17-a0ce-2fccfbe0e4a8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:23.031832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13745a0b-532a-4f17-a0ce-2fccfbe0e4a8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:23.032541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13745a0b-532a-4f17-a0ce-2fccfbe0e4a8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:23.033802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13745a0b-532a-4f17-a0ce-2fccfbe0e4a8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:23.034522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13745a0b-532a-4f17-a0ce-2fccfbe0e4a8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:23.065837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e4951e8e-be68-49c6-9d81-72a0edfa91ac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057179 Apr 11 19:57:23.066732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 870/1692] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:23.078181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-13745a0b-532a-4f17-a0ce-2fccfbe0e4a8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060256 Apr 11 19:57:23.078740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 823/1693] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:23.262698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0972c42c-78ba-4082-be25-b2807767f309 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:23.264137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0972c42c-78ba-4082-be25-b2807767f309 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:23.274327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0972c42c-78ba-4082-be25-b2807767f309 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:23.275078 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0972c42c-78ba-4082-be25-b2807767f309 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:23.276321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0972c42c-78ba-4082-be25-b2807767f309 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:23.277082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0972c42c-78ba-4082-be25-b2807767f309 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:23.313219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0972c42c-78ba-4082-be25-b2807767f309 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057182 Apr 11 19:57:23.313790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 871/1694] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:23.696147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b152b8a1-adb8-4e70-875c-46009a61fdb0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:23.697210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b152b8a1-adb8-4e70-875c-46009a61fdb0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:23.706383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b152b8a1-adb8-4e70-875c-46009a61fdb0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:23.706836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b152b8a1-adb8-4e70-875c-46009a61fdb0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:23.707638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b152b8a1-adb8-4e70-875c-46009a61fdb0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:23.708062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b152b8a1-adb8-4e70-875c-46009a61fdb0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:23.773926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b152b8a1-adb8-4e70-875c-46009a61fdb0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:23.781829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b152b8a1-adb8-4e70-875c-46009a61fdb0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092665 Apr 11 19:57:23.782373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 824/1695] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:23 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:24.084149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd211e0c-5156-4bb7-80c5-e6f6d48bd81d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:24.085641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd211e0c-5156-4bb7-80c5-e6f6d48bd81d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:24.093966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6d325a9c-5cd9-4cbe-bd1a-65c7942e3f62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:24.095628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6d325a9c-5cd9-4cbe-bd1a-65c7942e3f62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:24.095963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd211e0c-5156-4bb7-80c5-e6f6d48bd81d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:24.096410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd211e0c-5156-4bb7-80c5-e6f6d48bd81d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:24.097209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd211e0c-5156-4bb7-80c5-e6f6d48bd81d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:24.097645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd211e0c-5156-4bb7-80c5-e6f6d48bd81d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:24.102193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d325a9c-5cd9-4cbe-bd1a-65c7942e3f62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:24.102624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d325a9c-5cd9-4cbe-bd1a-65c7942e3f62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:24.103385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d325a9c-5cd9-4cbe-bd1a-65c7942e3f62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:24.103808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d325a9c-5cd9-4cbe-bd1a-65c7942e3f62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:24.126654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd211e0c-5156-4bb7-80c5-e6f6d48bd81d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049253 Apr 11 19:57:24.127540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 872/1696] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:24.133475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6d325a9c-5cd9-4cbe-bd1a-65c7942e3f62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046336 Apr 11 19:57:24.134069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 825/1697] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:24.328961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cafa2fd-b867-4777-a176-6f3ae13bd14b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:24.330182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cafa2fd-b867-4777-a176-6f3ae13bd14b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:24.336621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cafa2fd-b867-4777-a176-6f3ae13bd14b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:24.337024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cafa2fd-b867-4777-a176-6f3ae13bd14b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:24.337777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cafa2fd-b867-4777-a176-6f3ae13bd14b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:24.338202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cafa2fd-b867-4777-a176-6f3ae13bd14b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:24.365724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cafa2fd-b867-4777-a176-6f3ae13bd14b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Apr 11 19:57:24.366255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 873/1698] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:24.802461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0454cf3f-322c-461b-bd26-86fbef4ce526 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:24.803252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0454cf3f-322c-461b-bd26-86fbef4ce526 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:24.812279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0454cf3f-322c-461b-bd26-86fbef4ce526 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:24.812968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0454cf3f-322c-461b-bd26-86fbef4ce526 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:24.814218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0454cf3f-322c-461b-bd26-86fbef4ce526 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:24.814647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0454cf3f-322c-461b-bd26-86fbef4ce526 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:24.880195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0454cf3f-322c-461b-bd26-86fbef4ce526 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:24.890316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0454cf3f-322c-461b-bd26-86fbef4ce526 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093803 Apr 11 19:57:24.891234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 826/1699] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:24 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:25.142730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15b13392-44e0-44a2-b841-957d8a261214 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:25.143559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15b13392-44e0-44a2-b841-957d8a261214 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:25.146648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1c23f39e-b40a-46fc-bda8-e958c4be7808 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:25.147652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1c23f39e-b40a-46fc-bda8-e958c4be7808 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:25.150483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15b13392-44e0-44a2-b841-957d8a261214 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:25.150914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15b13392-44e0-44a2-b841-957d8a261214 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:25.151695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15b13392-44e0-44a2-b841-957d8a261214 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:25.152115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15b13392-44e0-44a2-b841-957d8a261214 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:25.154525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c23f39e-b40a-46fc-bda8-e958c4be7808 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:25.154525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c23f39e-b40a-46fc-bda8-e958c4be7808 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:25.155305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c23f39e-b40a-46fc-bda8-e958c4be7808 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:25.155722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c23f39e-b40a-46fc-bda8-e958c4be7808 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:25.182761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15b13392-44e0-44a2-b841-957d8a261214 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046631 Apr 11 19:57:25.183318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 874/1700] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:25.186234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1c23f39e-b40a-46fc-bda8-e958c4be7808 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043572 Apr 11 19:57:25.194496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 827/1701] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:57:25.378050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c30bb2a-57e7-4cb4-8be4-fb12ab996aa3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:25.378962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c30bb2a-57e7-4cb4-8be4-fb12ab996aa3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:25.385380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c30bb2a-57e7-4cb4-8be4-fb12ab996aa3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:25.385825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c30bb2a-57e7-4cb4-8be4-fb12ab996aa3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:25.386574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c30bb2a-57e7-4cb4-8be4-fb12ab996aa3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:25.386999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c30bb2a-57e7-4cb4-8be4-fb12ab996aa3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:25.416518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c30bb2a-57e7-4cb4-8be4-fb12ab996aa3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Apr 11 19:57:25.417001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 875/1702] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:25.918454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1bde235b-2838-4b1e-aa78-d9d4dcaefd81 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:25.919425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1bde235b-2838-4b1e-aa78-d9d4dcaefd81 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:25.928610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bde235b-2838-4b1e-aa78-d9d4dcaefd81 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:25.929300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bde235b-2838-4b1e-aa78-d9d4dcaefd81 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:25.930407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bde235b-2838-4b1e-aa78-d9d4dcaefd81 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:25.931012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bde235b-2838-4b1e-aa78-d9d4dcaefd81 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:26.011033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1bde235b-2838-4b1e-aa78-d9d4dcaefd81 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:26.018632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1bde235b-2838-4b1e-aa78-d9d4dcaefd81 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.106407 Apr 11 19:57:26.019204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 828/1703] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:25 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:26.195191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da12015e-6c0c-43c0-8e16-1be846be081e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:26.196187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da12015e-6c0c-43c0-8e16-1be846be081e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:26.199773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f094005-d33a-4179-ac46-6cea67ae83f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:26.200696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f094005-d33a-4179-ac46-6cea67ae83f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:26.203068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da12015e-6c0c-43c0-8e16-1be846be081e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:26.203518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da12015e-6c0c-43c0-8e16-1be846be081e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:26.204302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da12015e-6c0c-43c0-8e16-1be846be081e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:26.204738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da12015e-6c0c-43c0-8e16-1be846be081e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:26.207321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f094005-d33a-4179-ac46-6cea67ae83f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:26.207780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f094005-d33a-4179-ac46-6cea67ae83f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:26.208552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f094005-d33a-4179-ac46-6cea67ae83f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:26.208980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f094005-d33a-4179-ac46-6cea67ae83f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:26.237826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da12015e-6c0c-43c0-8e16-1be846be081e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046804 Apr 11 19:57:26.241348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 876/1704] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:26.241525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f094005-d33a-4179-ac46-6cea67ae83f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Apr 11 19:57:26.241525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 829/1705] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:57:26.428766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90f0d75d-2986-4522-893e-4e1ad37009cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:26.429712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90f0d75d-2986-4522-893e-4e1ad37009cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:26.436297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90f0d75d-2986-4522-893e-4e1ad37009cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:26.436746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90f0d75d-2986-4522-893e-4e1ad37009cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:26.437577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90f0d75d-2986-4522-893e-4e1ad37009cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:26.438008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90f0d75d-2986-4522-893e-4e1ad37009cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:26.475507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90f0d75d-2986-4522-893e-4e1ad37009cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050621 Apr 11 19:57:26.475994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 877/1706] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:27.035899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f753521d-55bb-47df-8006-2c10b2b1e923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:27.036510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f753521d-55bb-47df-8006-2c10b2b1e923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:27.043041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f753521d-55bb-47df-8006-2c10b2b1e923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:27.043500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f753521d-55bb-47df-8006-2c10b2b1e923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:27.044278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f753521d-55bb-47df-8006-2c10b2b1e923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:27.044712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f753521d-55bb-47df-8006-2c10b2b1e923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:27.109773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f753521d-55bb-47df-8006-2c10b2b1e923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:27.117471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f753521d-55bb-47df-8006-2c10b2b1e923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085629 Apr 11 19:57:27.118090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 830/1707] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:27 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:27.250165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91880a3e-7aaf-4c9b-b719-ff6342db4da3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:27.251869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91880a3e-7aaf-4c9b-b719-ff6342db4da3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:27.252271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-234e8cc3-2462-4930-b71d-908b04faf3ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:27.253253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-234e8cc3-2462-4930-b71d-908b04faf3ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:27.258534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91880a3e-7aaf-4c9b-b719-ff6342db4da3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:27.258989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91880a3e-7aaf-4c9b-b719-ff6342db4da3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:27.259758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91880a3e-7aaf-4c9b-b719-ff6342db4da3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:27.259866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-234e8cc3-2462-4930-b71d-908b04faf3ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:27.260213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91880a3e-7aaf-4c9b-b719-ff6342db4da3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:27.260329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-234e8cc3-2462-4930-b71d-908b04faf3ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:27.260993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-234e8cc3-2462-4930-b71d-908b04faf3ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:27.261412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-234e8cc3-2462-4930-b71d-908b04faf3ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:27.290473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91880a3e-7aaf-4c9b-b719-ff6342db4da3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044370 Apr 11 19:57:27.290953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 878/1708] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:27.291234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-234e8cc3-2462-4930-b71d-908b04faf3ae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 Apr 11 19:57:27.291835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 831/1709] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:27.487622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58e56a16-6d68-4877-b37a-fc3dbc13632e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:27.488552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58e56a16-6d68-4877-b37a-fc3dbc13632e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:27.494923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58e56a16-6d68-4877-b37a-fc3dbc13632e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:27.495371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58e56a16-6d68-4877-b37a-fc3dbc13632e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:27.496134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58e56a16-6d68-4877-b37a-fc3dbc13632e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:27.496564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58e56a16-6d68-4877-b37a-fc3dbc13632e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:27.526172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58e56a16-6d68-4877-b37a-fc3dbc13632e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042551 Apr 11 19:57:27.526720 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 879/1710] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:28.135454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d794aae0-c348-4922-88a5-497f7105691a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:28.136069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d794aae0-c348-4922-88a5-497f7105691a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:28.142674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d794aae0-c348-4922-88a5-497f7105691a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:28.143135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d794aae0-c348-4922-88a5-497f7105691a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:28.143910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d794aae0-c348-4922-88a5-497f7105691a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:28.144336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d794aae0-c348-4922-88a5-497f7105691a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:28.209572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d794aae0-c348-4922-88a5-497f7105691a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:28.217875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d794aae0-c348-4922-88a5-497f7105691a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086263 Apr 11 19:57:28.218448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 832/1711] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:28 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:28.303401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-052b7e52-4a67-49a5-8bc1-000117b0ed67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:28.303996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e137b75e-7677-4ab1-b45b-aaf93a687190 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:28.304368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-052b7e52-4a67-49a5-8bc1-000117b0ed67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:28.304526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e137b75e-7677-4ab1-b45b-aaf93a687190 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:28.311339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e137b75e-7677-4ab1-b45b-aaf93a687190 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:28.311566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-052b7e52-4a67-49a5-8bc1-000117b0ed67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:28.311759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e137b75e-7677-4ab1-b45b-aaf93a687190 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:28.311866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-052b7e52-4a67-49a5-8bc1-000117b0ed67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:28.312559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e137b75e-7677-4ab1-b45b-aaf93a687190 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:28.312705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-052b7e52-4a67-49a5-8bc1-000117b0ed67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:28.313023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e137b75e-7677-4ab1-b45b-aaf93a687190 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:28.313184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-052b7e52-4a67-49a5-8bc1-000117b0ed67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:28.342861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e137b75e-7677-4ab1-b45b-aaf93a687190 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043061 Apr 11 19:57:28.343137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-052b7e52-4a67-49a5-8bc1-000117b0ed67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Apr 11 19:57:28.343441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 833/1712] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:28.343974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 880/1713] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:28.538879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b998391e-1a46-4ddf-9f99-037cd67162d5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:28.539984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b998391e-1a46-4ddf-9f99-037cd67162d5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:28.546513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b998391e-1a46-4ddf-9f99-037cd67162d5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:28.546962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b998391e-1a46-4ddf-9f99-037cd67162d5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:28.547740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b998391e-1a46-4ddf-9f99-037cd67162d5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:28.548172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b998391e-1a46-4ddf-9f99-037cd67162d5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:28.580344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b998391e-1a46-4ddf-9f99-037cd67162d5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Apr 11 19:57:28.581356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 834/1714] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:29.235164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4deff14d-a4b1-4a18-9a6c-f09eca19c04c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:29.235780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4deff14d-a4b1-4a18-9a6c-f09eca19c04c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:29.242241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4deff14d-a4b1-4a18-9a6c-f09eca19c04c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:29.242682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4deff14d-a4b1-4a18-9a6c-f09eca19c04c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:29.243437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4deff14d-a4b1-4a18-9a6c-f09eca19c04c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:29.243864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4deff14d-a4b1-4a18-9a6c-f09eca19c04c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:29.319554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4deff14d-a4b1-4a18-9a6c-f09eca19c04c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:29.331366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4deff14d-a4b1-4a18-9a6c-f09eca19c04c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.099894 Apr 11 19:57:29.332113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 881/1715] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:29 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:29.355449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a8849e5-d831-4480-944e-4b955ac41773 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:29.355713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7ac0443e-4681-4023-8096-d64e6a66492f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:29.356361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4a8849e5-d831-4480-944e-4b955ac41773 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:29.356508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7ac0443e-4681-4023-8096-d64e6a66492f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:29.363046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a8849e5-d831-4480-944e-4b955ac41773 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:29.363247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ac0443e-4681-4023-8096-d64e6a66492f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:29.363504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a8849e5-d831-4480-944e-4b955ac41773 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:29.363678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ac0443e-4681-4023-8096-d64e6a66492f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:29.364283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a8849e5-d831-4480-944e-4b955ac41773 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:29.364480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ac0443e-4681-4023-8096-d64e6a66492f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:29.364715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a8849e5-d831-4480-944e-4b955ac41773 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:29.364880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ac0443e-4681-4023-8096-d64e6a66492f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:29.395517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4a8849e5-d831-4480-944e-4b955ac41773 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Apr 11 19:57:29.396072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 882/1716] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:29.400833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7ac0443e-4681-4023-8096-d64e6a66492f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049617 Apr 11 19:57:29.401535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 835/1717] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:57:29.596171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-61fa6ca3-1e65-4dae-bce9-f6905cd83efe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:29.597538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-61fa6ca3-1e65-4dae-bce9-f6905cd83efe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:29.611438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61fa6ca3-1e65-4dae-bce9-f6905cd83efe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:29.611886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61fa6ca3-1e65-4dae-bce9-f6905cd83efe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:29.612662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61fa6ca3-1e65-4dae-bce9-f6905cd83efe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:29.613139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61fa6ca3-1e65-4dae-bce9-f6905cd83efe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:29.642571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-61fa6ca3-1e65-4dae-bce9-f6905cd83efe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053192 Apr 11 19:57:29.643129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 883/1718] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:30.354115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-542f84fc-b824-4560-af06-19e77125abb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:30.355163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-542f84fc-b824-4560-af06-19e77125abb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:30.363848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542f84fc-b824-4560-af06-19e77125abb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:30.364464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542f84fc-b824-4560-af06-19e77125abb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:30.365079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542f84fc-b824-4560-af06-19e77125abb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:30.365511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542f84fc-b824-4560-af06-19e77125abb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:30.407315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-338d0756-0153-4605-9ec0-6f462043e752 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:30.408265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-338d0756-0153-4605-9ec0-6f462043e752 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:30.414901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-338d0756-0153-4605-9ec0-6f462043e752 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:30.415337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-338d0756-0153-4605-9ec0-6f462043e752 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:30.416105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-338d0756-0153-4605-9ec0-6f462043e752 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:30.416532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-338d0756-0153-4605-9ec0-6f462043e752 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:30.428131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-542f84fc-b824-4560-af06-19e77125abb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:30.436138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-542f84fc-b824-4560-af06-19e77125abb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088592 Apr 11 19:57:30.436686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 836/1719] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:30 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:30.441717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e8b2bc2-53ce-4e71-bad1-d574505f5680 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:30.442674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9e8b2bc2-53ce-4e71-bad1-d574505f5680 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:30.450868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e8b2bc2-53ce-4e71-bad1-d574505f5680 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:30.451493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e8b2bc2-53ce-4e71-bad1-d574505f5680 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:30.452558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-338d0756-0153-4605-9ec0-6f462043e752 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049187 Apr 11 19:57:30.452755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e8b2bc2-53ce-4e71-bad1-d574505f5680 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:30.453159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 884/1720] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:57:30.453412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e8b2bc2-53ce-4e71-bad1-d574505f5680 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:30.493557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e8b2bc2-53ce-4e71-bad1-d574505f5680 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055789 Apr 11 19:57:30.494138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 837/1721] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:30.657803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d2fcf9ac-1504-4970-941e-142b2ad2e3f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:30.659248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d2fcf9ac-1504-4970-941e-142b2ad2e3f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:30.668616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2fcf9ac-1504-4970-941e-142b2ad2e3f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:30.669375 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2fcf9ac-1504-4970-941e-142b2ad2e3f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:30.670546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2fcf9ac-1504-4970-941e-142b2ad2e3f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:30.670979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2fcf9ac-1504-4970-941e-142b2ad2e3f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:30.700649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d2fcf9ac-1504-4970-941e-142b2ad2e3f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049264 Apr 11 19:57:30.701151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 885/1722] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:31.454137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c0316288-d768-4cff-9b83-c2dc64fc43c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:31.454782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c0316288-d768-4cff-9b83-c2dc64fc43c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:31.462230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0316288-d768-4cff-9b83-c2dc64fc43c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:31.462677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0316288-d768-4cff-9b83-c2dc64fc43c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:31.463485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0316288-d768-4cff-9b83-c2dc64fc43c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:31.463928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0316288-d768-4cff-9b83-c2dc64fc43c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:31.464734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5598db4c-3156-4f6f-854b-068bfe52952a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:31.466244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5598db4c-3156-4f6f-854b-068bfe52952a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:31.474419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5598db4c-3156-4f6f-854b-068bfe52952a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:31.475172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5598db4c-3156-4f6f-854b-068bfe52952a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:31.476481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5598db4c-3156-4f6f-854b-068bfe52952a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:31.477055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5598db4c-3156-4f6f-854b-068bfe52952a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:31.511746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5598db4c-3156-4f6f-854b-068bfe52952a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051516 Apr 11 19:57:31.512411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 886/1723] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:31.517354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-57d222e6-abb3-4ef6-a027-61a0be5abc5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:31.518250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-57d222e6-abb3-4ef6-a027-61a0be5abc5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:31.524760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57d222e6-abb3-4ef6-a027-61a0be5abc5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:31.525210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57d222e6-abb3-4ef6-a027-61a0be5abc5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:31.525979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57d222e6-abb3-4ef6-a027-61a0be5abc5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:31.526400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57d222e6-abb3-4ef6-a027-61a0be5abc5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:31.529775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c0316288-d768-4cff-9b83-c2dc64fc43c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:31.544704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c0316288-d768-4cff-9b83-c2dc64fc43c4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.094340 Apr 11 19:57:31.545794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 838/1724] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:31 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:31.557719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-57d222e6-abb3-4ef6-a027-61a0be5abc5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044221 Apr 11 19:57:31.558376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 887/1725] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:31.712328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ed4edb5-f897-4dad-b1d8-0060946e026e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:31.713308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ed4edb5-f897-4dad-b1d8-0060946e026e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:31.720262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ed4edb5-f897-4dad-b1d8-0060946e026e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:31.720739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ed4edb5-f897-4dad-b1d8-0060946e026e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:31.721682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ed4edb5-f897-4dad-b1d8-0060946e026e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:31.722114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ed4edb5-f897-4dad-b1d8-0060946e026e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:31.753470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ed4edb5-f897-4dad-b1d8-0060946e026e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045210 Apr 11 19:57:31.754056 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 839/1726] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:32.524111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5c818e65-5c29-4330-ba46-7eb2cbc22461 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:32.524938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5c818e65-5c29-4330-ba46-7eb2cbc22461 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:32.531674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c818e65-5c29-4330-ba46-7eb2cbc22461 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:32.532121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c818e65-5c29-4330-ba46-7eb2cbc22461 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:32.532935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c818e65-5c29-4330-ba46-7eb2cbc22461 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:32.533521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c818e65-5c29-4330-ba46-7eb2cbc22461 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:32.563605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5c818e65-5c29-4330-ba46-7eb2cbc22461 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Apr 11 19:57:32.564474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 888/1727] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:32.565825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-080d772d-f869-4637-ab46-c9b209a793b4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:32.566417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-080d772d-f869-4637-ab46-c9b209a793b4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:32.569288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90edaa93-4b12-459a-acb2-95764820c1fc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:32.570210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90edaa93-4b12-459a-acb2-95764820c1fc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:32.573425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-080d772d-f869-4637-ab46-c9b209a793b4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:32.573864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-080d772d-f869-4637-ab46-c9b209a793b4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:32.574627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-080d772d-f869-4637-ab46-c9b209a793b4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:32.575049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-080d772d-f869-4637-ab46-c9b209a793b4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:32.576529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90edaa93-4b12-459a-acb2-95764820c1fc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:32.576998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90edaa93-4b12-459a-acb2-95764820c1fc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:32.577758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90edaa93-4b12-459a-acb2-95764820c1fc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:32.578182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90edaa93-4b12-459a-acb2-95764820c1fc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:32.607877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90edaa93-4b12-459a-acb2-95764820c1fc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042251 Apr 11 19:57:32.608593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 889/1728] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:32.638908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-080d772d-f869-4637-ab46-c9b209a793b4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:32.647891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-080d772d-f869-4637-ab46-c9b209a793b4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086755 Apr 11 19:57:32.648457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 840/1729] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:32 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:32.766523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fcc6146d-e93e-4d16-a64c-7dab89456030 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:32.767444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fcc6146d-e93e-4d16-a64c-7dab89456030 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:32.774595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcc6146d-e93e-4d16-a64c-7dab89456030 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:32.774991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcc6146d-e93e-4d16-a64c-7dab89456030 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:32.775863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcc6146d-e93e-4d16-a64c-7dab89456030 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:32.776297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcc6146d-e93e-4d16-a64c-7dab89456030 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:32.807097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fcc6146d-e93e-4d16-a64c-7dab89456030 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Apr 11 19:57:32.807661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 890/1730] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:33.579165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b9471bb3-ed73-4645-8128-7a58c03af17c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:33.580198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b9471bb3-ed73-4645-8128-7a58c03af17c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:33.587449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9471bb3-ed73-4645-8128-7a58c03af17c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:33.587896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9471bb3-ed73-4645-8128-7a58c03af17c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:33.588656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9471bb3-ed73-4645-8128-7a58c03af17c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:33.589117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9471bb3-ed73-4645-8128-7a58c03af17c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:33.621305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2513284e-7ea7-4bc8-a01c-e67e9e84eb59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:33.621915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9471bb3-ed73-4645-8128-7a58c03af17c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049048 Apr 11 19:57:33.622246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2513284e-7ea7-4bc8-a01c-e67e9e84eb59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:33.622501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 841/1731] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:33.631227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2513284e-7ea7-4bc8-a01c-e67e9e84eb59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:33.631957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2513284e-7ea7-4bc8-a01c-e67e9e84eb59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:33.633306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2513284e-7ea7-4bc8-a01c-e67e9e84eb59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:33.634023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2513284e-7ea7-4bc8-a01c-e67e9e84eb59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:33.666958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54b07e76-057f-4d8b-8a61-286dede7a4a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:33.667617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54b07e76-057f-4d8b-8a61-286dede7a4a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:33.667788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2513284e-7ea7-4bc8-a01c-e67e9e84eb59 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051298 Apr 11 19:57:33.668377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 891/1732] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:33.676255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54b07e76-057f-4d8b-8a61-286dede7a4a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:33.676698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54b07e76-057f-4d8b-8a61-286dede7a4a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:33.677911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54b07e76-057f-4d8b-8a61-286dede7a4a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:33.678381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54b07e76-057f-4d8b-8a61-286dede7a4a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:33.743573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54b07e76-057f-4d8b-8a61-286dede7a4a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:33.751524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54b07e76-057f-4d8b-8a61-286dede7a4a4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.089270 Apr 11 19:57:33.752092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 842/1733] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:33 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:33.818848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f02f27a7-9340-452d-81b5-18fa56693115 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:33.819826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f02f27a7-9340-452d-81b5-18fa56693115 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:33.826349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f02f27a7-9340-452d-81b5-18fa56693115 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:33.826790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f02f27a7-9340-452d-81b5-18fa56693115 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:33.827541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f02f27a7-9340-452d-81b5-18fa56693115 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:33.827964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f02f27a7-9340-452d-81b5-18fa56693115 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:33.859074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f02f27a7-9340-452d-81b5-18fa56693115 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Apr 11 19:57:33.859578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 892/1734] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:34.635348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed20a375-51f0-4d37-8a3c-3c7be4e4631a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:34.636431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed20a375-51f0-4d37-8a3c-3c7be4e4631a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:34.644292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed20a375-51f0-4d37-8a3c-3c7be4e4631a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:34.644810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed20a375-51f0-4d37-8a3c-3c7be4e4631a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:34.645737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed20a375-51f0-4d37-8a3c-3c7be4e4631a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:34.646240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed20a375-51f0-4d37-8a3c-3c7be4e4631a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:34.676681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed20a375-51f0-4d37-8a3c-3c7be4e4631a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046037 Apr 11 19:57:34.677283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 843/1735] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:34.680328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-65adb60f-1d2d-4c04-be84-490e1a3d461a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:34.681288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-65adb60f-1d2d-4c04-be84-490e1a3d461a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:34.688190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65adb60f-1d2d-4c04-be84-490e1a3d461a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:34.688640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65adb60f-1d2d-4c04-be84-490e1a3d461a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:34.689433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65adb60f-1d2d-4c04-be84-490e1a3d461a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:34.689860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65adb60f-1d2d-4c04-be84-490e1a3d461a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:34.718120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-65adb60f-1d2d-4c04-be84-490e1a3d461a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041948 Apr 11 19:57:34.718650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 893/1736] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:34.770432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04265ca4-6d98-4713-a73c-637f54c82bec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:34.771041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04265ca4-6d98-4713-a73c-637f54c82bec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:34.777754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04265ca4-6d98-4713-a73c-637f54c82bec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:34.778192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04265ca4-6d98-4713-a73c-637f54c82bec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:34.778946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04265ca4-6d98-4713-a73c-637f54c82bec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:34.779369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04265ca4-6d98-4713-a73c-637f54c82bec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:34.841422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04265ca4-6d98-4713-a73c-637f54c82bec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:34.849055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04265ca4-6d98-4713-a73c-637f54c82bec tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084043 Apr 11 19:57:34.849619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 844/1737] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:34 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:34.871297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4d938c06-13bd-4a28-9e14-871d5f72e5a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:34.872158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4d938c06-13bd-4a28-9e14-871d5f72e5a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:34.879293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d938c06-13bd-4a28-9e14-871d5f72e5a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:34.879745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d938c06-13bd-4a28-9e14-871d5f72e5a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:34.880499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d938c06-13bd-4a28-9e14-871d5f72e5a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:34.880946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d938c06-13bd-4a28-9e14-871d5f72e5a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:34.910293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4d938c06-13bd-4a28-9e14-871d5f72e5a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Apr 11 19:57:34.911030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 894/1738] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:35.693283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ed53771-70ac-43cc-8fcb-8e430d1b3c24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:35.694774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ed53771-70ac-43cc-8fcb-8e430d1b3c24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:35.705430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ed53771-70ac-43cc-8fcb-8e430d1b3c24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:35.706172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ed53771-70ac-43cc-8fcb-8e430d1b3c24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:35.706961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ed53771-70ac-43cc-8fcb-8e430d1b3c24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:35.707413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ed53771-70ac-43cc-8fcb-8e430d1b3c24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:35.730187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-edd7a089-8ea3-44c1-90bb-56e9f621a7b3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:35.731098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-edd7a089-8ea3-44c1-90bb-56e9f621a7b3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:35.736815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ed53771-70ac-43cc-8fcb-8e430d1b3c24 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050257 Apr 11 19:57:35.737461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 845/1739] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:35.737724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edd7a089-8ea3-44c1-90bb-56e9f621a7b3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:35.738197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edd7a089-8ea3-44c1-90bb-56e9f621a7b3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:35.738951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edd7a089-8ea3-44c1-90bb-56e9f621a7b3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:35.739357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edd7a089-8ea3-44c1-90bb-56e9f621a7b3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:35.769408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-edd7a089-8ea3-44c1-90bb-56e9f621a7b3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043145 Apr 11 19:57:35.769947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 895/1740] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:35.869772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bccef79d-f5fd-46e1-91bb-ff4dcd0bc02c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:35.870775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bccef79d-f5fd-46e1-91bb-ff4dcd0bc02c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:35.881329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bccef79d-f5fd-46e1-91bb-ff4dcd0bc02c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:35.882074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bccef79d-f5fd-46e1-91bb-ff4dcd0bc02c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:35.883339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bccef79d-f5fd-46e1-91bb-ff4dcd0bc02c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:35.884060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bccef79d-f5fd-46e1-91bb-ff4dcd0bc02c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:35.921871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ccb0830-ef25-4084-a16e-7dc55faec561 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:35.922795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ccb0830-ef25-4084-a16e-7dc55faec561 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:35.929436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ccb0830-ef25-4084-a16e-7dc55faec561 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:35.929878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ccb0830-ef25-4084-a16e-7dc55faec561 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:35.930666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ccb0830-ef25-4084-a16e-7dc55faec561 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:35.931074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ccb0830-ef25-4084-a16e-7dc55faec561 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:35.947871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bccef79d-f5fd-46e1-91bb-ff4dcd0bc02c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:35.955499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bccef79d-f5fd-46e1-91bb-ff4dcd0bc02c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092239 Apr 11 19:57:35.956148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 846/1741] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:35 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:35.959184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ccb0830-ef25-4084-a16e-7dc55faec561 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 Apr 11 19:57:35.959720 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 896/1742] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:36.752387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b502c5cf-5136-4bb7-8608-68a38abd1c6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:36.753604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b502c5cf-5136-4bb7-8608-68a38abd1c6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:36.760620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b502c5cf-5136-4bb7-8608-68a38abd1c6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:36.761149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b502c5cf-5136-4bb7-8608-68a38abd1c6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:36.761954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b502c5cf-5136-4bb7-8608-68a38abd1c6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:36.762407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b502c5cf-5136-4bb7-8608-68a38abd1c6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:36.781125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2c824f5d-20bf-467b-aee0-a663033ba870 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:36.782186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2c824f5d-20bf-467b-aee0-a663033ba870 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:36.788805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c824f5d-20bf-467b-aee0-a663033ba870 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:36.789338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c824f5d-20bf-467b-aee0-a663033ba870 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:36.790189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c824f5d-20bf-467b-aee0-a663033ba870 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:36.790624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c824f5d-20bf-467b-aee0-a663033ba870 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:36.796397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b502c5cf-5136-4bb7-8608-68a38abd1c6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050938 Apr 11 19:57:36.797401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 847/1743] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:36.821273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2c824f5d-20bf-467b-aee0-a663033ba870 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044283 Apr 11 19:57:36.821863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 897/1744] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:36.971102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56265ca8-91bc-4e94-849c-99162116772a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:36.972426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56265ca8-91bc-4e94-849c-99162116772a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:36.972936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc267cc8-ab43-4de6-861e-3ae220dcb923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:36.973587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc267cc8-ab43-4de6-861e-3ae220dcb923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:36.979434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56265ca8-91bc-4e94-849c-99162116772a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:36.979870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc267cc8-ab43-4de6-861e-3ae220dcb923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:36.980047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56265ca8-91bc-4e94-849c-99162116772a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:36.980323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc267cc8-ab43-4de6-861e-3ae220dcb923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:36.980640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56265ca8-91bc-4e94-849c-99162116772a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:36.981122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56265ca8-91bc-4e94-849c-99162116772a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:36.981319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc267cc8-ab43-4de6-861e-3ae220dcb923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:36.981574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc267cc8-ab43-4de6-861e-3ae220dcb923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:37.017673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56265ca8-91bc-4e94-849c-99162116772a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050527 Apr 11 19:57:37.018489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 848/1745] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:37.043817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dc267cc8-ab43-4de6-861e-3ae220dcb923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:37.051407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc267cc8-ab43-4de6-861e-3ae220dcb923 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082697 Apr 11 19:57:37.052049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 898/1746] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:36 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:37.810418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04dfe663-621f-44ef-b92e-0e803654b0b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:37.811334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04dfe663-621f-44ef-b92e-0e803654b0b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:37.818168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04dfe663-621f-44ef-b92e-0e803654b0b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:37.818616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04dfe663-621f-44ef-b92e-0e803654b0b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:37.819376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04dfe663-621f-44ef-b92e-0e803654b0b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:37.819800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04dfe663-621f-44ef-b92e-0e803654b0b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:37.833526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-637e43cb-eefc-48da-8e07-69a4e6623c8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:37.834655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-637e43cb-eefc-48da-8e07-69a4e6623c8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:37.842335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-637e43cb-eefc-48da-8e07-69a4e6623c8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:37.842799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-637e43cb-eefc-48da-8e07-69a4e6623c8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:37.843561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-637e43cb-eefc-48da-8e07-69a4e6623c8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:37.844014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-637e43cb-eefc-48da-8e07-69a4e6623c8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:37.851587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04dfe663-621f-44ef-b92e-0e803654b0b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Apr 11 19:57:37.852177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 849/1747] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:37.874192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-637e43cb-eefc-48da-8e07-69a4e6623c8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044774 Apr 11 19:57:37.875060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 899/1748] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:38.030100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4fb5ce31-f047-4570-9b97-a5c7d6b5fdaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:38.031032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4fb5ce31-f047-4570-9b97-a5c7d6b5fdaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:38.037528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fb5ce31-f047-4570-9b97-a5c7d6b5fdaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:38.037980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fb5ce31-f047-4570-9b97-a5c7d6b5fdaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:38.038754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fb5ce31-f047-4570-9b97-a5c7d6b5fdaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:38.039203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fb5ce31-f047-4570-9b97-a5c7d6b5fdaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:38.067947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-069265c1-3576-409d-9e5e-ce5a7c1632cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:38.068459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-069265c1-3576-409d-9e5e-ce5a7c1632cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:38.068936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4fb5ce31-f047-4570-9b97-a5c7d6b5fdaf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Apr 11 19:57:38.069572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 850/1749] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:38.075011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-069265c1-3576-409d-9e5e-ce5a7c1632cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:38.075460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-069265c1-3576-409d-9e5e-ce5a7c1632cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:38.076353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-069265c1-3576-409d-9e5e-ce5a7c1632cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:38.076789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-069265c1-3576-409d-9e5e-ce5a7c1632cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:38.141932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-069265c1-3576-409d-9e5e-ce5a7c1632cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:38.150403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-069265c1-3576-409d-9e5e-ce5a7c1632cb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086613 Apr 11 19:57:38.150965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 900/1750] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:38 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:38.863892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c7fc46f-8721-4d09-968f-80b7a1a60953 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:38.864720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c7fc46f-8721-4d09-968f-80b7a1a60953 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:38.871433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c7fc46f-8721-4d09-968f-80b7a1a60953 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:38.871881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c7fc46f-8721-4d09-968f-80b7a1a60953 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:38.872651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c7fc46f-8721-4d09-968f-80b7a1a60953 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:38.873122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c7fc46f-8721-4d09-968f-80b7a1a60953 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:38.886079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f3b96ec8-ec6b-4278-b162-e0ab2365af9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:38.887924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f3b96ec8-ec6b-4278-b162-e0ab2365af9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:38.894756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3b96ec8-ec6b-4278-b162-e0ab2365af9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:38.895200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3b96ec8-ec6b-4278-b162-e0ab2365af9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:38.895976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3b96ec8-ec6b-4278-b162-e0ab2365af9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:38.896450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3b96ec8-ec6b-4278-b162-e0ab2365af9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:38.903981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c7fc46f-8721-4d09-968f-80b7a1a60953 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 Apr 11 19:57:38.904567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 851/1751] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:38.927471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f3b96ec8-ec6b-4278-b162-e0ab2365af9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045272 Apr 11 19:57:38.928040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 901/1752] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:57:39.081811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89034f49-2484-4864-a3b0-d85f69173d53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:39.082772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89034f49-2484-4864-a3b0-d85f69173d53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:39.089442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89034f49-2484-4864-a3b0-d85f69173d53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:39.089890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89034f49-2484-4864-a3b0-d85f69173d53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:39.090654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89034f49-2484-4864-a3b0-d85f69173d53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:39.091084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89034f49-2484-4864-a3b0-d85f69173d53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:39.121122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89034f49-2484-4864-a3b0-d85f69173d53 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Apr 11 19:57:39.121806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 852/1753] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:39.167741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ae3ccb3d-14df-45c2-a048-6dccf7b598a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:39.168376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ae3ccb3d-14df-45c2-a048-6dccf7b598a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:39.175064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae3ccb3d-14df-45c2-a048-6dccf7b598a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:39.175513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae3ccb3d-14df-45c2-a048-6dccf7b598a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:39.176288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae3ccb3d-14df-45c2-a048-6dccf7b598a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:39.176719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae3ccb3d-14df-45c2-a048-6dccf7b598a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:39.239452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ae3ccb3d-14df-45c2-a048-6dccf7b598a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:39.247021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ae3ccb3d-14df-45c2-a048-6dccf7b598a9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083071 Apr 11 19:57:39.247602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 902/1754] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:39 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:39.916179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6b807a83-9a55-43df-ade5-e98994910930 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:39.917127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6b807a83-9a55-43df-ade5-e98994910930 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:39.924272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b807a83-9a55-43df-ade5-e98994910930 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:39.924746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b807a83-9a55-43df-ade5-e98994910930 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:39.925724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b807a83-9a55-43df-ade5-e98994910930 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:39.926146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b807a83-9a55-43df-ade5-e98994910930 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:39.939458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-61b64c2a-0ea1-4609-aca2-f3f88cee6e12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:39.940549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-61b64c2a-0ea1-4609-aca2-f3f88cee6e12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:39.947351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61b64c2a-0ea1-4609-aca2-f3f88cee6e12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:39.947797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61b64c2a-0ea1-4609-aca2-f3f88cee6e12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:39.948576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61b64c2a-0ea1-4609-aca2-f3f88cee6e12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:39.949045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61b64c2a-0ea1-4609-aca2-f3f88cee6e12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:39.957095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6b807a83-9a55-43df-ade5-e98994910930 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Apr 11 19:57:39.957697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 853/1755] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:39.978837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-61b64c2a-0ea1-4609-aca2-f3f88cee6e12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043290 Apr 11 19:57:39.979456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 903/1756] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:40.133966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-be901f47-2cbe-4440-8c5e-13852abbc786 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:40.135076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-be901f47-2cbe-4440-8c5e-13852abbc786 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:40.141330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be901f47-2cbe-4440-8c5e-13852abbc786 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:40.141781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be901f47-2cbe-4440-8c5e-13852abbc786 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:40.142549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be901f47-2cbe-4440-8c5e-13852abbc786 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:40.142981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be901f47-2cbe-4440-8c5e-13852abbc786 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:40.172287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-be901f47-2cbe-4440-8c5e-13852abbc786 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Apr 11 19:57:40.172757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 854/1757] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:40.264709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-37dfbe45-aa48-4bbb-9dd5-d841bd5fadeb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:40.265346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-37dfbe45-aa48-4bbb-9dd5-d841bd5fadeb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:40.271855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37dfbe45-aa48-4bbb-9dd5-d841bd5fadeb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:40.272336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37dfbe45-aa48-4bbb-9dd5-d841bd5fadeb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:40.273158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37dfbe45-aa48-4bbb-9dd5-d841bd5fadeb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:40.273772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37dfbe45-aa48-4bbb-9dd5-d841bd5fadeb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:40.334715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37dfbe45-aa48-4bbb-9dd5-d841bd5fadeb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:40.342960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-37dfbe45-aa48-4bbb-9dd5-d841bd5fadeb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082282 Apr 11 19:57:40.343535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 904/1758] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:40 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:40.969176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa7c13d9-1474-455d-9b2b-b2f4af6750b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:40.970245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa7c13d9-1474-455d-9b2b-b2f4af6750b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:40.977175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa7c13d9-1474-455d-9b2b-b2f4af6750b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:40.977655 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa7c13d9-1474-455d-9b2b-b2f4af6750b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:40.978496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa7c13d9-1474-455d-9b2b-b2f4af6750b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:40.979068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa7c13d9-1474-455d-9b2b-b2f4af6750b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:40.990878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-249418a5-be8b-4099-9ab4-f8cb89a754d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:40.992533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-249418a5-be8b-4099-9ab4-f8cb89a754d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:40.999063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-249418a5-be8b-4099-9ab4-f8cb89a754d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:40.999837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-249418a5-be8b-4099-9ab4-f8cb89a754d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:41.000604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-249418a5-be8b-4099-9ab4-f8cb89a754d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:41.001066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-249418a5-be8b-4099-9ab4-f8cb89a754d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:41.012384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa7c13d9-1474-455d-9b2b-b2f4af6750b0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047170 Apr 11 19:57:41.013237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 855/1759] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:41.031919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-249418a5-be8b-4099-9ab4-f8cb89a754d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045408 Apr 11 19:57:41.032508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 905/1760] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:57:41.184035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae2dca63-119e-473c-b8dd-c32576224ad4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:41.185000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae2dca63-119e-473c-b8dd-c32576224ad4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:41.191629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae2dca63-119e-473c-b8dd-c32576224ad4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:41.192083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae2dca63-119e-473c-b8dd-c32576224ad4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:41.192856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae2dca63-119e-473c-b8dd-c32576224ad4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:41.193323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae2dca63-119e-473c-b8dd-c32576224ad4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:41.222940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae2dca63-119e-473c-b8dd-c32576224ad4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Apr 11 19:57:41.223503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 856/1761] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:41.359705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2e11f153-4a92-40c8-acb0-29a04290cd69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:41.360305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2e11f153-4a92-40c8-acb0-29a04290cd69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:41.366775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e11f153-4a92-40c8-acb0-29a04290cd69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:41.367221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e11f153-4a92-40c8-acb0-29a04290cd69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:41.367981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e11f153-4a92-40c8-acb0-29a04290cd69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:41.368411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e11f153-4a92-40c8-acb0-29a04290cd69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:41.430272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2e11f153-4a92-40c8-acb0-29a04290cd69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:41.437938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2e11f153-4a92-40c8-acb0-29a04290cd69 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082299 Apr 11 19:57:41.438430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 906/1762] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:41 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:42.025027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f8e71f9-5a2a-424b-a7ae-6f1adf663e8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:42.025997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f8e71f9-5a2a-424b-a7ae-6f1adf663e8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:42.032850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f8e71f9-5a2a-424b-a7ae-6f1adf663e8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:42.033314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f8e71f9-5a2a-424b-a7ae-6f1adf663e8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:42.034197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f8e71f9-5a2a-424b-a7ae-6f1adf663e8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:42.034623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f8e71f9-5a2a-424b-a7ae-6f1adf663e8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:42.043922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c51caff-264b-4fef-b4ea-f808b3ceba33 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:42.044879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c51caff-264b-4fef-b4ea-f808b3ceba33 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:42.051636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c51caff-264b-4fef-b4ea-f808b3ceba33 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:42.052088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c51caff-264b-4fef-b4ea-f808b3ceba33 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:42.052863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c51caff-264b-4fef-b4ea-f808b3ceba33 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:42.053334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c51caff-264b-4fef-b4ea-f808b3ceba33 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:42.065308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f8e71f9-5a2a-424b-a7ae-6f1adf663e8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Apr 11 19:57:42.065891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 857/1763] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:42.083224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c51caff-264b-4fef-b4ea-f808b3ceba33 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043291 Apr 11 19:57:42.083784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 907/1764] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:42.234791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-be8c6c69-7c2a-4214-959e-93ee3b82098d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:42.235748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-be8c6c69-7c2a-4214-959e-93ee3b82098d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:42.241979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be8c6c69-7c2a-4214-959e-93ee3b82098d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:42.242561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be8c6c69-7c2a-4214-959e-93ee3b82098d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:42.243305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be8c6c69-7c2a-4214-959e-93ee3b82098d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:42.243819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be8c6c69-7c2a-4214-959e-93ee3b82098d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:42.275228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-be8c6c69-7c2a-4214-959e-93ee3b82098d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Apr 11 19:57:42.275701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 858/1765] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:42.455384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f147e1e7-2018-4a50-a9cd-00d965c4e53e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:42.456092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f147e1e7-2018-4a50-a9cd-00d965c4e53e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:42.462271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f147e1e7-2018-4a50-a9cd-00d965c4e53e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:42.462722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f147e1e7-2018-4a50-a9cd-00d965c4e53e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:42.463488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f147e1e7-2018-4a50-a9cd-00d965c4e53e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:42.463921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f147e1e7-2018-4a50-a9cd-00d965c4e53e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:42.529010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f147e1e7-2018-4a50-a9cd-00d965c4e53e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:42.536743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f147e1e7-2018-4a50-a9cd-00d965c4e53e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085545 Apr 11 19:57:42.537392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 908/1766] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:42 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:43.080967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5251801c-2a97-4c5a-88af-a4e8319e12f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:43.081923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5251801c-2a97-4c5a-88af-a4e8319e12f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:43.088830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5251801c-2a97-4c5a-88af-a4e8319e12f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:43.089305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5251801c-2a97-4c5a-88af-a4e8319e12f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:43.090074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5251801c-2a97-4c5a-88af-a4e8319e12f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:43.090507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5251801c-2a97-4c5a-88af-a4e8319e12f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:43.095410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2abed797-2279-44f1-a550-daeaeaafd9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:43.096365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2abed797-2279-44f1-a550-daeaeaafd9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:43.102960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2abed797-2279-44f1-a550-daeaeaafd9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:43.103406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2abed797-2279-44f1-a550-daeaeaafd9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:43.104168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2abed797-2279-44f1-a550-daeaeaafd9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:43.104596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2abed797-2279-44f1-a550-daeaeaafd9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:43.129202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5251801c-2a97-4c5a-88af-a4e8319e12f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054557 Apr 11 19:57:43.130022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 859/1767] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:43.136120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2abed797-2279-44f1-a550-daeaeaafd9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044572 Apr 11 19:57:43.136576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 909/1768] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:43.287177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81fbbd43-099a-47b6-a80c-7061ae11378a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:43.288102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81fbbd43-099a-47b6-a80c-7061ae11378a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:43.294504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81fbbd43-099a-47b6-a80c-7061ae11378a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:43.294947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81fbbd43-099a-47b6-a80c-7061ae11378a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:43.295713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81fbbd43-099a-47b6-a80c-7061ae11378a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:43.296141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81fbbd43-099a-47b6-a80c-7061ae11378a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:43.326634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81fbbd43-099a-47b6-a80c-7061ae11378a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043372 Apr 11 19:57:43.327271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 860/1769] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:43.556828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6575d038-51bc-4870-bac9-354e1993792b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:43.557461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6575d038-51bc-4870-bac9-354e1993792b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:43.563880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6575d038-51bc-4870-bac9-354e1993792b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:43.564329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6575d038-51bc-4870-bac9-354e1993792b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:43.565214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6575d038-51bc-4870-bac9-354e1993792b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:43.565645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6575d038-51bc-4870-bac9-354e1993792b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:43.629139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6575d038-51bc-4870-bac9-354e1993792b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:43.637233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6575d038-51bc-4870-bac9-354e1993792b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085907 Apr 11 19:57:43.637813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 910/1770] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:43 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:44.142582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b61383c-a781-4e79-8521-d32efa3a0fed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:44.143557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b61383c-a781-4e79-8521-d32efa3a0fed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:44.149354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5477d1af-a884-4bf9-8285-330e4e35015a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:44.150282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5477d1af-a884-4bf9-8285-330e4e35015a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:44.150590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b61383c-a781-4e79-8521-d32efa3a0fed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:44.151060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b61383c-a781-4e79-8521-d32efa3a0fed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:44.151857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b61383c-a781-4e79-8521-d32efa3a0fed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:44.152279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b61383c-a781-4e79-8521-d32efa3a0fed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:44.156755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5477d1af-a884-4bf9-8285-330e4e35015a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:44.157232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5477d1af-a884-4bf9-8285-330e4e35015a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:44.158058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5477d1af-a884-4bf9-8285-330e4e35015a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:44.158542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5477d1af-a884-4bf9-8285-330e4e35015a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:44.190111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5477d1af-a884-4bf9-8285-330e4e35015a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044521 Apr 11 19:57:44.191369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b61383c-a781-4e79-8521-d32efa3a0fed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052074 Apr 11 19:57:44.192198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 861/1771] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:44.192338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 911/1772] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:44.340229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6ed027d-c294-4819-b93a-2809e13f15a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:44.341770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a6ed027d-c294-4819-b93a-2809e13f15a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:44.349109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6ed027d-c294-4819-b93a-2809e13f15a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:44.349561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6ed027d-c294-4819-b93a-2809e13f15a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:44.350338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6ed027d-c294-4819-b93a-2809e13f15a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:44.350772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6ed027d-c294-4819-b93a-2809e13f15a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:44.380575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6ed027d-c294-4819-b93a-2809e13f15a4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045395 Apr 11 19:57:44.381197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 862/1773] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:44.653852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-746c6eed-7f85-4fc9-bd85-230bfa131762 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:44.654461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-746c6eed-7f85-4fc9-bd85-230bfa131762 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:44.661398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-746c6eed-7f85-4fc9-bd85-230bfa131762 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:44.662132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-746c6eed-7f85-4fc9-bd85-230bfa131762 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:44.663114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-746c6eed-7f85-4fc9-bd85-230bfa131762 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:44.663741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-746c6eed-7f85-4fc9-bd85-230bfa131762 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:44.730108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-746c6eed-7f85-4fc9-bd85-230bfa131762 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:44.738185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-746c6eed-7f85-4fc9-bd85-230bfa131762 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088353 Apr 11 19:57:44.738790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 912/1774] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:44 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:45.202487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-63f32203-cf9d-4e8b-96d2-06a7246e56fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:45.203405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-63f32203-cf9d-4e8b-96d2-06a7246e56fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:45.203833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-17164f7d-1c40-4e21-9635-3cf4f54dfa1c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:45.204893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-17164f7d-1c40-4e21-9635-3cf4f54dfa1c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:45.209974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f32203-cf9d-4e8b-96d2-06a7246e56fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:45.210417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f32203-cf9d-4e8b-96d2-06a7246e56fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:45.211205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f32203-cf9d-4e8b-96d2-06a7246e56fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:45.211400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17164f7d-1c40-4e21-9635-3cf4f54dfa1c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:45.211705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f32203-cf9d-4e8b-96d2-06a7246e56fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:45.211842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17164f7d-1c40-4e21-9635-3cf4f54dfa1c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:45.212610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17164f7d-1c40-4e21-9635-3cf4f54dfa1c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:45.213065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17164f7d-1c40-4e21-9635-3cf4f54dfa1c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:45.242938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-63f32203-cf9d-4e8b-96d2-06a7246e56fb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044647 Apr 11 19:57:45.243275 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-17164f7d-1c40-4e21-9635-3cf4f54dfa1c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Apr 11 19:57:45.243519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 863/1775] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:45.244032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 913/1776] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:57:45.392882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-67b55696-2048-40ed-9fad-f20ce18621c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:45.393923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-67b55696-2048-40ed-9fad-f20ce18621c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:45.400506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67b55696-2048-40ed-9fad-f20ce18621c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:45.400951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67b55696-2048-40ed-9fad-f20ce18621c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:45.401753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67b55696-2048-40ed-9fad-f20ce18621c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:45.402181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67b55696-2048-40ed-9fad-f20ce18621c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:45.432653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-67b55696-2048-40ed-9fad-f20ce18621c3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Apr 11 19:57:45.433373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 864/1777] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:45.756980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b48fb82b-b6fc-4698-8a47-958d8358eb10 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:45.757609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b48fb82b-b6fc-4698-8a47-958d8358eb10 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:45.764661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b48fb82b-b6fc-4698-8a47-958d8358eb10 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:45.765054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b48fb82b-b6fc-4698-8a47-958d8358eb10 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:45.765842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b48fb82b-b6fc-4698-8a47-958d8358eb10 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:45.766264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b48fb82b-b6fc-4698-8a47-958d8358eb10 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:45.831740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b48fb82b-b6fc-4698-8a47-958d8358eb10 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:45.839621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b48fb82b-b6fc-4698-8a47-958d8358eb10 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086488 Apr 11 19:57:45.840199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 914/1778] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:45 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:46.255630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-900b5939-768a-4dcb-ae09-6588349f54d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:46.256265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07bcc6ae-545a-4278-a04e-6ae81a139be7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:46.256636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07bcc6ae-545a-4278-a04e-6ae81a139be7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:46.256755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-900b5939-768a-4dcb-ae09-6588349f54d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:46.263307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-900b5939-768a-4dcb-ae09-6588349f54d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:46.263545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07bcc6ae-545a-4278-a04e-6ae81a139be7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:46.263744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-900b5939-768a-4dcb-ae09-6588349f54d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:46.264080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07bcc6ae-545a-4278-a04e-6ae81a139be7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:46.264550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-900b5939-768a-4dcb-ae09-6588349f54d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:46.266128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-900b5939-768a-4dcb-ae09-6588349f54d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:46.266303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07bcc6ae-545a-4278-a04e-6ae81a139be7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:46.266303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07bcc6ae-545a-4278-a04e-6ae81a139be7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:46.295857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-900b5939-768a-4dcb-ae09-6588349f54d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Apr 11 19:57:46.296662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 865/1779] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:46.299018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07bcc6ae-545a-4278-a04e-6ae81a139be7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047408 Apr 11 19:57:46.299695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 915/1780] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:46.444978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b0b3faf-3f37-43bc-a06f-517697b2600f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:46.445843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b0b3faf-3f37-43bc-a06f-517697b2600f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:46.452411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b0b3faf-3f37-43bc-a06f-517697b2600f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:46.452866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b0b3faf-3f37-43bc-a06f-517697b2600f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:46.453687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b0b3faf-3f37-43bc-a06f-517697b2600f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:46.454120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b0b3faf-3f37-43bc-a06f-517697b2600f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:46.485718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b0b3faf-3f37-43bc-a06f-517697b2600f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Apr 11 19:57:46.486305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 866/1781] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:46.860624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b50d67d-a9bc-4f8c-aabd-e7da177b8785 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:46.861332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b50d67d-a9bc-4f8c-aabd-e7da177b8785 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:46.868009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b50d67d-a9bc-4f8c-aabd-e7da177b8785 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:46.868389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b50d67d-a9bc-4f8c-aabd-e7da177b8785 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:46.869192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b50d67d-a9bc-4f8c-aabd-e7da177b8785 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:46.869622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b50d67d-a9bc-4f8c-aabd-e7da177b8785 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:46.942582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b50d67d-a9bc-4f8c-aabd-e7da177b8785 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:46.950565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b50d67d-a9bc-4f8c-aabd-e7da177b8785 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.096378 Apr 11 19:57:46.951138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 916/1782] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:46 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:47.309260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-31942b98-9bcc-4b54-9dc1-c9ea19ceea62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:47.311390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-31942b98-9bcc-4b54-9dc1-c9ea19ceea62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:47.314824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f03372b1-d9cf-4c6c-82c7-95f3cc33ac86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:47.316493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f03372b1-d9cf-4c6c-82c7-95f3cc33ac86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:47.318483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31942b98-9bcc-4b54-9dc1-c9ea19ceea62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:47.318942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31942b98-9bcc-4b54-9dc1-c9ea19ceea62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:47.319714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31942b98-9bcc-4b54-9dc1-c9ea19ceea62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:47.320140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31942b98-9bcc-4b54-9dc1-c9ea19ceea62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:47.327623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f03372b1-d9cf-4c6c-82c7-95f3cc33ac86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:47.328386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f03372b1-d9cf-4c6c-82c7-95f3cc33ac86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:47.329790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f03372b1-d9cf-4c6c-82c7-95f3cc33ac86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:47.330561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f03372b1-d9cf-4c6c-82c7-95f3cc33ac86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:47.350742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-31942b98-9bcc-4b54-9dc1-c9ea19ceea62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046411 Apr 11 19:57:47.351322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 867/1783] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:47.371787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f03372b1-d9cf-4c6c-82c7-95f3cc33ac86 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064738 Apr 11 19:57:47.372359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 917/1784] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:47.498615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe2ff00d-d934-45ab-97a6-5b7035607045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:47.499397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe2ff00d-d934-45ab-97a6-5b7035607045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:47.506498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe2ff00d-d934-45ab-97a6-5b7035607045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:47.506951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe2ff00d-d934-45ab-97a6-5b7035607045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:47.507770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe2ff00d-d934-45ab-97a6-5b7035607045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:47.508347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe2ff00d-d934-45ab-97a6-5b7035607045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:47.538632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe2ff00d-d934-45ab-97a6-5b7035607045 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Apr 11 19:57:47.539280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 868/1785] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:47.973769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68af6383-a550-4756-b33a-7520b2be1b99 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:47.974399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68af6383-a550-4756-b33a-7520b2be1b99 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:47.980839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68af6383-a550-4756-b33a-7520b2be1b99 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:47.981319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68af6383-a550-4756-b33a-7520b2be1b99 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:47.982074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68af6383-a550-4756-b33a-7520b2be1b99 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:47.982503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68af6383-a550-4756-b33a-7520b2be1b99 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:48.043534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-68af6383-a550-4756-b33a-7520b2be1b99 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:48.051258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68af6383-a550-4756-b33a-7520b2be1b99 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084704 Apr 11 19:57:48.051893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 918/1786] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:47 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:48.386346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-62d8f564-b7f4-45d9-a826-3c0c985cb976 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:48.387512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-62d8f564-b7f4-45d9-a826-3c0c985cb976 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:48.395489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62d8f564-b7f4-45d9-a826-3c0c985cb976 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:48.395933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62d8f564-b7f4-45d9-a826-3c0c985cb976 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:48.396775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62d8f564-b7f4-45d9-a826-3c0c985cb976 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:48.397237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62d8f564-b7f4-45d9-a826-3c0c985cb976 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:48.427014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-62d8f564-b7f4-45d9-a826-3c0c985cb976 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045720 Apr 11 19:57:48.427584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 919/1787] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:48.439519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c6f2decd-021b-44e6-ade4-62306efd5679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:48.440468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c6f2decd-021b-44e6-ade4-62306efd5679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:48.446875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6f2decd-021b-44e6-ade4-62306efd5679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:48.447318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6f2decd-021b-44e6-ade4-62306efd5679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:48.448092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6f2decd-021b-44e6-ade4-62306efd5679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:48.448520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6f2decd-021b-44e6-ade4-62306efd5679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:48.477431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c6f2decd-021b-44e6-ade4-62306efd5679 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117710 Apr 11 19:57:48.478001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 869/1788] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:48.552928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-42ce5b5f-126c-473a-bdec-2ee61060c72f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:48.553846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-42ce5b5f-126c-473a-bdec-2ee61060c72f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:48.560048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42ce5b5f-126c-473a-bdec-2ee61060c72f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:48.560491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42ce5b5f-126c-473a-bdec-2ee61060c72f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:48.561289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42ce5b5f-126c-473a-bdec-2ee61060c72f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:48.561752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42ce5b5f-126c-473a-bdec-2ee61060c72f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:48.591180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-42ce5b5f-126c-473a-bdec-2ee61060c72f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042961 Apr 11 19:57:48.591733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 920/1789] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:49.068245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7ce47252-a299-4375-9865-7a705fa3e55a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:49.068855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7ce47252-a299-4375-9865-7a705fa3e55a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:49.075410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ce47252-a299-4375-9865-7a705fa3e55a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:49.075872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ce47252-a299-4375-9865-7a705fa3e55a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:49.076656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ce47252-a299-4375-9865-7a705fa3e55a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:49.077377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ce47252-a299-4375-9865-7a705fa3e55a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:49.152422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7ce47252-a299-4375-9865-7a705fa3e55a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:49.163919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7ce47252-a299-4375-9865-7a705fa3e55a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.099306 Apr 11 19:57:49.164730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 870/1790] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:49 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:49.438383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6dfaa024-370d-486f-9f47-c182ad71028e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:49.439388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6dfaa024-370d-486f-9f47-c182ad71028e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:49.446237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6dfaa024-370d-486f-9f47-c182ad71028e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:49.446690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6dfaa024-370d-486f-9f47-c182ad71028e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:49.447467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6dfaa024-370d-486f-9f47-c182ad71028e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:49.447897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6dfaa024-370d-486f-9f47-c182ad71028e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:49.478907 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6dfaa024-370d-486f-9f47-c182ad71028e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044544 Apr 11 19:57:49.479466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 921/1791] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:49.489185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bbebf357-a7c0-40ff-8274-d5dd9c5467c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:49.490113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bbebf357-a7c0-40ff-8274-d5dd9c5467c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:49.496674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbebf357-a7c0-40ff-8274-d5dd9c5467c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:49.497164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbebf357-a7c0-40ff-8274-d5dd9c5467c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:49.497923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbebf357-a7c0-40ff-8274-d5dd9c5467c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:49.498348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbebf357-a7c0-40ff-8274-d5dd9c5467c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:49.528379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bbebf357-a7c0-40ff-8274-d5dd9c5467c8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043107 Apr 11 19:57:49.528936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 871/1792] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:49.603351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-effb7693-83a2-429f-beb1-e3149927209a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:49.604301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-effb7693-83a2-429f-beb1-e3149927209a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:49.610608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-effb7693-83a2-429f-beb1-e3149927209a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:49.611052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-effb7693-83a2-429f-beb1-e3149927209a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:49.611816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-effb7693-83a2-429f-beb1-e3149927209a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:49.612250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-effb7693-83a2-429f-beb1-e3149927209a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:49.648875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-effb7693-83a2-429f-beb1-e3149927209a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049519 Apr 11 19:57:49.649493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 922/1793] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:50.183316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-26777f9e-5fb1-4df8-9fd7-ae78757f2ad9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:50.183959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-26777f9e-5fb1-4df8-9fd7-ae78757f2ad9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:50.190534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26777f9e-5fb1-4df8-9fd7-ae78757f2ad9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:50.190975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26777f9e-5fb1-4df8-9fd7-ae78757f2ad9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:50.191731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26777f9e-5fb1-4df8-9fd7-ae78757f2ad9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:50.192161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26777f9e-5fb1-4df8-9fd7-ae78757f2ad9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:50.254284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-26777f9e-5fb1-4df8-9fd7-ae78757f2ad9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:50.261985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-26777f9e-5fb1-4df8-9fd7-ae78757f2ad9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082744 Apr 11 19:57:50.262550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 872/1794] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:50 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:50.491401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-edcca68f-4116-4046-b963-646991ff7232 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:50.492342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-edcca68f-4116-4046-b963-646991ff7232 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:50.499057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edcca68f-4116-4046-b963-646991ff7232 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:50.499833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edcca68f-4116-4046-b963-646991ff7232 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:50.500607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edcca68f-4116-4046-b963-646991ff7232 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:50.501082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edcca68f-4116-4046-b963-646991ff7232 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:50.530480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-edcca68f-4116-4046-b963-646991ff7232 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043216 Apr 11 19:57:50.531027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 923/1795] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:50.539892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-927f8f81-c5e9-4ab4-aebd-adb0990512fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:50.540774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-927f8f81-c5e9-4ab4-aebd-adb0990512fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:50.547438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-927f8f81-c5e9-4ab4-aebd-adb0990512fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:50.547880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-927f8f81-c5e9-4ab4-aebd-adb0990512fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:50.548636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-927f8f81-c5e9-4ab4-aebd-adb0990512fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:50.549174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-927f8f81-c5e9-4ab4-aebd-adb0990512fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:50.579009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-927f8f81-c5e9-4ab4-aebd-adb0990512fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043099 Apr 11 19:57:50.579574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 873/1796] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:50.660033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ba219f12-0ebc-45dc-929e-67a3dfbecbfd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:50.660945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ba219f12-0ebc-45dc-929e-67a3dfbecbfd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:50.667597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba219f12-0ebc-45dc-929e-67a3dfbecbfd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:50.668044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba219f12-0ebc-45dc-929e-67a3dfbecbfd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:50.668811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba219f12-0ebc-45dc-929e-67a3dfbecbfd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:50.669264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba219f12-0ebc-45dc-929e-67a3dfbecbfd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:50.698229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ba219f12-0ebc-45dc-929e-67a3dfbecbfd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Apr 11 19:57:50.698788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 924/1797] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:51.282590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6854d746-42a0-4982-b350-b7b868cbf8c2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:51.283618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6854d746-42a0-4982-b350-b7b868cbf8c2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:51.293613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6854d746-42a0-4982-b350-b7b868cbf8c2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:51.294345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6854d746-42a0-4982-b350-b7b868cbf8c2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:51.295581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6854d746-42a0-4982-b350-b7b868cbf8c2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:51.296290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6854d746-42a0-4982-b350-b7b868cbf8c2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:51.364810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6854d746-42a0-4982-b350-b7b868cbf8c2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:51.374337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6854d746-42a0-4982-b350-b7b868cbf8c2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098211 Apr 11 19:57:51.375236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 874/1798] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:51 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:51.544053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56dcec71-e5f0-419e-b915-ba35503d7cb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:51.545037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56dcec71-e5f0-419e-b915-ba35503d7cb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:51.552282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56dcec71-e5f0-419e-b915-ba35503d7cb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:51.552730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56dcec71-e5f0-419e-b915-ba35503d7cb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:51.553521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56dcec71-e5f0-419e-b915-ba35503d7cb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:51.553954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56dcec71-e5f0-419e-b915-ba35503d7cb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:51.586308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56dcec71-e5f0-419e-b915-ba35503d7cb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047029 Apr 11 19:57:51.586878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 925/1799] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:51.590379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4175710b-3da0-4e54-ae56-55b48ff1d77e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:51.591316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4175710b-3da0-4e54-ae56-55b48ff1d77e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:51.598226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4175710b-3da0-4e54-ae56-55b48ff1d77e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:51.598677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4175710b-3da0-4e54-ae56-55b48ff1d77e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:51.599438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4175710b-3da0-4e54-ae56-55b48ff1d77e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:51.599870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4175710b-3da0-4e54-ae56-55b48ff1d77e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:51.631407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4175710b-3da0-4e54-ae56-55b48ff1d77e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Apr 11 19:57:51.631966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 875/1800] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:51.714413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5fbee08f-124b-4df8-bb78-42bae104c8ae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:51.715947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5fbee08f-124b-4df8-bb78-42bae104c8ae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:51.724461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5fbee08f-124b-4df8-bb78-42bae104c8ae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:51.724925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5fbee08f-124b-4df8-bb78-42bae104c8ae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:51.725719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5fbee08f-124b-4df8-bb78-42bae104c8ae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:51.726137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5fbee08f-124b-4df8-bb78-42bae104c8ae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:51.755712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5fbee08f-124b-4df8-bb78-42bae104c8ae tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048223 Apr 11 19:57:51.756464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 926/1801] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:52.393204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3fa00bef-934d-44ed-adab-9a1e6f2f866c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:52.393809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3fa00bef-934d-44ed-adab-9a1e6f2f866c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:52.400208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fa00bef-934d-44ed-adab-9a1e6f2f866c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:52.400650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fa00bef-934d-44ed-adab-9a1e6f2f866c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:52.401445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fa00bef-934d-44ed-adab-9a1e6f2f866c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:52.401872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fa00bef-934d-44ed-adab-9a1e6f2f866c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:52.598573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b71a9708-66fe-483a-92e9-f8e8706665f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:52.599409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b71a9708-66fe-483a-92e9-f8e8706665f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:52.606362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b71a9708-66fe-483a-92e9-f8e8706665f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:52.606812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b71a9708-66fe-483a-92e9-f8e8706665f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:52.607582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b71a9708-66fe-483a-92e9-f8e8706665f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:52.608013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b71a9708-66fe-483a-92e9-f8e8706665f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:52.639038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b71a9708-66fe-483a-92e9-f8e8706665f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044651 Apr 11 19:57:52.639773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 927/1802] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:52.644371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f6cc0dc4-bf58-46aa-bcc5-f62df60df5f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:52.645431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f6cc0dc4-bf58-46aa-bcc5-f62df60df5f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:52.651690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6cc0dc4-bf58-46aa-bcc5-f62df60df5f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:52.652126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6cc0dc4-bf58-46aa-bcc5-f62df60df5f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:52.652942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6cc0dc4-bf58-46aa-bcc5-f62df60df5f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:52.653364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6cc0dc4-bf58-46aa-bcc5-f62df60df5f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:52.678527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3fa00bef-934d-44ed-adab-9a1e6f2f866c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:52.683684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f6cc0dc4-bf58-46aa-bcc5-f62df60df5f6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Apr 11 19:57:52.684346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 928/1803] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:52.685839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3fa00bef-934d-44ed-adab-9a1e6f2f866c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.297549 Apr 11 19:57:52.686398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 876/1804] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:52 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:52.770946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c91018f7-ad3a-4898-83a6-1665773ef2bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:52.771878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c91018f7-ad3a-4898-83a6-1665773ef2bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:52.778279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c91018f7-ad3a-4898-83a6-1665773ef2bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:52.778721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c91018f7-ad3a-4898-83a6-1665773ef2bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:52.779476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c91018f7-ad3a-4898-83a6-1665773ef2bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:52.779895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c91018f7-ad3a-4898-83a6-1665773ef2bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:52.808939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c91018f7-ad3a-4898-83a6-1665773ef2bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042828 Apr 11 19:57:52.809530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 929/1805] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:53.651413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1951eb1b-db96-44cc-a968-38ac57a1ea3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:53.652349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1951eb1b-db96-44cc-a968-38ac57a1ea3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:53.659217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1951eb1b-db96-44cc-a968-38ac57a1ea3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:53.659642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1951eb1b-db96-44cc-a968-38ac57a1ea3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:53.660416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1951eb1b-db96-44cc-a968-38ac57a1ea3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:53.660848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1951eb1b-db96-44cc-a968-38ac57a1ea3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:53.690618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1951eb1b-db96-44cc-a968-38ac57a1ea3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043342 Apr 11 19:57:53.691317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 877/1806] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:53.695731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc7ca949-065e-4231-91df-cc06b24de22e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:53.696830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc7ca949-065e-4231-91df-cc06b24de22e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:53.702262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e101c622-4f32-41f5-9141-192803fee4be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:53.702787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e101c622-4f32-41f5-9141-192803fee4be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:53.703323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc7ca949-065e-4231-91df-cc06b24de22e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:53.703763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc7ca949-065e-4231-91df-cc06b24de22e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:53.704535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc7ca949-065e-4231-91df-cc06b24de22e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:53.704966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc7ca949-065e-4231-91df-cc06b24de22e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:53.708929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e101c622-4f32-41f5-9141-192803fee4be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:53.709418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e101c622-4f32-41f5-9141-192803fee4be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:53.710201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e101c622-4f32-41f5-9141-192803fee4be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:53.710632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e101c622-4f32-41f5-9141-192803fee4be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:53.734339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc7ca949-065e-4231-91df-cc06b24de22e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042596 Apr 11 19:57:53.735231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 930/1807] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:53.769811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e101c622-4f32-41f5-9141-192803fee4be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:53.777334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e101c622-4f32-41f5-9141-192803fee4be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.078821 Apr 11 19:57:53.777901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 878/1808] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:53 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:57:53.820431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-391ce197-f429-461d-bd56-ae21216f0040 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:53.821379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-391ce197-f429-461d-bd56-ae21216f0040 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:53.827473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-391ce197-f429-461d-bd56-ae21216f0040 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:53.827934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-391ce197-f429-461d-bd56-ae21216f0040 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:53.828666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-391ce197-f429-461d-bd56-ae21216f0040 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:53.829119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-391ce197-f429-461d-bd56-ae21216f0040 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:53.857941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-391ce197-f429-461d-bd56-ae21216f0040 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Apr 11 19:57:53.858527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 931/1809] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:54.702700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-51543318-ca05-4831-8432-10411f78f63b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:54.703626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-51543318-ca05-4831-8432-10411f78f63b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:54.710457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51543318-ca05-4831-8432-10411f78f63b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:54.710905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51543318-ca05-4831-8432-10411f78f63b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:54.711702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51543318-ca05-4831-8432-10411f78f63b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:54.712138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51543318-ca05-4831-8432-10411f78f63b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:54.740612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-51543318-ca05-4831-8432-10411f78f63b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042004 Apr 11 19:57:54.741199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 879/1810] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:54.746073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fa8640ba-a46c-4ebe-b18c-73f6d56a1a7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:54.747038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fa8640ba-a46c-4ebe-b18c-73f6d56a1a7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:54.754117 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa8640ba-a46c-4ebe-b18c-73f6d56a1a7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:54.754568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa8640ba-a46c-4ebe-b18c-73f6d56a1a7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:54.755332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa8640ba-a46c-4ebe-b18c-73f6d56a1a7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:54.755769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa8640ba-a46c-4ebe-b18c-73f6d56a1a7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:54.785360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fa8640ba-a46c-4ebe-b18c-73f6d56a1a7b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Apr 11 19:57:54.785915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 932/1811] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:54.794251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0ea3c4e0-8aa7-44d6-ae41-a8a518dc045e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:54.794863 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0ea3c4e0-8aa7-44d6-ae41-a8a518dc045e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:54.801390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ea3c4e0-8aa7-44d6-ae41-a8a518dc045e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:54.801844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ea3c4e0-8aa7-44d6-ae41-a8a518dc045e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:54.802601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ea3c4e0-8aa7-44d6-ae41-a8a518dc045e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:54.803033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ea3c4e0-8aa7-44d6-ae41-a8a518dc045e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:54.861730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0ea3c4e0-8aa7-44d6-ae41-a8a518dc045e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:54.869410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0ea3c4e0-8aa7-44d6-ae41-a8a518dc045e tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.078916 Apr 11 19:57:54.869899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 880/1812] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:54 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:54.870108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aed1e3a2-b4d5-4a7c-9605-8d54f19e69c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:54.871181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aed1e3a2-b4d5-4a7c-9605-8d54f19e69c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:54.877983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aed1e3a2-b4d5-4a7c-9605-8d54f19e69c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:54.878428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aed1e3a2-b4d5-4a7c-9605-8d54f19e69c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:54.879191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aed1e3a2-b4d5-4a7c-9605-8d54f19e69c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:54.879616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aed1e3a2-b4d5-4a7c-9605-8d54f19e69c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:54.907859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aed1e3a2-b4d5-4a7c-9605-8d54f19e69c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041674 Apr 11 19:57:54.908397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 933/1813] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:55.797793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-085e977c-f563-4447-8f1d-8445d642f2ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:55.798727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-085e977c-f563-4447-8f1d-8445d642f2ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:55.800802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6512f5c-481e-4a21-8bce-5181b534e809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:55.801749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a6512f5c-481e-4a21-8bce-5181b534e809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:55.805433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-085e977c-f563-4447-8f1d-8445d642f2ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:55.805882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-085e977c-f563-4447-8f1d-8445d642f2ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:55.806655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-085e977c-f563-4447-8f1d-8445d642f2ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:55.807086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-085e977c-f563-4447-8f1d-8445d642f2ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:55.807573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6512f5c-481e-4a21-8bce-5181b534e809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:55.808024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6512f5c-481e-4a21-8bce-5181b534e809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:55.808788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6512f5c-481e-4a21-8bce-5181b534e809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:55.809265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6512f5c-481e-4a21-8bce-5181b534e809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:55.838739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6512f5c-481e-4a21-8bce-5181b534e809 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090581 Apr 11 19:57:55.838977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-085e977c-f563-4447-8f1d-8445d642f2ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045072 Apr 11 19:57:55.839576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 881/1814] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:55.839710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 934/1815] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:55.887334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d61d3240-825d-4732-9464-3884b84b153b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:55.887989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d61d3240-825d-4732-9464-3884b84b153b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:55.895610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d61d3240-825d-4732-9464-3884b84b153b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:55.896062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d61d3240-825d-4732-9464-3884b84b153b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:55.896839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d61d3240-825d-4732-9464-3884b84b153b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:55.897314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d61d3240-825d-4732-9464-3884b84b153b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:55.920265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1a7bd36-e744-4c0c-9a08-0904dac786a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:55.921250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1a7bd36-e744-4c0c-9a08-0904dac786a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:55.927265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1a7bd36-e744-4c0c-9a08-0904dac786a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:55.927711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1a7bd36-e744-4c0c-9a08-0904dac786a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:55.928466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1a7bd36-e744-4c0c-9a08-0904dac786a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:55.928889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1a7bd36-e744-4c0c-9a08-0904dac786a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:55.957485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1a7bd36-e744-4c0c-9a08-0904dac786a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041282 Apr 11 19:57:55.958335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 935/1816] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:55.959045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d61d3240-825d-4732-9464-3884b84b153b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:55.968082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d61d3240-825d-4732-9464-3884b84b153b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085185 Apr 11 19:57:55.968679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 882/1817] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:55 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:56.851073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3fc8f19d-f68b-4fca-aa0a-0076106d591f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:56.851989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3fc8f19d-f68b-4fca-aa0a-0076106d591f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:56.853534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf4bcd54-cc87-428d-9110-f12032cabef1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:56.854478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf4bcd54-cc87-428d-9110-f12032cabef1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:56.858803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fc8f19d-f68b-4fca-aa0a-0076106d591f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:56.859243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fc8f19d-f68b-4fca-aa0a-0076106d591f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:56.860005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fc8f19d-f68b-4fca-aa0a-0076106d591f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:56.860429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fc8f19d-f68b-4fca-aa0a-0076106d591f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:56.860802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf4bcd54-cc87-428d-9110-f12032cabef1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:56.861299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf4bcd54-cc87-428d-9110-f12032cabef1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:56.862159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf4bcd54-cc87-428d-9110-f12032cabef1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:56.862585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf4bcd54-cc87-428d-9110-f12032cabef1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:56.890343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3fc8f19d-f68b-4fca-aa0a-0076106d591f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043134 Apr 11 19:57:56.890816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 936/1818] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:56.891486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf4bcd54-cc87-428d-9110-f12032cabef1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041849 Apr 11 19:57:56.892050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 883/1819] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:56.969581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f04a1898-2071-4e7c-bfd0-faca9ccd9273 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:56.970500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f04a1898-2071-4e7c-bfd0-faca9ccd9273 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:56.977098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f04a1898-2071-4e7c-bfd0-faca9ccd9273 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:56.977545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f04a1898-2071-4e7c-bfd0-faca9ccd9273 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:56.978298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f04a1898-2071-4e7c-bfd0-faca9ccd9273 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:56.978754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f04a1898-2071-4e7c-bfd0-faca9ccd9273 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:56.985387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f5c695bc-a0b8-46dc-91bf-29163350d147 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:56.985993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f5c695bc-a0b8-46dc-91bf-29163350d147 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:56.992369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5c695bc-a0b8-46dc-91bf-29163350d147 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:56.992827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5c695bc-a0b8-46dc-91bf-29163350d147 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:56.993647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5c695bc-a0b8-46dc-91bf-29163350d147 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:56.994072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5c695bc-a0b8-46dc-91bf-29163350d147 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:57.009874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f04a1898-2071-4e7c-bfd0-faca9ccd9273 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Apr 11 19:57:57.010707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 937/1820] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:57.057462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5c695bc-a0b8-46dc-91bf-29163350d147 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:57.065360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f5c695bc-a0b8-46dc-91bf-29163350d147 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083940 Apr 11 19:57:57.065956 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 884/1821] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:56 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:57.902923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b46367ff-c77c-40b7-8791-f14c73d10d36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:57.903494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2be693d7-d96d-4b09-8538-7ff6399d1700 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:57.903881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b46367ff-c77c-40b7-8791-f14c73d10d36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:57.904294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2be693d7-d96d-4b09-8538-7ff6399d1700 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:57.910484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2be693d7-d96d-4b09-8538-7ff6399d1700 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:57.910692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b46367ff-c77c-40b7-8791-f14c73d10d36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:57.910935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b46367ff-c77c-40b7-8791-f14c73d10d36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:57.911119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2be693d7-d96d-4b09-8538-7ff6399d1700 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:57.911699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2be693d7-d96d-4b09-8538-7ff6399d1700 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:57.911843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b46367ff-c77c-40b7-8791-f14c73d10d36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:57.912130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b46367ff-c77c-40b7-8791-f14c73d10d36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:57.912288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2be693d7-d96d-4b09-8538-7ff6399d1700 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:57.941924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b46367ff-c77c-40b7-8791-f14c73d10d36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042924 Apr 11 19:57:57.942175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2be693d7-d96d-4b09-8538-7ff6399d1700 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Apr 11 19:57:57.945960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 938/1822] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:57.946099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 885/1823] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:58.022920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f0a17611-d4e7-4417-8fcd-4adb5c3ab890 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:58.023871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f0a17611-d4e7-4417-8fcd-4adb5c3ab890 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:58.030308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0a17611-d4e7-4417-8fcd-4adb5c3ab890 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:58.030778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0a17611-d4e7-4417-8fcd-4adb5c3ab890 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:58.031545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0a17611-d4e7-4417-8fcd-4adb5c3ab890 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:58.031968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0a17611-d4e7-4417-8fcd-4adb5c3ab890 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:58.061691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f0a17611-d4e7-4417-8fcd-4adb5c3ab890 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042707 Apr 11 19:57:58.062584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 939/1824] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:58.082392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-747f54d4-db52-491d-8c57-50f9ee6ebe18 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:58.082996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-747f54d4-db52-491d-8c57-50f9ee6ebe18 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:58.090652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-747f54d4-db52-491d-8c57-50f9ee6ebe18 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:58.091116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-747f54d4-db52-491d-8c57-50f9ee6ebe18 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:58.091900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-747f54d4-db52-491d-8c57-50f9ee6ebe18 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:58.092335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-747f54d4-db52-491d-8c57-50f9ee6ebe18 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:58.154224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-747f54d4-db52-491d-8c57-50f9ee6ebe18 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:58.162692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-747f54d4-db52-491d-8c57-50f9ee6ebe18 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084088 Apr 11 19:57:58.163392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 886/1825] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:58 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:57:58.953933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e5c82f26-675f-468c-931f-1502472516ee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:58.954456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-759d79c8-bb92-411f-b034-28e5e0db88d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:58.954842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e5c82f26-675f-468c-931f-1502472516ee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:58.956045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-759d79c8-bb92-411f-b034-28e5e0db88d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:58.961845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5c82f26-675f-468c-931f-1502472516ee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:58.962313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5c82f26-675f-468c-931f-1502472516ee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:58.963080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5c82f26-675f-468c-931f-1502472516ee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:58.963388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-759d79c8-bb92-411f-b034-28e5e0db88d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:58.963519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5c82f26-675f-468c-931f-1502472516ee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:58.963854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-759d79c8-bb92-411f-b034-28e5e0db88d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:58.964626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-759d79c8-bb92-411f-b034-28e5e0db88d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:58.965152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-759d79c8-bb92-411f-b034-28e5e0db88d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:58.995003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-759d79c8-bb92-411f-b034-28e5e0db88d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044928 Apr 11 19:57:58.995601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 887/1826] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:57:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:57:58.998090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e5c82f26-675f-468c-931f-1502472516ee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048075 Apr 11 19:57:58.998661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 940/1827] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:59.073803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db312573-e1ef-45da-9963-df04c0cdeac1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:59.074726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db312573-e1ef-45da-9963-df04c0cdeac1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:59.081389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db312573-e1ef-45da-9963-df04c0cdeac1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:59.081832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db312573-e1ef-45da-9963-df04c0cdeac1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:59.082594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db312573-e1ef-45da-9963-df04c0cdeac1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:59.083019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db312573-e1ef-45da-9963-df04c0cdeac1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:59.113168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db312573-e1ef-45da-9963-df04c0cdeac1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043378 Apr 11 19:57:59.113717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 888/1828] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:57:59 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:57:59.180999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff17577f-dadb-43c2-90b4-98a7c9a13ef8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:57:59.181606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff17577f-dadb-43c2-90b4-98a7c9a13ef8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:57:59.188454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff17577f-dadb-43c2-90b4-98a7c9a13ef8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:59.188933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff17577f-dadb-43c2-90b4-98a7c9a13ef8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:59.189788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff17577f-dadb-43c2-90b4-98a7c9a13ef8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:57:59.190242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff17577f-dadb-43c2-90b4-98a7c9a13ef8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:57:59.298120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff17577f-dadb-43c2-90b4-98a7c9a13ef8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:57:59.306200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff17577f-dadb-43c2-90b4-98a7c9a13ef8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.129046 Apr 11 19:57:59.306746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 941/1829] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:57:59 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:00.007138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c4630486-fee2-407e-877f-7438d434adcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:00.008043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c4630486-fee2-407e-877f-7438d434adcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:00.010095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee89465c-f3ce-48e1-8ae6-069917a6b9a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:00.011091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee89465c-f3ce-48e1-8ae6-069917a6b9a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:00.014977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4630486-fee2-407e-877f-7438d434adcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:00.015424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4630486-fee2-407e-877f-7438d434adcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:00.016188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4630486-fee2-407e-877f-7438d434adcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:00.016641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4630486-fee2-407e-877f-7438d434adcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:00.018446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee89465c-f3ce-48e1-8ae6-069917a6b9a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:00.019197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee89465c-f3ce-48e1-8ae6-069917a6b9a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:00.020438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee89465c-f3ce-48e1-8ae6-069917a6b9a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:00.021234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee89465c-f3ce-48e1-8ae6-069917a6b9a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:00.054045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c4630486-fee2-407e-877f-7438d434adcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050943 Apr 11 19:58:00.054623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 889/1830] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:00.056334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee89465c-f3ce-48e1-8ae6-069917a6b9a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050214 Apr 11 19:58:00.056921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 942/1831] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:00.127876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bad1ce47-3e50-423b-a22b-ac2ec6e6b6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:00.128845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bad1ce47-3e50-423b-a22b-ac2ec6e6b6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:00.135831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bad1ce47-3e50-423b-a22b-ac2ec6e6b6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:00.136270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bad1ce47-3e50-423b-a22b-ac2ec6e6b6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:00.137146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bad1ce47-3e50-423b-a22b-ac2ec6e6b6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:00.137567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bad1ce47-3e50-423b-a22b-ac2ec6e6b6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:00.170253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bad1ce47-3e50-423b-a22b-ac2ec6e6b6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047352 Apr 11 19:58:00.170859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 890/1832] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:00.325896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0682d5a7-317e-439d-8944-d83b65c72ac0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:00.326415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0682d5a7-317e-439d-8944-d83b65c72ac0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:00.333435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0682d5a7-317e-439d-8944-d83b65c72ac0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:00.333885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0682d5a7-317e-439d-8944-d83b65c72ac0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:00.334649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0682d5a7-317e-439d-8944-d83b65c72ac0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:00.335081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0682d5a7-317e-439d-8944-d83b65c72ac0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:00.396648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0682d5a7-317e-439d-8944-d83b65c72ac0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:00.404373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0682d5a7-317e-439d-8944-d83b65c72ac0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083137 Apr 11 19:58:00.404935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 943/1833] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:00 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:58:01.066719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-891dce31-c678-4745-8a01-3a00df5fdc94 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:01.067690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-891dce31-c678-4745-8a01-3a00df5fdc94 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:01.067853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-577682e4-b4fb-484e-b54a-8e46da492961 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:01.068635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-577682e4-b4fb-484e-b54a-8e46da492961 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:01.074298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-891dce31-c678-4745-8a01-3a00df5fdc94 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:01.074751 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-891dce31-c678-4745-8a01-3a00df5fdc94 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:01.075258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-577682e4-b4fb-484e-b54a-8e46da492961 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:01.075521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-891dce31-c678-4745-8a01-3a00df5fdc94 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:01.075798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-577682e4-b4fb-484e-b54a-8e46da492961 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:01.075955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-891dce31-c678-4745-8a01-3a00df5fdc94 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:01.076680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-577682e4-b4fb-484e-b54a-8e46da492961 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:01.077196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-577682e4-b4fb-484e-b54a-8e46da492961 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:01.105639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-891dce31-c678-4745-8a01-3a00df5fdc94 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043442 Apr 11 19:58:01.106464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-577682e4-b4fb-484e-b54a-8e46da492961 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042316 Apr 11 19:58:01.106592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 891/1834] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:01.106995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 944/1835] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:01.182007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-30d5085d-8598-4212-9d6c-26b82dcd87f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:01.182952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-30d5085d-8598-4212-9d6c-26b82dcd87f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:01.189599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30d5085d-8598-4212-9d6c-26b82dcd87f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:01.190053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30d5085d-8598-4212-9d6c-26b82dcd87f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:01.192132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30d5085d-8598-4212-9d6c-26b82dcd87f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:01.192132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30d5085d-8598-4212-9d6c-26b82dcd87f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:01.221464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-30d5085d-8598-4212-9d6c-26b82dcd87f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Apr 11 19:58:01.222040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 892/1836] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:01.421813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9416ab3c-ac7e-4d05-b6c7-99a1ad374cc1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:01.422313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9416ab3c-ac7e-4d05-b6c7-99a1ad374cc1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:01.428861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9416ab3c-ac7e-4d05-b6c7-99a1ad374cc1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:01.429346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9416ab3c-ac7e-4d05-b6c7-99a1ad374cc1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:01.430102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9416ab3c-ac7e-4d05-b6c7-99a1ad374cc1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:01.430535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9416ab3c-ac7e-4d05-b6c7-99a1ad374cc1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:01.492848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9416ab3c-ac7e-4d05-b6c7-99a1ad374cc1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:01.501056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9416ab3c-ac7e-4d05-b6c7-99a1ad374cc1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083300 Apr 11 19:58:01.501615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 945/1837] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:01 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:02.118271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3ce87cf8-3f55-4676-82ee-b1a66489b606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:02.118935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ffe1ef09-8ee0-40a6-9352-62ea2f826206 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:02.119327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3ce87cf8-3f55-4676-82ee-b1a66489b606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:02.119417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ffe1ef09-8ee0-40a6-9352-62ea2f826206 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:02.126131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ce87cf8-3f55-4676-82ee-b1a66489b606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:02.126575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ce87cf8-3f55-4676-82ee-b1a66489b606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:02.126711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffe1ef09-8ee0-40a6-9352-62ea2f826206 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:02.127096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffe1ef09-8ee0-40a6-9352-62ea2f826206 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:02.127378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ce87cf8-3f55-4676-82ee-b1a66489b606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:02.127816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ce87cf8-3f55-4676-82ee-b1a66489b606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:02.128114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffe1ef09-8ee0-40a6-9352-62ea2f826206 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:02.128555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ffe1ef09-8ee0-40a6-9352-62ea2f826206 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:02.160071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ffe1ef09-8ee0-40a6-9352-62ea2f826206 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Apr 11 19:58:02.160371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3ce87cf8-3f55-4676-82ee-b1a66489b606 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046102 Apr 11 19:58:02.160682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 946/1838] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:02.160837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 893/1839] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:02.233476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-78f3a259-9db4-4025-a59a-dbef38d153cc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:02.234404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-78f3a259-9db4-4025-a59a-dbef38d153cc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:02.240778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78f3a259-9db4-4025-a59a-dbef38d153cc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:02.241252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78f3a259-9db4-4025-a59a-dbef38d153cc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:02.242011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78f3a259-9db4-4025-a59a-dbef38d153cc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:02.242440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78f3a259-9db4-4025-a59a-dbef38d153cc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:02.271292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-78f3a259-9db4-4025-a59a-dbef38d153cc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Apr 11 19:58:02.271847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 947/1840] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:02.518735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9229164d-f100-4ab8-8aed-97720d391ec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:02.519321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9229164d-f100-4ab8-8aed-97720d391ec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:02.525888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9229164d-f100-4ab8-8aed-97720d391ec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:02.526344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9229164d-f100-4ab8-8aed-97720d391ec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:02.527120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9229164d-f100-4ab8-8aed-97720d391ec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:02.527558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9229164d-f100-4ab8-8aed-97720d391ec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:02.635404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9229164d-f100-4ab8-8aed-97720d391ec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:02.643191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9229164d-f100-4ab8-8aed-97720d391ec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.128362 Apr 11 19:58:02.643724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 894/1841] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:02 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:03.172343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13f1183a-ba41-4cd7-8d9e-3e58f7449782 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:03.173072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-76e4914e-ee40-4fc9-b646-a579156be961 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:03.173494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13f1183a-ba41-4cd7-8d9e-3e58f7449782 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:03.174005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-76e4914e-ee40-4fc9-b646-a579156be961 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:03.180187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13f1183a-ba41-4cd7-8d9e-3e58f7449782 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:03.180636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13f1183a-ba41-4cd7-8d9e-3e58f7449782 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:03.181288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76e4914e-ee40-4fc9-b646-a579156be961 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:03.181398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13f1183a-ba41-4cd7-8d9e-3e58f7449782 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:03.181833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76e4914e-ee40-4fc9-b646-a579156be961 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:03.181937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13f1183a-ba41-4cd7-8d9e-3e58f7449782 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:03.182834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76e4914e-ee40-4fc9-b646-a579156be961 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:03.183381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76e4914e-ee40-4fc9-b646-a579156be961 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:03.214886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13f1183a-ba41-4cd7-8d9e-3e58f7449782 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046523 Apr 11 19:58:03.215458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 948/1842] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:03.217801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-76e4914e-ee40-4fc9-b646-a579156be961 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049503 Apr 11 19:58:03.218410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 895/1843] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:58:03.283768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6400a4c-312a-42a3-984f-7c00dfbc56fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:03.284724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a6400a4c-312a-42a3-984f-7c00dfbc56fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:03.291778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6400a4c-312a-42a3-984f-7c00dfbc56fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:03.292226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6400a4c-312a-42a3-984f-7c00dfbc56fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:03.293023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6400a4c-312a-42a3-984f-7c00dfbc56fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:03.293457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6400a4c-312a-42a3-984f-7c00dfbc56fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:03.324243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a6400a4c-312a-42a3-984f-7c00dfbc56fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Apr 11 19:58:03.324859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 949/1844] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:03.660341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1c2635a8-6d76-4959-a9fe-b3b2990fdaac tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:03.661100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1c2635a8-6d76-4959-a9fe-b3b2990fdaac tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:03.669504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c2635a8-6d76-4959-a9fe-b3b2990fdaac tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:03.669945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c2635a8-6d76-4959-a9fe-b3b2990fdaac tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:03.670715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c2635a8-6d76-4959-a9fe-b3b2990fdaac tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:03.671200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c2635a8-6d76-4959-a9fe-b3b2990fdaac tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:03.735534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1c2635a8-6d76-4959-a9fe-b3b2990fdaac tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:03.744279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1c2635a8-6d76-4959-a9fe-b3b2990fdaac tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088262 Apr 11 19:58:03.744832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 896/1845] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:03 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:04.009763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:58:04.010052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 19:58:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 19:58:04.226839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9deb76c1-49eb-43e7-bc6f-3b26c0fa8c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:04.228066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9deb76c1-49eb-43e7-bc6f-3b26c0fa8c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:04.229743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0fca649f-76fc-4724-be70-6a36cfb6eadf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:04.230705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0fca649f-76fc-4724-be70-6a36cfb6eadf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:04.235583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9deb76c1-49eb-43e7-bc6f-3b26c0fa8c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:04.235919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9deb76c1-49eb-43e7-bc6f-3b26c0fa8c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:04.236928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9deb76c1-49eb-43e7-bc6f-3b26c0fa8c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:04.237362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9deb76c1-49eb-43e7-bc6f-3b26c0fa8c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:04.237721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0fca649f-76fc-4724-be70-6a36cfb6eadf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:04.238543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0fca649f-76fc-4724-be70-6a36cfb6eadf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:04.239345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0fca649f-76fc-4724-be70-6a36cfb6eadf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:04.239778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0fca649f-76fc-4724-be70-6a36cfb6eadf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:04.276362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0fca649f-76fc-4724-be70-6a36cfb6eadf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050680 Apr 11 19:58:04.277268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 897/1846] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:04.283603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9deb76c1-49eb-43e7-bc6f-3b26c0fa8c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060865 Apr 11 19:58:04.284703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 950/1847] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:04.336098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae02f64e-cd8e-4611-81f1-a9161aad16fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:04.337015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae02f64e-cd8e-4611-81f1-a9161aad16fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:04.344832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae02f64e-cd8e-4611-81f1-a9161aad16fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:04.345317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae02f64e-cd8e-4611-81f1-a9161aad16fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:04.346121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae02f64e-cd8e-4611-81f1-a9161aad16fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:04.346556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae02f64e-cd8e-4611-81f1-a9161aad16fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:04.380958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae02f64e-cd8e-4611-81f1-a9161aad16fe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048799 Apr 11 19:58:04.381534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 898/1848] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:04.761729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25572505-ca31-4f7a-8123-f65ec0dc811b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:04.762344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25572505-ca31-4f7a-8123-f65ec0dc811b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:04.769743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25572505-ca31-4f7a-8123-f65ec0dc811b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:04.770220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25572505-ca31-4f7a-8123-f65ec0dc811b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:04.770999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25572505-ca31-4f7a-8123-f65ec0dc811b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:04.771424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25572505-ca31-4f7a-8123-f65ec0dc811b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:04.840678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25572505-ca31-4f7a-8123-f65ec0dc811b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:04.849735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25572505-ca31-4f7a-8123-f65ec0dc811b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.091987 Apr 11 19:58:04.850306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 951/1849] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:04 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:05.157858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f385fa23-e738-4ae6-9eac-c77fe19342ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:05.158534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f385fa23-e738-4ae6-9eac-c77fe19342ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:05.167346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f385fa23-e738-4ae6-9eac-c77fe19342ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.167848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f385fa23-e738-4ae6-9eac-c77fe19342ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.168789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f385fa23-e738-4ae6-9eac-c77fe19342ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.169265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f385fa23-e738-4ae6-9eac-c77fe19342ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.288547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-796f0f85-7580-4b4a-b3c7-5e2224fd4caa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:05.289550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-796f0f85-7580-4b4a-b3c7-5e2224fd4caa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:05.296342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796f0f85-7580-4b4a-b3c7-5e2224fd4caa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.296784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796f0f85-7580-4b4a-b3c7-5e2224fd4caa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.297580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796f0f85-7580-4b4a-b3c7-5e2224fd4caa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.298005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796f0f85-7580-4b4a-b3c7-5e2224fd4caa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.329683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-796f0f85-7580-4b4a-b3c7-5e2224fd4caa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045151 Apr 11 19:58:05.330412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 952/1850] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:58:05.335195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-72b992d5-2f6d-4ae9-858f-696c445cf920 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:05.336111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-72b992d5-2f6d-4ae9-858f-696c445cf920 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:05.342836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72b992d5-2f6d-4ae9-858f-696c445cf920 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.343278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72b992d5-2f6d-4ae9-858f-696c445cf920 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.344024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72b992d5-2f6d-4ae9-858f-696c445cf920 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.344449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72b992d5-2f6d-4ae9-858f-696c445cf920 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.374973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-72b992d5-2f6d-4ae9-858f-696c445cf920 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043167 Apr 11 19:58:05.375564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 953/1851] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:05.392986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-28a95568-4d23-429a-9eda-123ff1c98f05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:05.393930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-28a95568-4d23-429a-9eda-123ff1c98f05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:05.400107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28a95568-4d23-429a-9eda-123ff1c98f05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.400551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28a95568-4d23-429a-9eda-123ff1c98f05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.401382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28a95568-4d23-429a-9eda-123ff1c98f05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.401805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28a95568-4d23-429a-9eda-123ff1c98f05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.431365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-28a95568-4d23-429a-9eda-123ff1c98f05 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042505 Apr 11 19:58:05.431952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 954/1852] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:05.866534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5e4a7d38-a510-46ab-897c-51c318c33ae7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:05.867139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5e4a7d38-a510-46ab-897c-51c318c33ae7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:05.873594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e4a7d38-a510-46ab-897c-51c318c33ae7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.874037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e4a7d38-a510-46ab-897c-51c318c33ae7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.875110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e4a7d38-a510-46ab-897c-51c318c33ae7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:05.875535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e4a7d38-a510-46ab-897c-51c318c33ae7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:05.948149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5e4a7d38-a510-46ab-897c-51c318c33ae7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:05.956082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5e4a7d38-a510-46ab-897c-51c318c33ae7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093428 Apr 11 19:58:05.956959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 955/1853] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:05 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:06.181831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-781d5804-36c2-4bc1-afa3-333c396f6035 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:06.182321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-781d5804-36c2-4bc1-afa3-333c396f6035 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:06.190532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-781d5804-36c2-4bc1-afa3-333c396f6035 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.190798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-781d5804-36c2-4bc1-afa3-333c396f6035 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.191592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-781d5804-36c2-4bc1-afa3-333c396f6035 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.192023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-781d5804-36c2-4bc1-afa3-333c396f6035 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.217509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-781d5804-36c2-4bc1-afa3-333c396f6035 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 19:58:06.301658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-781d5804-36c2-4bc1-afa3-333c396f6035 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "DELETE /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 204 len: 0 microversion: 2.1 time: 0.123433 Apr 11 19:58:06.302368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 956/1854] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 19:58:06 2022] DELETE /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 19:58:06.311290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-57338052-4613-488f-94b3-fdc5932eb780 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:06.312013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-57338052-4613-488f-94b3-fdc5932eb780 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:06.318305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57338052-4613-488f-94b3-fdc5932eb780 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.318755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57338052-4613-488f-94b3-fdc5932eb780 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.319529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57338052-4613-488f-94b3-fdc5932eb780 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.319961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57338052-4613-488f-94b3-fdc5932eb780 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.460233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-57338052-4613-488f-94b3-fdc5932eb780 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:06.470268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-57338052-4613-488f-94b3-fdc5932eb780 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1690 microversion: 2.1 time: 0.163213 Apr 11 19:58:06.470874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 957/1855] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:06 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:58:06.475727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-33cc6571-ea26-4d6a-bb37-b2c647a4f654 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:06.476860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-33cc6571-ea26-4d6a-bb37-b2c647a4f654 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:06.484628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33cc6571-ea26-4d6a-bb37-b2c647a4f654 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.485157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33cc6571-ea26-4d6a-bb37-b2c647a4f654 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.485933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33cc6571-ea26-4d6a-bb37-b2c647a4f654 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.486478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33cc6571-ea26-4d6a-bb37-b2c647a4f654 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.517236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-33cc6571-ea26-4d6a-bb37-b2c647a4f654 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045187 Apr 11 19:58:06.517898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 958/1856] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:06.522570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6807fec5-ea83-4e23-a1f3-246299ad8d26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:06.523495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6807fec5-ea83-4e23-a1f3-246299ad8d26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:06.530232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6807fec5-ea83-4e23-a1f3-246299ad8d26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.530681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6807fec5-ea83-4e23-a1f3-246299ad8d26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.531448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6807fec5-ea83-4e23-a1f3-246299ad8d26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.531880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6807fec5-ea83-4e23-a1f3-246299ad8d26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.562070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6807fec5-ea83-4e23-a1f3-246299ad8d26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043112 Apr 11 19:58:06.562645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 959/1857] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:06.567358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-816a6bdc-4fc0-459e-b3e9-4ed43d513738 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:06.568273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-816a6bdc-4fc0-459e-b3e9-4ed43d513738 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:06.574699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-816a6bdc-4fc0-459e-b3e9-4ed43d513738 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.575176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-816a6bdc-4fc0-459e-b3e9-4ed43d513738 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.575946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-816a6bdc-4fc0-459e-b3e9-4ed43d513738 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.576350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-816a6bdc-4fc0-459e-b3e9-4ed43d513738 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.614704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-816a6bdc-4fc0-459e-b3e9-4ed43d513738 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050993 Apr 11 19:58:06.615677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 960/1858] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:06.974314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d687c5e4-ecd0-44f0-b695-d69ccc540eb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:06.974929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d687c5e4-ecd0-44f0-b695-d69ccc540eb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:06.981167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d687c5e4-ecd0-44f0-b695-d69ccc540eb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.981620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d687c5e4-ecd0-44f0-b695-d69ccc540eb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:06.982405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d687c5e4-ecd0-44f0-b695-d69ccc540eb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:06.982837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d687c5e4-ecd0-44f0-b695-d69ccc540eb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.051238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d687c5e4-ecd0-44f0-b695-d69ccc540eb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:07.059389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d687c5e4-ecd0-44f0-b695-d69ccc540eb9 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088915 Apr 11 19:58:07.060016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 961/1859] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:06 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:07.488815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-984ca23b-e5a4-4586-92a4-ebfe2c85f887 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:07.489520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-984ca23b-e5a4-4586-92a4-ebfe2c85f887 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:07.496092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-984ca23b-e5a4-4586-92a4-ebfe2c85f887 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.496520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-984ca23b-e5a4-4586-92a4-ebfe2c85f887 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.497321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-984ca23b-e5a4-4586-92a4-ebfe2c85f887 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.497754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-984ca23b-e5a4-4586-92a4-ebfe2c85f887 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.568542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-984ca23b-e5a4-4586-92a4-ebfe2c85f887 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:07.576184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-984ca23b-e5a4-4586-92a4-ebfe2c85f887 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 200 len: 1622 microversion: 2.1 time: 0.091238 Apr 11 19:58:07.576760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 962/1860] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:07 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 1622 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:58:07.581734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e11eb6d7-a44b-4b9c-8c61-e5f363caaa89 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:07.582654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e11eb6d7-a44b-4b9c-8c61-e5f363caaa89 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:07.590638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e11eb6d7-a44b-4b9c-8c61-e5f363caaa89 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.591051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e11eb6d7-a44b-4b9c-8c61-e5f363caaa89 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.591861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e11eb6d7-a44b-4b9c-8c61-e5f363caaa89 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.592293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e11eb6d7-a44b-4b9c-8c61-e5f363caaa89 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.630077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e11eb6d7-a44b-4b9c-8c61-e5f363caaa89 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052231 Apr 11 19:58:07.631487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 963/1861] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:07.636705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-41d64b61-007e-4b8a-bdd3-51d5cfcc852b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:07.637636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-41d64b61-007e-4b8a-bdd3-51d5cfcc852b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:07.643957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41d64b61-007e-4b8a-bdd3-51d5cfcc852b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.644461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41d64b61-007e-4b8a-bdd3-51d5cfcc852b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.645206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41d64b61-007e-4b8a-bdd3-51d5cfcc852b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.645619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41d64b61-007e-4b8a-bdd3-51d5cfcc852b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.684621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-41d64b61-007e-4b8a-bdd3-51d5cfcc852b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051552 Apr 11 19:58:07.685422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 964/1862] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:07.691197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07168a4b-6572-4ddf-8fec-57e42e51ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:07.692141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07168a4b-6572-4ddf-8fec-57e42e51ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:07.698452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07168a4b-6572-4ddf-8fec-57e42e51ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.698904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07168a4b-6572-4ddf-8fec-57e42e51ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.699681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07168a4b-6572-4ddf-8fec-57e42e51ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.700121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07168a4b-6572-4ddf-8fec-57e42e51ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.750152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07168a4b-6572-4ddf-8fec-57e42e51ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063193 Apr 11 19:58:07.750752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 965/1863] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:07.757226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-f026f9c3-a664-42cc-bff5-4bb46bb2a2b1 req-d8a97f87-a3dd-4d55-875a-586708980358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62434824-2496-481a-908e-420cbb083eb4", "name": "network-vif-deleted", "tag": "409a162a-d663-4d40-a44e-b1539f5fae5d"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:07.767439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-f026f9c3-a664-42cc-bff5-4bb46bb2a2b1 req-d8a97f87-a3dd-4d55-875a-586708980358 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:07.767956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-f026f9c3-a664-42cc-bff5-4bb46bb2a2b1 req-d8a97f87-a3dd-4d55-875a-586708980358 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:07.781795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-f026f9c3-a664-42cc-bff5-4bb46bb2a2b1 req-d8a97f87-a3dd-4d55-875a-586708980358 service nova] Creating event network-vif-deleted:409a162a-d663-4d40-a44e-b1539f5fae5d for instance 62434824-2496-481a-908e-420cbb083eb4 on hv-cinder-83078 Apr 11 19:58:07.787748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-f026f9c3-a664-42cc-bff5-4bb46bb2a2b1 req-d8a97f87-a3dd-4d55-875a-586708980358 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035770 Apr 11 19:58:07.788560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 966/1864] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 19:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:08.081482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d7fb178-9fcc-4b19-9e9b-86905f1d19a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:08.082245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d7fb178-9fcc-4b19-9e9b-86905f1d19a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:08.089336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d7fb178-9fcc-4b19-9e9b-86905f1d19a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.089885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d7fb178-9fcc-4b19-9e9b-86905f1d19a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.090756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d7fb178-9fcc-4b19-9e9b-86905f1d19a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.091199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d7fb178-9fcc-4b19-9e9b-86905f1d19a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.172647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9d7fb178-9fcc-4b19-9e9b-86905f1d19a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:08.180698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d7fb178-9fcc-4b19-9e9b-86905f1d19a5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.103535 Apr 11 19:58:08.182140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 967/1865] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:08 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:08.593787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:08.594413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 62434824-2496-481a-908e-420cbb083eb4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:08.603725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.604173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.605004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.605407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.619860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] HTTP exception thrown: Instance 62434824-2496-481a-908e-420cbb083eb4 could not be found. Apr 11 19:58:08.620493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Returning 404 to user: Instance 62434824-2496-481a-908e-420cbb083eb4 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 19:58:08.621378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eaa90696-f127-42ce-bfec-7e9a8fc6cd8b tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4" status: 404 len: 111 microversion: 2.1 time: 0.031911 Apr 11 19:58:08.621944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 968/1866] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:08 2022] GET /compute/v2.1/servers/62434824-2496-481a-908e-420cbb083eb4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 19:58:08.630710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9146795b-8bf8-48bf-8a93-5226dad19f95 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '.version_select at 0x7f4086e6e430>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:08.656965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9146795b-8bf8-48bf-8a93-5226dad19f95 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729070753" status: 202 len: 0 microversion: 2.1 time: 0.029980 Apr 11 19:58:08.657602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 969/1867] 10.222.0.62 () {58 vars in 1220 bytes} [Mon Apr 11 19:58:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729070753 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:58:08.662499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8443909-6bfa-4dae-8bca-b4ac769ad349 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:08.663430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8443909-6bfa-4dae-8bca-b4ac769ad349 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:08.671646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8443909-6bfa-4dae-8bca-b4ac769ad349 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.672076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8443909-6bfa-4dae-8bca-b4ac769ad349 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.673732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8443909-6bfa-4dae-8bca-b4ac769ad349 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.673732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8443909-6bfa-4dae-8bca-b4ac769ad349 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.707024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8443909-6bfa-4dae-8bca-b4ac769ad349 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048430 Apr 11 19:58:08.707846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 970/1868] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:08.714489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d76db0a1-e05f-4dca-aaf9-259ac69fa091 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:08.714489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d76db0a1-e05f-4dca-aaf9-259ac69fa091 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:08.720346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d76db0a1-e05f-4dca-aaf9-259ac69fa091 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.721540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d76db0a1-e05f-4dca-aaf9-259ac69fa091 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.722914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d76db0a1-e05f-4dca-aaf9-259ac69fa091 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.723336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d76db0a1-e05f-4dca-aaf9-259ac69fa091 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.807206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d76db0a1-e05f-4dca-aaf9-259ac69fa091 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/action" status: 200 len: 41884 microversion: 2.1 time: 0.097968 Apr 11 19:58:08.808514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 971/1869] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 19:58:08 2022] POST /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4/action => generated 41884 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:08.815059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8905e10b-5abb-4c10-94d0-c40acf509a82 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:08.816138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8905e10b-5abb-4c10-94d0-c40acf509a82 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:08.823284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8905e10b-5abb-4c10-94d0-c40acf509a82 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.823886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8905e10b-5abb-4c10-94d0-c40acf509a82 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.824772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8905e10b-5abb-4c10-94d0-c40acf509a82 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:08.825327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8905e10b-5abb-4c10-94d0-c40acf509a82 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:08.869191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8905e10b-5abb-4c10-94d0-c40acf509a82 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059199 Apr 11 19:58:08.870090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 972/1870] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:09.205032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-406d7e93-527e-4c64-92e7-aabe47ebfddf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:09.205696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-406d7e93-527e-4c64-92e7-aabe47ebfddf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:09.211913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406d7e93-527e-4c64-92e7-aabe47ebfddf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:09.212369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406d7e93-527e-4c64-92e7-aabe47ebfddf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:09.213188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406d7e93-527e-4c64-92e7-aabe47ebfddf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:09.213630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406d7e93-527e-4c64-92e7-aabe47ebfddf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:09.278075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-406d7e93-527e-4c64-92e7-aabe47ebfddf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:09.286441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-406d7e93-527e-4c64-92e7-aabe47ebfddf tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086506 Apr 11 19:58:09.296175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 973/1871] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:09 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:09.719532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-03202797-446b-4d16-bec3-9899676dd0ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:09.720506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-03202797-446b-4d16-bec3-9899676dd0ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:09.727687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03202797-446b-4d16-bec3-9899676dd0ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:09.728139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03202797-446b-4d16-bec3-9899676dd0ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:09.728954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03202797-446b-4d16-bec3-9899676dd0ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:09.729395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03202797-446b-4d16-bec3-9899676dd0ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:09.761639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-03202797-446b-4d16-bec3-9899676dd0ff tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046146 Apr 11 19:58:09.762214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 974/1872] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:09.883602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50d9e2d9-60cf-4ba8-9d54-251be7a55444 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:09.885047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50d9e2d9-60cf-4ba8-9d54-251be7a55444 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:09.893478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50d9e2d9-60cf-4ba8-9d54-251be7a55444 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:09.894084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50d9e2d9-60cf-4ba8-9d54-251be7a55444 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:09.895053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50d9e2d9-60cf-4ba8-9d54-251be7a55444 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:09.895692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50d9e2d9-60cf-4ba8-9d54-251be7a55444 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:09.926681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50d9e2d9-60cf-4ba8-9d54-251be7a55444 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049031 Apr 11 19:58:09.927280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 975/1873] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:10.304336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6701659c-5e76-4fda-a840-146e63da3e58 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:10.305009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6701659c-5e76-4fda-a840-146e63da3e58 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:10.311883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6701659c-5e76-4fda-a840-146e63da3e58 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:10.312349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6701659c-5e76-4fda-a840-146e63da3e58 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:10.313163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6701659c-5e76-4fda-a840-146e63da3e58 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:10.313622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6701659c-5e76-4fda-a840-146e63da3e58 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:10.386156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6701659c-5e76-4fda-a840-146e63da3e58 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:10.394137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6701659c-5e76-4fda-a840-146e63da3e58 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.094036 Apr 11 19:58:10.394889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 976/1874] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:10 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:10.774104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4005d5a0-3306-45e5-a0d9-2015704c3a0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:10.775024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4005d5a0-3306-45e5-a0d9-2015704c3a0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:10.783006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4005d5a0-3306-45e5-a0d9-2015704c3a0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:10.783589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4005d5a0-3306-45e5-a0d9-2015704c3a0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:10.784401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4005d5a0-3306-45e5-a0d9-2015704c3a0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:10.784963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4005d5a0-3306-45e5-a0d9-2015704c3a0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:10.817526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4005d5a0-3306-45e5-a0d9-2015704c3a0d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047366 Apr 11 19:58:10.818113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 977/1875] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:10.940488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-96ff085a-a971-4357-9567-aae05508d7ff tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:10.941880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-96ff085a-a971-4357-9567-aae05508d7ff tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:10.952007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96ff085a-a971-4357-9567-aae05508d7ff tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:10.952736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96ff085a-a971-4357-9567-aae05508d7ff tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:10.954004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96ff085a-a971-4357-9567-aae05508d7ff tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:10.954758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96ff085a-a971-4357-9567-aae05508d7ff tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:10.989769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-96ff085a-a971-4357-9567-aae05508d7ff tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054870 Apr 11 19:58:10.990370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 978/1876] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:11.415021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-42c6a376-121b-4f98-b306-e614939783ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:11.415531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-42c6a376-121b-4f98-b306-e614939783ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:11.422548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42c6a376-121b-4f98-b306-e614939783ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:11.422991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42c6a376-121b-4f98-b306-e614939783ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:11.423792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42c6a376-121b-4f98-b306-e614939783ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:11.424261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42c6a376-121b-4f98-b306-e614939783ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:11.489900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-42c6a376-121b-4f98-b306-e614939783ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:11.498294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-42c6a376-121b-4f98-b306-e614939783ca tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087205 Apr 11 19:58:11.498880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 979/1877] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:11 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:11.832777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8430c3db-4762-4fb2-bdd9-c0058625938d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:11.833722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8430c3db-4762-4fb2-bdd9-c0058625938d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:11.840819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8430c3db-4762-4fb2-bdd9-c0058625938d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:11.841305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8430c3db-4762-4fb2-bdd9-c0058625938d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:11.842062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8430c3db-4762-4fb2-bdd9-c0058625938d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:11.842491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8430c3db-4762-4fb2-bdd9-c0058625938d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:11.872956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8430c3db-4762-4fb2-bdd9-c0058625938d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044469 Apr 11 19:58:11.873523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 980/1878] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:12.001769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a52b796c-40f6-4b2b-a041-1aa7ae9f4c25 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:12.002766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a52b796c-40f6-4b2b-a041-1aa7ae9f4c25 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:12.009724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a52b796c-40f6-4b2b-a041-1aa7ae9f4c25 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:12.010167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a52b796c-40f6-4b2b-a041-1aa7ae9f4c25 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:12.010926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a52b796c-40f6-4b2b-a041-1aa7ae9f4c25 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:12.011350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a52b796c-40f6-4b2b-a041-1aa7ae9f4c25 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:12.040982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a52b796c-40f6-4b2b-a041-1aa7ae9f4c25 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Apr 11 19:58:12.041574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 981/1879] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:12.516232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b131baf6-36e2-444e-9590-477493a9627f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:12.516770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b131baf6-36e2-444e-9590-477493a9627f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:12.523350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b131baf6-36e2-444e-9590-477493a9627f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:12.523795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b131baf6-36e2-444e-9590-477493a9627f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:12.524619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b131baf6-36e2-444e-9590-477493a9627f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:12.525022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b131baf6-36e2-444e-9590-477493a9627f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:12.598922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b131baf6-36e2-444e-9590-477493a9627f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:12.606918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b131baf6-36e2-444e-9590-477493a9627f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.094689 Apr 11 19:58:12.607507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 982/1880] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:12 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:58:12.888334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-641ce06c-6cec-44af-9fbc-6301c8276d2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:12.889635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-641ce06c-6cec-44af-9fbc-6301c8276d2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:12.898521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-641ce06c-6cec-44af-9fbc-6301c8276d2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:12.899055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-641ce06c-6cec-44af-9fbc-6301c8276d2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:12.899939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-641ce06c-6cec-44af-9fbc-6301c8276d2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:12.900412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-641ce06c-6cec-44af-9fbc-6301c8276d2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:12.929308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-641ce06c-6cec-44af-9fbc-6301c8276d2b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046155 Apr 11 19:58:12.929888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 983/1881] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 19:58:13.058234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1247c088-55ba-4ffb-85de-45eeb24b7c5d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:13.059746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1247c088-55ba-4ffb-85de-45eeb24b7c5d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:13.071152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1247c088-55ba-4ffb-85de-45eeb24b7c5d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:13.071490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1247c088-55ba-4ffb-85de-45eeb24b7c5d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:13.072512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1247c088-55ba-4ffb-85de-45eeb24b7c5d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:13.073276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1247c088-55ba-4ffb-85de-45eeb24b7c5d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:13.107660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1247c088-55ba-4ffb-85de-45eeb24b7c5d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056013 Apr 11 19:58:13.108228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 984/1882] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:13.625601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8b0d30ba-8b6b-45ee-b80b-bc700b56e23d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:13.626110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8b0d30ba-8b6b-45ee-b80b-bc700b56e23d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:13.632638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b0d30ba-8b6b-45ee-b80b-bc700b56e23d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:13.633112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b0d30ba-8b6b-45ee-b80b-bc700b56e23d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:13.633863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b0d30ba-8b6b-45ee-b80b-bc700b56e23d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:13.634286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b0d30ba-8b6b-45ee-b80b-bc700b56e23d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:13.701910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8b0d30ba-8b6b-45ee-b80b-bc700b56e23d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:13.709425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8b0d30ba-8b6b-45ee-b80b-bc700b56e23d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.088154 Apr 11 19:58:13.709985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 985/1883] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:13 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:13.945506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-837bcddd-5be1-4988-b8f3-48eabc29fa78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:13.947022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-837bcddd-5be1-4988-b8f3-48eabc29fa78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:13.956604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-837bcddd-5be1-4988-b8f3-48eabc29fa78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:13.957096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-837bcddd-5be1-4988-b8f3-48eabc29fa78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:13.957846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-837bcddd-5be1-4988-b8f3-48eabc29fa78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:13.958271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-837bcddd-5be1-4988-b8f3-48eabc29fa78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:13.988530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-837bcddd-5be1-4988-b8f3-48eabc29fa78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049791 Apr 11 19:58:13.989104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 986/1884] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:14.123672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b1e7461-a067-48fc-ae60-ddff0c1623a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:14.125624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b1e7461-a067-48fc-ae60-ddff0c1623a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:14.135917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b1e7461-a067-48fc-ae60-ddff0c1623a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:14.136652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b1e7461-a067-48fc-ae60-ddff0c1623a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:14.137945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b1e7461-a067-48fc-ae60-ddff0c1623a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:14.138766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b1e7461-a067-48fc-ae60-ddff0c1623a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:14.168322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b1e7461-a067-48fc-ae60-ddff0c1623a1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051160 Apr 11 19:58:14.168845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 987/1885] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:14.730145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b977a6c9-973f-4e80-b15f-faecb4d6bb59 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:14.731148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b977a6c9-973f-4e80-b15f-faecb4d6bb59 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:14.739685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b977a6c9-973f-4e80-b15f-faecb4d6bb59 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:14.740134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b977a6c9-973f-4e80-b15f-faecb4d6bb59 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:14.740893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b977a6c9-973f-4e80-b15f-faecb4d6bb59 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:14.741353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b977a6c9-973f-4e80-b15f-faecb4d6bb59 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:14.814127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b977a6c9-973f-4e80-b15f-faecb4d6bb59 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:14.822447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b977a6c9-973f-4e80-b15f-faecb4d6bb59 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098813 Apr 11 19:58:14.823018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 988/1886] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:14 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:15.003680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e9b29ef-91a2-42dd-bd5d-a931b117cdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:15.004602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e9b29ef-91a2-42dd-bd5d-a931b117cdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:15.011094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e9b29ef-91a2-42dd-bd5d-a931b117cdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:15.011539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e9b29ef-91a2-42dd-bd5d-a931b117cdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:15.012327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e9b29ef-91a2-42dd-bd5d-a931b117cdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:15.012758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e9b29ef-91a2-42dd-bd5d-a931b117cdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:15.042974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e9b29ef-91a2-42dd-bd5d-a931b117cdcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045273 Apr 11 19:58:15.043532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 989/1887] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:15.183914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e46ca8a5-1a91-478a-9694-d6e0a97fb726 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:15.185450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e46ca8a5-1a91-478a-9694-d6e0a97fb726 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:15.193277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e46ca8a5-1a91-478a-9694-d6e0a97fb726 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:15.193735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e46ca8a5-1a91-478a-9694-d6e0a97fb726 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:15.194499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e46ca8a5-1a91-478a-9694-d6e0a97fb726 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:15.194931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e46ca8a5-1a91-478a-9694-d6e0a97fb726 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:15.222792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e46ca8a5-1a91-478a-9694-d6e0a97fb726 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045531 Apr 11 19:58:15.223330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 990/1888] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:15.841762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2e70b1f-0ec8-48f2-8805-952a5e78bf97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:15.842369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2e70b1f-0ec8-48f2-8805-952a5e78bf97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:15.848819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2e70b1f-0ec8-48f2-8805-952a5e78bf97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:15.849294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2e70b1f-0ec8-48f2-8805-952a5e78bf97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:15.850049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2e70b1f-0ec8-48f2-8805-952a5e78bf97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:15.850479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2e70b1f-0ec8-48f2-8805-952a5e78bf97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:15.913328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2e70b1f-0ec8-48f2-8805-952a5e78bf97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:15.921403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2e70b1f-0ec8-48f2-8805-952a5e78bf97 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085033 Apr 11 19:58:15.921958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 991/1889] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:15 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:16.055282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fd8773d6-c415-4f65-9c24-5ed54525593f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:16.056182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fd8773d6-c415-4f65-9c24-5ed54525593f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:16.062792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd8773d6-c415-4f65-9c24-5ed54525593f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:16.063239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd8773d6-c415-4f65-9c24-5ed54525593f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:16.064010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd8773d6-c415-4f65-9c24-5ed54525593f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:16.064444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd8773d6-c415-4f65-9c24-5ed54525593f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:16.096389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fd8773d6-c415-4f65-9c24-5ed54525593f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045069 Apr 11 19:58:16.096863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 992/1890] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:16.234943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8b7e21b4-af38-428c-a5b5-1c288e207e17 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:16.235858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8b7e21b4-af38-428c-a5b5-1c288e207e17 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:16.242656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b7e21b4-af38-428c-a5b5-1c288e207e17 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:16.243089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b7e21b4-af38-428c-a5b5-1c288e207e17 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:16.243849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b7e21b4-af38-428c-a5b5-1c288e207e17 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:16.244274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b7e21b4-af38-428c-a5b5-1c288e207e17 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:16.273591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8b7e21b4-af38-428c-a5b5-1c288e207e17 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Apr 11 19:58:16.274163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 993/1891] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:16.938820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-12eebefb-bd6d-4371-b8c2-313f660e6a43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:16.939428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-12eebefb-bd6d-4371-b8c2-313f660e6a43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:16.945899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12eebefb-bd6d-4371-b8c2-313f660e6a43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:16.946341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12eebefb-bd6d-4371-b8c2-313f660e6a43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:16.947103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12eebefb-bd6d-4371-b8c2-313f660e6a43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:16.947533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12eebefb-bd6d-4371-b8c2-313f660e6a43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:17.008055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-12eebefb-bd6d-4371-b8c2-313f660e6a43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:17.016154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-12eebefb-bd6d-4371-b8c2-313f660e6a43 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081243 Apr 11 19:58:17.016715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 994/1892] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:16 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:17.111717 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a2098c8a-9e56-4c44-94d4-474077832ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:17.112634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a2098c8a-9e56-4c44-94d4-474077832ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:17.119112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2098c8a-9e56-4c44-94d4-474077832ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:17.119553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2098c8a-9e56-4c44-94d4-474077832ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:17.120319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2098c8a-9e56-4c44-94d4-474077832ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:17.120746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2098c8a-9e56-4c44-94d4-474077832ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:17.151019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a2098c8a-9e56-4c44-94d4-474077832ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045950 Apr 11 19:58:17.151612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 995/1893] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:17.287255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e8aa1338-c489-47b1-bd51-609153ff2e11 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:17.288179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e8aa1338-c489-47b1-bd51-609153ff2e11 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:17.297587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8aa1338-c489-47b1-bd51-609153ff2e11 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:17.298209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8aa1338-c489-47b1-bd51-609153ff2e11 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:17.299407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8aa1338-c489-47b1-bd51-609153ff2e11 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:17.299967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8aa1338-c489-47b1-bd51-609153ff2e11 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:17.336146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e8aa1338-c489-47b1-bd51-609153ff2e11 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053738 Apr 11 19:58:17.336718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 996/1894] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 19:58:18.036561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e8e0af0b-28c5-454f-976a-f76b659c565a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:18.037183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e8e0af0b-28c5-454f-976a-f76b659c565a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:18.043674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8e0af0b-28c5-454f-976a-f76b659c565a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:18.044118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8e0af0b-28c5-454f-976a-f76b659c565a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:18.044871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8e0af0b-28c5-454f-976a-f76b659c565a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:18.045331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8e0af0b-28c5-454f-976a-f76b659c565a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:18.106851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e8e0af0b-28c5-454f-976a-f76b659c565a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:18.115400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e8e0af0b-28c5-454f-976a-f76b659c565a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083899 Apr 11 19:58:18.116302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 997/1895] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:18 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:18.165091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab725340-d0c1-4a95-afe7-a800bab05405 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:18.166362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab725340-d0c1-4a95-afe7-a800bab05405 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:18.175103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab725340-d0c1-4a95-afe7-a800bab05405 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:18.175735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab725340-d0c1-4a95-afe7-a800bab05405 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:18.176815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab725340-d0c1-4a95-afe7-a800bab05405 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:18.177475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab725340-d0c1-4a95-afe7-a800bab05405 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:18.210934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab725340-d0c1-4a95-afe7-a800bab05405 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051279 Apr 11 19:58:18.211484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 998/1896] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:18.352039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a94fbd7e-cdb0-478b-aa87-6eb1c03fe62a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:18.353453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a94fbd7e-cdb0-478b-aa87-6eb1c03fe62a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:18.363474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a94fbd7e-cdb0-478b-aa87-6eb1c03fe62a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:18.363922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a94fbd7e-cdb0-478b-aa87-6eb1c03fe62a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:18.364687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a94fbd7e-cdb0-478b-aa87-6eb1c03fe62a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:18.365161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a94fbd7e-cdb0-478b-aa87-6eb1c03fe62a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:18.393056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a94fbd7e-cdb0-478b-aa87-6eb1c03fe62a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047576 Apr 11 19:58:18.393668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 999/1897] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:19.142171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8940458a-1fb4-402c-90ab-0f0d5a257b19 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:19.143219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8940458a-1fb4-402c-90ab-0f0d5a257b19 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:19.150316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8940458a-1fb4-402c-90ab-0f0d5a257b19 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:19.150761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8940458a-1fb4-402c-90ab-0f0d5a257b19 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:19.151508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8940458a-1fb4-402c-90ab-0f0d5a257b19 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:19.151938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8940458a-1fb4-402c-90ab-0f0d5a257b19 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:19.220609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8940458a-1fb4-402c-90ab-0f0d5a257b19 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:19.230258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8940458a-1fb4-402c-90ab-0f0d5a257b19 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.095397 Apr 11 19:58:19.230864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1000/1898] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:19 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:19.235786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f1cee71-55a0-4df6-97a2-3f4b9f76beef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:19.236717 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f1cee71-55a0-4df6-97a2-3f4b9f76beef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:19.243637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f1cee71-55a0-4df6-97a2-3f4b9f76beef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:19.244187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f1cee71-55a0-4df6-97a2-3f4b9f76beef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:19.245040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f1cee71-55a0-4df6-97a2-3f4b9f76beef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:19.245463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f1cee71-55a0-4df6-97a2-3f4b9f76beef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:19.279008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f1cee71-55a0-4df6-97a2-3f4b9f76beef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047065 Apr 11 19:58:19.279581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1001/1899] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:19.407172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0c65f071-c349-4978-aa00-c4a80a296a0e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:19.407964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0c65f071-c349-4978-aa00-c4a80a296a0e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:19.415065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c65f071-c349-4978-aa00-c4a80a296a0e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:19.415508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c65f071-c349-4978-aa00-c4a80a296a0e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:19.416267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c65f071-c349-4978-aa00-c4a80a296a0e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:19.416694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c65f071-c349-4978-aa00-c4a80a296a0e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:19.445544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0c65f071-c349-4978-aa00-c4a80a296a0e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042379 Apr 11 19:58:19.446100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1002/1900] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:20.250650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c149d386-0d41-46a1-ae4e-831dce721e50 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:20.251342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c149d386-0d41-46a1-ae4e-831dce721e50 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:20.258018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c149d386-0d41-46a1-ae4e-831dce721e50 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:20.258747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c149d386-0d41-46a1-ae4e-831dce721e50 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:20.259559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c149d386-0d41-46a1-ae4e-831dce721e50 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:20.259993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c149d386-0d41-46a1-ae4e-831dce721e50 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:20.321419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c149d386-0d41-46a1-ae4e-831dce721e50 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:20.329441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c149d386-0d41-46a1-ae4e-831dce721e50 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083048 Apr 11 19:58:20.330015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1003/1901] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:20 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:20.334660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c22d71f-2216-4e6b-9e51-1bdb6873d2cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:20.335589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c22d71f-2216-4e6b-9e51-1bdb6873d2cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:20.343924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c22d71f-2216-4e6b-9e51-1bdb6873d2cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:20.344647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c22d71f-2216-4e6b-9e51-1bdb6873d2cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:20.345983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c22d71f-2216-4e6b-9e51-1bdb6873d2cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:20.346781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c22d71f-2216-4e6b-9e51-1bdb6873d2cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:20.377190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c22d71f-2216-4e6b-9e51-1bdb6873d2cb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046066 Apr 11 19:58:20.377790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1004/1902] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:20.457900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cfbdc7b4-3461-4351-ae9d-390458cbebd2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:20.458740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cfbdc7b4-3461-4351-ae9d-390458cbebd2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:20.465417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfbdc7b4-3461-4351-ae9d-390458cbebd2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:20.465864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfbdc7b4-3461-4351-ae9d-390458cbebd2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:20.466620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfbdc7b4-3461-4351-ae9d-390458cbebd2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:20.467050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfbdc7b4-3461-4351-ae9d-390458cbebd2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:20.496741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cfbdc7b4-3461-4351-ae9d-390458cbebd2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042868 Apr 11 19:58:20.497345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1005/1903] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:20.537736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-f385fa23-e738-4ae6-9eac-c77fe19342ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'services' on Instance uuid c9ab5394-5558-4afd-b34d-c75fc0dfd907 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 19:58:21.352450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7642dff-6191-48a6-b23c-d9b3562b1af0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:21.353092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7642dff-6191-48a6-b23c-d9b3562b1af0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:21.360157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7642dff-6191-48a6-b23c-d9b3562b1af0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:21.360613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7642dff-6191-48a6-b23c-d9b3562b1af0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:21.361415 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7642dff-6191-48a6-b23c-d9b3562b1af0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:21.361848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7642dff-6191-48a6-b23c-d9b3562b1af0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:21.434292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7642dff-6191-48a6-b23c-d9b3562b1af0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:21.442614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7642dff-6191-48a6-b23c-d9b3562b1af0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098081 Apr 11 19:58:21.443100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1006/1904] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:21 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:21.447673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2d78970-8e57-4cd5-a003-a6558259ccb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:21.448609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2d78970-8e57-4cd5-a003-a6558259ccb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:21.454975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2d78970-8e57-4cd5-a003-a6558259ccb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:21.455461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2d78970-8e57-4cd5-a003-a6558259ccb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:21.456280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2d78970-8e57-4cd5-a003-a6558259ccb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:21.456700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2d78970-8e57-4cd5-a003-a6558259ccb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:21.485986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2d78970-8e57-4cd5-a003-a6558259ccb8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041831 Apr 11 19:58:21.486555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1007/1905] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:21.509005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2ea7bb10-6206-4bed-8630-bd8ff8fe6547 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:21.509947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2ea7bb10-6206-4bed-8630-bd8ff8fe6547 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:21.516336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ea7bb10-6206-4bed-8630-bd8ff8fe6547 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:21.516789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ea7bb10-6206-4bed-8630-bd8ff8fe6547 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:21.517590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ea7bb10-6206-4bed-8630-bd8ff8fe6547 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:21.518028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ea7bb10-6206-4bed-8630-bd8ff8fe6547 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:21.548431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2ea7bb10-6206-4bed-8630-bd8ff8fe6547 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043129 Apr 11 19:58:21.549635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1008/1906] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:22.458981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-28446ade-b22a-45fb-bbaa-5524cf352f9c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:22.459692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-28446ade-b22a-45fb-bbaa-5524cf352f9c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:22.465973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28446ade-b22a-45fb-bbaa-5524cf352f9c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:22.466426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28446ade-b22a-45fb-bbaa-5524cf352f9c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:22.467213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28446ade-b22a-45fb-bbaa-5524cf352f9c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:22.467645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28446ade-b22a-45fb-bbaa-5524cf352f9c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:22.527605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-28446ade-b22a-45fb-bbaa-5524cf352f9c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:22.535326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-28446ade-b22a-45fb-bbaa-5524cf352f9c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080399 Apr 11 19:58:22.535886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1009/1907] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:22 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:22.540366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2fa40b62-9ed1-4a19-aff5-85186ee5cf92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:22.541287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2fa40b62-9ed1-4a19-aff5-85186ee5cf92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:22.547441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fa40b62-9ed1-4a19-aff5-85186ee5cf92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:22.547879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fa40b62-9ed1-4a19-aff5-85186ee5cf92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:22.548633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fa40b62-9ed1-4a19-aff5-85186ee5cf92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:22.549108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fa40b62-9ed1-4a19-aff5-85186ee5cf92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:22.589237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2fa40b62-9ed1-4a19-aff5-85186ee5cf92 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052106 Apr 11 19:58:22.589814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1010/1908] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:22.594804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a49fd6b2-4c2d-408a-be9a-5115c6ae2523 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:22.595745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a49fd6b2-4c2d-408a-be9a-5115c6ae2523 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:22.602142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a49fd6b2-4c2d-408a-be9a-5115c6ae2523 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:22.602593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a49fd6b2-4c2d-408a-be9a-5115c6ae2523 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:22.603360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a49fd6b2-4c2d-408a-be9a-5115c6ae2523 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:22.603793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a49fd6b2-4c2d-408a-be9a-5115c6ae2523 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:22.634282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a49fd6b2-4c2d-408a-be9a-5115c6ae2523 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Apr 11 19:58:22.634849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1011/1909] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:23.552855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3cd70c97-0d91-44ae-a7f0-2c4cb203ed3d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:23.553614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3cd70c97-0d91-44ae-a7f0-2c4cb203ed3d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:23.561212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cd70c97-0d91-44ae-a7f0-2c4cb203ed3d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:23.561653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cd70c97-0d91-44ae-a7f0-2c4cb203ed3d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:23.562416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cd70c97-0d91-44ae-a7f0-2c4cb203ed3d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:23.563290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cd70c97-0d91-44ae-a7f0-2c4cb203ed3d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:23.627788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3cd70c97-0d91-44ae-a7f0-2c4cb203ed3d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:23.636152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3cd70c97-0d91-44ae-a7f0-2c4cb203ed3d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087464 Apr 11 19:58:23.636722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1012/1910] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:23 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:23.641328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b9a5425-a1a8-47a9-bd8e-6df81ffd06c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:23.642356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b9a5425-a1a8-47a9-bd8e-6df81ffd06c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:23.648446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b9a5425-a1a8-47a9-bd8e-6df81ffd06c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:23.648889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b9a5425-a1a8-47a9-bd8e-6df81ffd06c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:23.649677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b9a5425-a1a8-47a9-bd8e-6df81ffd06c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:23.650101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b9a5425-a1a8-47a9-bd8e-6df81ffd06c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:23.678883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b9a5425-a1a8-47a9-bd8e-6df81ffd06c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041074 Apr 11 19:58:23.679435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1013/1911] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:23.684143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb43560c-0ed0-4773-b9dd-7926198e3893 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:23.685074 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb43560c-0ed0-4773-b9dd-7926198e3893 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:23.691383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb43560c-0ed0-4773-b9dd-7926198e3893 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:23.691822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb43560c-0ed0-4773-b9dd-7926198e3893 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:23.692664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb43560c-0ed0-4773-b9dd-7926198e3893 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:23.693132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb43560c-0ed0-4773-b9dd-7926198e3893 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:23.722550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb43560c-0ed0-4773-b9dd-7926198e3893 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042111 Apr 11 19:58:23.723111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1014/1912] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:24.653299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d2ed5ed1-dcb2-4329-bceb-084886a70f08 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:24.653881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d2ed5ed1-dcb2-4329-bceb-084886a70f08 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:24.660466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2ed5ed1-dcb2-4329-bceb-084886a70f08 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:24.660946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2ed5ed1-dcb2-4329-bceb-084886a70f08 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:24.661681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2ed5ed1-dcb2-4329-bceb-084886a70f08 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:24.662107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2ed5ed1-dcb2-4329-bceb-084886a70f08 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:24.722954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d2ed5ed1-dcb2-4329-bceb-084886a70f08 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:24.730937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d2ed5ed1-dcb2-4329-bceb-084886a70f08 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081558 Apr 11 19:58:24.731496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1015/1913] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:24 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:24.736213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9aaeb5c3-1fcb-4771-893c-a93573667165 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:24.737138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9aaeb5c3-1fcb-4771-893c-a93573667165 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:24.743290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aaeb5c3-1fcb-4771-893c-a93573667165 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:24.743730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aaeb5c3-1fcb-4771-893c-a93573667165 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:24.744479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aaeb5c3-1fcb-4771-893c-a93573667165 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:24.744922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aaeb5c3-1fcb-4771-893c-a93573667165 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:24.774414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9aaeb5c3-1fcb-4771-893c-a93573667165 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041897 Apr 11 19:58:24.774971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1016/1914] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:24.779431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-948a0ccd-e7ba-4918-ae92-8f1a7afc991d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:24.780332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-948a0ccd-e7ba-4918-ae92-8f1a7afc991d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:24.786480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-948a0ccd-e7ba-4918-ae92-8f1a7afc991d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:24.786924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-948a0ccd-e7ba-4918-ae92-8f1a7afc991d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:24.787687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-948a0ccd-e7ba-4918-ae92-8f1a7afc991d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:24.788124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-948a0ccd-e7ba-4918-ae92-8f1a7afc991d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:24.816262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-948a0ccd-e7ba-4918-ae92-8f1a7afc991d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040274 Apr 11 19:58:24.816787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1017/1915] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:25.748129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d2e335c-ff50-47d1-a8e3-27cd7832168f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:25.748797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6d2e335c-ff50-47d1-a8e3-27cd7832168f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:25.755842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d2e335c-ff50-47d1-a8e3-27cd7832168f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:25.756295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d2e335c-ff50-47d1-a8e3-27cd7832168f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:25.757106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d2e335c-ff50-47d1-a8e3-27cd7832168f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:25.757542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d2e335c-ff50-47d1-a8e3-27cd7832168f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:25.817759 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6d2e335c-ff50-47d1-a8e3-27cd7832168f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:25.825612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6d2e335c-ff50-47d1-a8e3-27cd7832168f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081510 Apr 11 19:58:25.826274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1018/1916] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:25 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:25.830979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e089db96-7e0c-42a1-846b-44d5b2bc8b6b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:25.831881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e089db96-7e0c-42a1-846b-44d5b2bc8b6b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:25.837976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e089db96-7e0c-42a1-846b-44d5b2bc8b6b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:25.838417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e089db96-7e0c-42a1-846b-44d5b2bc8b6b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:25.839167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e089db96-7e0c-42a1-846b-44d5b2bc8b6b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:25.839592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e089db96-7e0c-42a1-846b-44d5b2bc8b6b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:25.867790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e089db96-7e0c-42a1-846b-44d5b2bc8b6b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040503 Apr 11 19:58:25.868320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1019/1917] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:25.872697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a1c7e54-8fe1-4ab9-bd72-55b7ba2de201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:25.873608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a1c7e54-8fe1-4ab9-bd72-55b7ba2de201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:25.879815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a1c7e54-8fe1-4ab9-bd72-55b7ba2de201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:25.880251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a1c7e54-8fe1-4ab9-bd72-55b7ba2de201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:25.881025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a1c7e54-8fe1-4ab9-bd72-55b7ba2de201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:25.881454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a1c7e54-8fe1-4ab9-bd72-55b7ba2de201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:25.912933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a1c7e54-8fe1-4ab9-bd72-55b7ba2de201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Apr 11 19:58:25.913526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1020/1918] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:26.842976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ed93a161-8bb6-4604-a8f0-fffcf7c55854 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:26.843661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ed93a161-8bb6-4604-a8f0-fffcf7c55854 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:26.850209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed93a161-8bb6-4604-a8f0-fffcf7c55854 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:26.850630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed93a161-8bb6-4604-a8f0-fffcf7c55854 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:26.851404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed93a161-8bb6-4604-a8f0-fffcf7c55854 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:26.851827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed93a161-8bb6-4604-a8f0-fffcf7c55854 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:26.912676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ed93a161-8bb6-4604-a8f0-fffcf7c55854 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:26.921567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ed93a161-8bb6-4604-a8f0-fffcf7c55854 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.082477 Apr 11 19:58:26.922135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1021/1919] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:26 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:26.926737 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fd931105-3141-4222-ac77-4ac8c8878d3e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:26.927646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fd931105-3141-4222-ac77-4ac8c8878d3e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:26.933771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd931105-3141-4222-ac77-4ac8c8878d3e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:26.934214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd931105-3141-4222-ac77-4ac8c8878d3e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:26.934981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd931105-3141-4222-ac77-4ac8c8878d3e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:26.935409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd931105-3141-4222-ac77-4ac8c8878d3e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:26.963933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fd931105-3141-4222-ac77-4ac8c8878d3e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040753 Apr 11 19:58:26.964486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1022/1920] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:26.969061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c010354-e4b0-4837-86f0-87ee88f3050a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:26.969956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c010354-e4b0-4837-86f0-87ee88f3050a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:26.975976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c010354-e4b0-4837-86f0-87ee88f3050a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:26.976414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c010354-e4b0-4837-86f0-87ee88f3050a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:26.977192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c010354-e4b0-4837-86f0-87ee88f3050a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:26.977614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c010354-e4b0-4837-86f0-87ee88f3050a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:27.005709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c010354-e4b0-4837-86f0-87ee88f3050a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040148 Apr 11 19:58:27.006275 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1023/1921] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:27.939643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-431a7a8a-7a77-4a63-8b64-3d8fcf7b008f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:27.940427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-431a7a8a-7a77-4a63-8b64-3d8fcf7b008f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:27.947741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-431a7a8a-7a77-4a63-8b64-3d8fcf7b008f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:27.948190 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-431a7a8a-7a77-4a63-8b64-3d8fcf7b008f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:27.949005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-431a7a8a-7a77-4a63-8b64-3d8fcf7b008f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:27.949431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-431a7a8a-7a77-4a63-8b64-3d8fcf7b008f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:28.013546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-431a7a8a-7a77-4a63-8b64-3d8fcf7b008f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:28.021548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-431a7a8a-7a77-4a63-8b64-3d8fcf7b008f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085894 Apr 11 19:58:28.022140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1024/1922] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:27 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:28.026735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6c292c4b-303d-440e-813d-3aab5c4a053a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:28.027641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6c292c4b-303d-440e-813d-3aab5c4a053a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:28.033658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c292c4b-303d-440e-813d-3aab5c4a053a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:28.034104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c292c4b-303d-440e-813d-3aab5c4a053a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:28.034854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c292c4b-303d-440e-813d-3aab5c4a053a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:28.035286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c292c4b-303d-440e-813d-3aab5c4a053a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:28.063976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6c292c4b-303d-440e-813d-3aab5c4a053a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040836 Apr 11 19:58:28.064560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1025/1923] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:28.068973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e0996be3-68dc-41c5-b0fe-0feadfb7011e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:28.069927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e0996be3-68dc-41c5-b0fe-0feadfb7011e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:28.075818 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0996be3-68dc-41c5-b0fe-0feadfb7011e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:28.076254 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0996be3-68dc-41c5-b0fe-0feadfb7011e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:28.077036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0996be3-68dc-41c5-b0fe-0feadfb7011e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:28.077464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0996be3-68dc-41c5-b0fe-0feadfb7011e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:28.104435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e0996be3-68dc-41c5-b0fe-0feadfb7011e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038889 Apr 11 19:58:28.105015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1026/1924] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:29.037971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-867fa030-f480-4d66-ac83-7a606eb99ca1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:29.038769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-867fa030-f480-4d66-ac83-7a606eb99ca1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:29.045836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-867fa030-f480-4d66-ac83-7a606eb99ca1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:29.046475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-867fa030-f480-4d66-ac83-7a606eb99ca1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:29.047243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-867fa030-f480-4d66-ac83-7a606eb99ca1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:29.047667 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-867fa030-f480-4d66-ac83-7a606eb99ca1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:29.110773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-867fa030-f480-4d66-ac83-7a606eb99ca1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:29.118769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-867fa030-f480-4d66-ac83-7a606eb99ca1 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084715 Apr 11 19:58:29.119352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1027/1925] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:29 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:29.124098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e4f72748-a8c7-4f36-adba-ffcfa4f2854a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:29.125374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e4f72748-a8c7-4f36-adba-ffcfa4f2854a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:29.131799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4f72748-a8c7-4f36-adba-ffcfa4f2854a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:29.132286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4f72748-a8c7-4f36-adba-ffcfa4f2854a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:29.133109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4f72748-a8c7-4f36-adba-ffcfa4f2854a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:29.133536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4f72748-a8c7-4f36-adba-ffcfa4f2854a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:29.163473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e4f72748-a8c7-4f36-adba-ffcfa4f2854a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042976 Apr 11 19:58:29.163934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1028/1926] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:29.168425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1df2c5ed-1da0-48e8-9024-16a0930ab676 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:29.169351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1df2c5ed-1da0-48e8-9024-16a0930ab676 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:29.175341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1df2c5ed-1da0-48e8-9024-16a0930ab676 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:29.175786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1df2c5ed-1da0-48e8-9024-16a0930ab676 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:29.176539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1df2c5ed-1da0-48e8-9024-16a0930ab676 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:29.177004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1df2c5ed-1da0-48e8-9024-16a0930ab676 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:29.205134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1df2c5ed-1da0-48e8-9024-16a0930ab676 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040142 Apr 11 19:58:29.205733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1029/1927] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:30.136943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fdd8d259-1504-427a-919c-cd9ca8bf19f2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:30.137664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fdd8d259-1504-427a-919c-cd9ca8bf19f2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:30.144338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdd8d259-1504-427a-919c-cd9ca8bf19f2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:30.144874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdd8d259-1504-427a-919c-cd9ca8bf19f2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:30.145681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdd8d259-1504-427a-919c-cd9ca8bf19f2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:30.146112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdd8d259-1504-427a-919c-cd9ca8bf19f2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:30.208516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fdd8d259-1504-427a-919c-cd9ca8bf19f2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:30.216208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fdd8d259-1504-427a-919c-cd9ca8bf19f2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083152 Apr 11 19:58:30.216763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1030/1928] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:30 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:30.221332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1462851-c6b3-4bea-bf79-20bf34a454ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:30.222306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1462851-c6b3-4bea-bf79-20bf34a454ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:30.228048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1462851-c6b3-4bea-bf79-20bf34a454ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:30.228492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1462851-c6b3-4bea-bf79-20bf34a454ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:30.229272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1462851-c6b3-4bea-bf79-20bf34a454ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:30.229704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1462851-c6b3-4bea-bf79-20bf34a454ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:30.258121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1462851-c6b3-4bea-bf79-20bf34a454ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040342 Apr 11 19:58:30.258669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1031/1929] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:30.263067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-21ff4b27-aeee-48d1-9458-3b83cb0ae1c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:30.263957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-21ff4b27-aeee-48d1-9458-3b83cb0ae1c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:30.269750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21ff4b27-aeee-48d1-9458-3b83cb0ae1c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:30.270162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21ff4b27-aeee-48d1-9458-3b83cb0ae1c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:30.270925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21ff4b27-aeee-48d1-9458-3b83cb0ae1c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:30.271347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21ff4b27-aeee-48d1-9458-3b83cb0ae1c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:30.307334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-21ff4b27-aeee-48d1-9458-3b83cb0ae1c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Apr 11 19:58:30.307895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1032/1930] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:31.237296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cc70bbe-8206-44e7-a123-d5ebe446e4da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:31.238028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cc70bbe-8206-44e7-a123-d5ebe446e4da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:31.245378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cc70bbe-8206-44e7-a123-d5ebe446e4da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:31.245907 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cc70bbe-8206-44e7-a123-d5ebe446e4da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:31.246802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cc70bbe-8206-44e7-a123-d5ebe446e4da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:31.247505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cc70bbe-8206-44e7-a123-d5ebe446e4da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:31.313832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cc70bbe-8206-44e7-a123-d5ebe446e4da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:31.323093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cc70bbe-8206-44e7-a123-d5ebe446e4da tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092318 Apr 11 19:58:31.323657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1033/1931] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:31 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:31.328389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b12489f6-db6f-4e02-a562-5819ba2d6f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:31.329312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b12489f6-db6f-4e02-a562-5819ba2d6f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:31.335362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b12489f6-db6f-4e02-a562-5819ba2d6f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:31.335802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b12489f6-db6f-4e02-a562-5819ba2d6f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:31.336585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b12489f6-db6f-4e02-a562-5819ba2d6f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:31.337046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b12489f6-db6f-4e02-a562-5819ba2d6f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:31.367158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b12489f6-db6f-4e02-a562-5819ba2d6f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042423 Apr 11 19:58:31.367707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1034/1932] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:31.372162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b380122-8215-45a4-b421-89a29e9930bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:31.373060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b380122-8215-45a4-b421-89a29e9930bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:31.379185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b380122-8215-45a4-b421-89a29e9930bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:31.379619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b380122-8215-45a4-b421-89a29e9930bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:31.380361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b380122-8215-45a4-b421-89a29e9930bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:31.380784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b380122-8215-45a4-b421-89a29e9930bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:31.411149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b380122-8215-45a4-b421-89a29e9930bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Apr 11 19:58:31.411736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1035/1933] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:32.344182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0dce322d-8e59-434b-93df-f6cf4859829c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:32.345292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0dce322d-8e59-434b-93df-f6cf4859829c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:32.352510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0dce322d-8e59-434b-93df-f6cf4859829c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:32.352960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0dce322d-8e59-434b-93df-f6cf4859829c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:32.353751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0dce322d-8e59-434b-93df-f6cf4859829c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:32.354168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0dce322d-8e59-434b-93df-f6cf4859829c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:32.420245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0dce322d-8e59-434b-93df-f6cf4859829c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:32.428269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0dce322d-8e59-434b-93df-f6cf4859829c tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.090388 Apr 11 19:58:32.428819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1036/1934] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:32 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:32.433510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f85639ef-f7d0-42c9-9c14-ef8910e2b75a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:32.434453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f85639ef-f7d0-42c9-9c14-ef8910e2b75a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:32.441273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f85639ef-f7d0-42c9-9c14-ef8910e2b75a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:32.441771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f85639ef-f7d0-42c9-9c14-ef8910e2b75a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:32.442452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f85639ef-f7d0-42c9-9c14-ef8910e2b75a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:32.442877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f85639ef-f7d0-42c9-9c14-ef8910e2b75a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:32.473162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f85639ef-f7d0-42c9-9c14-ef8910e2b75a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043209 Apr 11 19:58:32.473726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1037/1935] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:32.478171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f5afb429-7f09-4c5b-854a-de79bd878cb7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:32.479080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f5afb429-7f09-4c5b-854a-de79bd878cb7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:32.485053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5afb429-7f09-4c5b-854a-de79bd878cb7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:32.485495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5afb429-7f09-4c5b-854a-de79bd878cb7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:32.486248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5afb429-7f09-4c5b-854a-de79bd878cb7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:32.486675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5afb429-7f09-4c5b-854a-de79bd878cb7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:32.515744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f5afb429-7f09-4c5b-854a-de79bd878cb7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040987 Apr 11 19:58:32.516302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1038/1936] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:33.445716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a0b7d55-1126-4506-a2fc-884c7de3dd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:33.448657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a0b7d55-1126-4506-a2fc-884c7de3dd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:33.453048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a0b7d55-1126-4506-a2fc-884c7de3dd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:33.453502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a0b7d55-1126-4506-a2fc-884c7de3dd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:33.454281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a0b7d55-1126-4506-a2fc-884c7de3dd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:33.454712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a0b7d55-1126-4506-a2fc-884c7de3dd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:33.524847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0a0b7d55-1126-4506-a2fc-884c7de3dd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:33.532985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a0b7d55-1126-4506-a2fc-884c7de3dd30 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.091209 Apr 11 19:58:33.533572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1039/1937] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:33 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:33.538159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-039a45f5-af8c-474d-8d4b-a2f6f1c8674d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:33.539064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-039a45f5-af8c-474d-8d4b-a2f6f1c8674d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:33.547567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-039a45f5-af8c-474d-8d4b-a2f6f1c8674d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:33.548309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-039a45f5-af8c-474d-8d4b-a2f6f1c8674d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:33.549738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-039a45f5-af8c-474d-8d4b-a2f6f1c8674d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:33.550462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-039a45f5-af8c-474d-8d4b-a2f6f1c8674d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:33.587819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-039a45f5-af8c-474d-8d4b-a2f6f1c8674d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053102 Apr 11 19:58:33.588264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1040/1938] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:33.592996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-93364846-bf76-47a1-8e23-17ca37fa7caa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:33.593883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-93364846-bf76-47a1-8e23-17ca37fa7caa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:33.600163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93364846-bf76-47a1-8e23-17ca37fa7caa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:33.600594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93364846-bf76-47a1-8e23-17ca37fa7caa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:33.601386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93364846-bf76-47a1-8e23-17ca37fa7caa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:33.601807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93364846-bf76-47a1-8e23-17ca37fa7caa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:33.635257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-93364846-bf76-47a1-8e23-17ca37fa7caa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Apr 11 19:58:33.635795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1041/1939] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:34.550474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a2de73fd-dfcb-4ca7-a12e-232e5f64f0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:34.551146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a2de73fd-dfcb-4ca7-a12e-232e5f64f0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:34.557863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2de73fd-dfcb-4ca7-a12e-232e5f64f0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:34.558312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2de73fd-dfcb-4ca7-a12e-232e5f64f0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:34.559069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2de73fd-dfcb-4ca7-a12e-232e5f64f0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:34.559501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a2de73fd-dfcb-4ca7-a12e-232e5f64f0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:34.622017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a2de73fd-dfcb-4ca7-a12e-232e5f64f0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:34.631084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a2de73fd-dfcb-4ca7-a12e-232e5f64f0d0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.084531 Apr 11 19:58:34.631693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1042/1940] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:34 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:34.636363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbb9b50c-ac0a-472c-8255-c87460a844a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:34.637310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbb9b50c-ac0a-472c-8255-c87460a844a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:34.644446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbb9b50c-ac0a-472c-8255-c87460a844a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:34.644893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbb9b50c-ac0a-472c-8255-c87460a844a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:34.645694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbb9b50c-ac0a-472c-8255-c87460a844a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:34.646126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbb9b50c-ac0a-472c-8255-c87460a844a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:34.676142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbb9b50c-ac0a-472c-8255-c87460a844a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043326 Apr 11 19:58:34.676718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1043/1941] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:34.681352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-057199b9-0326-4230-bb0e-00e26e63732f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:34.682266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-057199b9-0326-4230-bb0e-00e26e63732f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:34.688520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-057199b9-0326-4230-bb0e-00e26e63732f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:34.689000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-057199b9-0326-4230-bb0e-00e26e63732f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:34.689771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-057199b9-0326-4230-bb0e-00e26e63732f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:34.690282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-057199b9-0326-4230-bb0e-00e26e63732f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:34.720138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-057199b9-0326-4230-bb0e-00e26e63732f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Apr 11 19:58:34.720713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1044/1942] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:35.648639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b6bed00-243e-448a-b7d4-9f6dd5ca39c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:35.649309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b6bed00-243e-448a-b7d4-9f6dd5ca39c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:35.656187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b6bed00-243e-448a-b7d4-9f6dd5ca39c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:35.656632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b6bed00-243e-448a-b7d4-9f6dd5ca39c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:35.657455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b6bed00-243e-448a-b7d4-9f6dd5ca39c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:35.657892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b6bed00-243e-448a-b7d4-9f6dd5ca39c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:35.719727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b6bed00-243e-448a-b7d4-9f6dd5ca39c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:35.728038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b6bed00-243e-448a-b7d4-9f6dd5ca39c8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083315 Apr 11 19:58:35.728623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1045/1943] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:35 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:35.733437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4de26d71-c431-4f8e-b9af-7ea4f2a65c78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:35.734354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4de26d71-c431-4f8e-b9af-7ea4f2a65c78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:35.740666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4de26d71-c431-4f8e-b9af-7ea4f2a65c78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:35.741141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4de26d71-c431-4f8e-b9af-7ea4f2a65c78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:35.741906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4de26d71-c431-4f8e-b9af-7ea4f2a65c78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:35.742332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4de26d71-c431-4f8e-b9af-7ea4f2a65c78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:35.773368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4de26d71-c431-4f8e-b9af-7ea4f2a65c78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043568 Apr 11 19:58:35.773949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1046/1944] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:35.778663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5bbc8a04-8055-4bec-ba38-a01b84cb48e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:35.779614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5bbc8a04-8055-4bec-ba38-a01b84cb48e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:35.785347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bbc8a04-8055-4bec-ba38-a01b84cb48e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:35.785795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bbc8a04-8055-4bec-ba38-a01b84cb48e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:35.786567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bbc8a04-8055-4bec-ba38-a01b84cb48e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:35.786997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bbc8a04-8055-4bec-ba38-a01b84cb48e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:35.818662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5bbc8a04-8055-4bec-ba38-a01b84cb48e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Apr 11 19:58:35.819229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1047/1945] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:36.746933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-527407ca-fc2b-4f5f-9d5c-c0b6f58a0f04 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:36.747880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-527407ca-fc2b-4f5f-9d5c-c0b6f58a0f04 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:36.755157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-527407ca-fc2b-4f5f-9d5c-c0b6f58a0f04 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:36.755621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-527407ca-fc2b-4f5f-9d5c-c0b6f58a0f04 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:36.756376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-527407ca-fc2b-4f5f-9d5c-c0b6f58a0f04 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:36.756796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-527407ca-fc2b-4f5f-9d5c-c0b6f58a0f04 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:36.833975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-527407ca-fc2b-4f5f-9d5c-c0b6f58a0f04 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:36.841819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-527407ca-fc2b-4f5f-9d5c-c0b6f58a0f04 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.099063 Apr 11 19:58:36.842400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1048/1946] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:36 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:58:36.847212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2186fc38-edaa-4923-b9de-6003dfeb028f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:36.848145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2186fc38-edaa-4923-b9de-6003dfeb028f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:36.857139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2186fc38-edaa-4923-b9de-6003dfeb028f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:36.857894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2186fc38-edaa-4923-b9de-6003dfeb028f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:36.859230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2186fc38-edaa-4923-b9de-6003dfeb028f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:36.859951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2186fc38-edaa-4923-b9de-6003dfeb028f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:36.899555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2186fc38-edaa-4923-b9de-6003dfeb028f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055711 Apr 11 19:58:36.900391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1049/1947] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:36.908219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-acb9fa75-58ae-456b-8a6e-5d0f1d6dd148 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:36.909927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-acb9fa75-58ae-456b-8a6e-5d0f1d6dd148 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:36.919288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acb9fa75-58ae-456b-8a6e-5d0f1d6dd148 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:36.919969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acb9fa75-58ae-456b-8a6e-5d0f1d6dd148 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:36.921215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acb9fa75-58ae-456b-8a6e-5d0f1d6dd148 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:36.921904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acb9fa75-58ae-456b-8a6e-5d0f1d6dd148 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:36.953200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-acb9fa75-58ae-456b-8a6e-5d0f1d6dd148 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051415 Apr 11 19:58:36.953772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1050/1948] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:37.860195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bea55eb1-66d4-43f6-8037-1650790b2071 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:37.861287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bea55eb1-66d4-43f6-8037-1650790b2071 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:37.868435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea55eb1-66d4-43f6-8037-1650790b2071 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:37.868878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea55eb1-66d4-43f6-8037-1650790b2071 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:37.869675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea55eb1-66d4-43f6-8037-1650790b2071 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:37.870097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea55eb1-66d4-43f6-8037-1650790b2071 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:37.938742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bea55eb1-66d4-43f6-8037-1650790b2071 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:37.947635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bea55eb1-66d4-43f6-8037-1650790b2071 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.092645 Apr 11 19:58:37.948179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1051/1949] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:37 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:58:37.952881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-98a14409-7681-4b70-a376-1c6a117f6ce5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:37.953839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-98a14409-7681-4b70-a376-1c6a117f6ce5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:37.960357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98a14409-7681-4b70-a376-1c6a117f6ce5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:37.960801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98a14409-7681-4b70-a376-1c6a117f6ce5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:37.961709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98a14409-7681-4b70-a376-1c6a117f6ce5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:37.962134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98a14409-7681-4b70-a376-1c6a117f6ce5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:38.001339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-98a14409-7681-4b70-a376-1c6a117f6ce5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052029 Apr 11 19:58:38.001885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1052/1950] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:38.006594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8077191f-8642-42d1-a385-15501a96449c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:38.007501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8077191f-8642-42d1-a385-15501a96449c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:38.013673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8077191f-8642-42d1-a385-15501a96449c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:38.014122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8077191f-8642-42d1-a385-15501a96449c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:38.014881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8077191f-8642-42d1-a385-15501a96449c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:38.015311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8077191f-8642-42d1-a385-15501a96449c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:38.044368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8077191f-8642-42d1-a385-15501a96449c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 Apr 11 19:58:38.044940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1053/1951] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:38.965274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84012e5b-e13c-4e66-9ea3-3c84328897d8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:38.965999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84012e5b-e13c-4e66-9ea3-3c84328897d8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:38.973833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84012e5b-e13c-4e66-9ea3-3c84328897d8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:38.974276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84012e5b-e13c-4e66-9ea3-3c84328897d8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:38.975027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84012e5b-e13c-4e66-9ea3-3c84328897d8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:38.975446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84012e5b-e13c-4e66-9ea3-3c84328897d8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:39.038649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84012e5b-e13c-4e66-9ea3-3c84328897d8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:39.047666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84012e5b-e13c-4e66-9ea3-3c84328897d8 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086193 Apr 11 19:58:39.050993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1054/1952] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:38 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:39.053032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f68d6b99-367e-4418-83e2-99bf1ddde330 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:39.054017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f68d6b99-367e-4418-83e2-99bf1ddde330 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:39.060161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f68d6b99-367e-4418-83e2-99bf1ddde330 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:39.060603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f68d6b99-367e-4418-83e2-99bf1ddde330 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:39.061411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f68d6b99-367e-4418-83e2-99bf1ddde330 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:39.061837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f68d6b99-367e-4418-83e2-99bf1ddde330 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:39.095959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f68d6b99-367e-4418-83e2-99bf1ddde330 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046639 Apr 11 19:58:39.096596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1055/1953] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:39.101272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-726e0094-a362-4ddd-9add-fff1aba7e2f1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:39.102373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-726e0094-a362-4ddd-9add-fff1aba7e2f1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:39.108858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-726e0094-a362-4ddd-9add-fff1aba7e2f1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:39.109337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-726e0094-a362-4ddd-9add-fff1aba7e2f1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:39.110105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-726e0094-a362-4ddd-9add-fff1aba7e2f1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:39.110530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-726e0094-a362-4ddd-9add-fff1aba7e2f1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:39.140731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-726e0094-a362-4ddd-9add-fff1aba7e2f1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043067 Apr 11 19:58:39.141335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1056/1954] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:40.064537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab695e9a-d6ae-4e8f-93c9-8f24786405d2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:40.065251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab695e9a-d6ae-4e8f-93c9-8f24786405d2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:40.072199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab695e9a-d6ae-4e8f-93c9-8f24786405d2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:40.072645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab695e9a-d6ae-4e8f-93c9-8f24786405d2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:40.073439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab695e9a-d6ae-4e8f-93c9-8f24786405d2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:40.073869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab695e9a-d6ae-4e8f-93c9-8f24786405d2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:40.138495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab695e9a-d6ae-4e8f-93c9-8f24786405d2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:40.147840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab695e9a-d6ae-4e8f-93c9-8f24786405d2 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087081 Apr 11 19:58:40.148427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1057/1955] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:40 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:40.155607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fd67879d-de06-4130-ac7d-cdfd883818d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:40.156549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fd67879d-de06-4130-ac7d-cdfd883818d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:40.163198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd67879d-de06-4130-ac7d-cdfd883818d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:40.163657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd67879d-de06-4130-ac7d-cdfd883818d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:40.164434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd67879d-de06-4130-ac7d-cdfd883818d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:40.164864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd67879d-de06-4130-ac7d-cdfd883818d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:40.202912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fd67879d-de06-4130-ac7d-cdfd883818d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053350 Apr 11 19:58:40.203505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1058/1956] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:40.208838 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ce608b96-9ab3-40ca-a5d6-a83751eb6ce1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:40.209776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ce608b96-9ab3-40ca-a5d6-a83751eb6ce1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:40.215618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce608b96-9ab3-40ca-a5d6-a83751eb6ce1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:40.216331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce608b96-9ab3-40ca-a5d6-a83751eb6ce1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:40.217119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce608b96-9ab3-40ca-a5d6-a83751eb6ce1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:40.217543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce608b96-9ab3-40ca-a5d6-a83751eb6ce1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:40.252360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ce608b96-9ab3-40ca-a5d6-a83751eb6ce1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047726 Apr 11 19:58:40.252982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1059/1957] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:41.166169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fb435bd6-aaaa-42f7-bd52-30e9aa29b35f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:41.167047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fb435bd6-aaaa-42f7-bd52-30e9aa29b35f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:41.175918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb435bd6-aaaa-42f7-bd52-30e9aa29b35f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:41.176722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb435bd6-aaaa-42f7-bd52-30e9aa29b35f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:41.177084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb435bd6-aaaa-42f7-bd52-30e9aa29b35f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:41.177507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb435bd6-aaaa-42f7-bd52-30e9aa29b35f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:41.243301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fb435bd6-aaaa-42f7-bd52-30e9aa29b35f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:41.251528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fb435bd6-aaaa-42f7-bd52-30e9aa29b35f tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.089703 Apr 11 19:58:41.252153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1060/1958] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:41 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:41.257486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1253e654-8071-4b2a-a342-646e9bfe37da tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:41.258378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1253e654-8071-4b2a-a342-646e9bfe37da tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:41.265273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1253e654-8071-4b2a-a342-646e9bfe37da tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:41.265741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1253e654-8071-4b2a-a342-646e9bfe37da tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:41.266619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1253e654-8071-4b2a-a342-646e9bfe37da tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:41.267008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1253e654-8071-4b2a-a342-646e9bfe37da tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:41.297247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1253e654-8071-4b2a-a342-646e9bfe37da tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043806 Apr 11 19:58:41.297792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1061/1959] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:41.302573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1f7a46c3-4503-4c35-add0-86a184738d92 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:41.304217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1f7a46c3-4503-4c35-add0-86a184738d92 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:41.310166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7a46c3-4503-4c35-add0-86a184738d92 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:41.310614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7a46c3-4503-4c35-add0-86a184738d92 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:41.311373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7a46c3-4503-4c35-add0-86a184738d92 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:41.311827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7a46c3-4503-4c35-add0-86a184738d92 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:41.339920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1f7a46c3-4503-4c35-add0-86a184738d92 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 Apr 11 19:58:41.340476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1062/1960] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:42.268647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-64a9a6f9-e715-4537-a194-549c5a31837a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:42.269321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-64a9a6f9-e715-4537-a194-549c5a31837a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:42.275997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64a9a6f9-e715-4537-a194-549c5a31837a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:42.276498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64a9a6f9-e715-4537-a194-549c5a31837a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:42.277316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64a9a6f9-e715-4537-a194-549c5a31837a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:42.277748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64a9a6f9-e715-4537-a194-549c5a31837a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:42.342926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-64a9a6f9-e715-4537-a194-549c5a31837a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:42.351779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-64a9a6f9-e715-4537-a194-549c5a31837a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086982 Apr 11 19:58:42.352339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1063/1961] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:42 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:42.357123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f2262e3-f84c-4c25-b434-3244b6a238d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:42.358014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f2262e3-f84c-4c25-b434-3244b6a238d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:42.363993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f2262e3-f84c-4c25-b434-3244b6a238d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:42.364503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f2262e3-f84c-4c25-b434-3244b6a238d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:42.365288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f2262e3-f84c-4c25-b434-3244b6a238d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:42.365713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f2262e3-f84c-4c25-b434-3244b6a238d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:42.394508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f2262e3-f84c-4c25-b434-3244b6a238d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040978 Apr 11 19:58:42.395064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1064/1962] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:42.402175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c430759a-eeb0-400c-8cb5-f431504e530e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:42.403079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c430759a-eeb0-400c-8cb5-f431504e530e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:42.409000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c430759a-eeb0-400c-8cb5-f431504e530e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:42.409438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c430759a-eeb0-400c-8cb5-f431504e530e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:42.410249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c430759a-eeb0-400c-8cb5-f431504e530e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:42.410727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c430759a-eeb0-400c-8cb5-f431504e530e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:42.439297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c430759a-eeb0-400c-8cb5-f431504e530e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043143 Apr 11 19:58:42.440224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1065/1963] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:43.368945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1cefbc57-8d13-437f-b8a6-71fac835fec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:43.369653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1cefbc57-8d13-437f-b8a6-71fac835fec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:43.376457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cefbc57-8d13-437f-b8a6-71fac835fec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:43.376926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cefbc57-8d13-437f-b8a6-71fac835fec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:43.377653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cefbc57-8d13-437f-b8a6-71fac835fec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:43.378172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cefbc57-8d13-437f-b8a6-71fac835fec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:43.438120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1cefbc57-8d13-437f-b8a6-71fac835fec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:43.445806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1cefbc57-8d13-437f-b8a6-71fac835fec6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.080812 Apr 11 19:58:43.446322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1066/1964] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:43 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:43.450766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-43fcf80a-dfc6-4e40-97c9-cf3940ec5621 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:43.451666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-43fcf80a-dfc6-4e40-97c9-cf3940ec5621 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:43.457217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43fcf80a-dfc6-4e40-97c9-cf3940ec5621 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:43.457650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43fcf80a-dfc6-4e40-97c9-cf3940ec5621 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:43.458391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43fcf80a-dfc6-4e40-97c9-cf3940ec5621 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:43.458810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43fcf80a-dfc6-4e40-97c9-cf3940ec5621 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:43.487314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-43fcf80a-dfc6-4e40-97c9-cf3940ec5621 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040065 Apr 11 19:58:43.487913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1067/1965] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:43.492222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-82ca2335-d40a-4909-9cb5-27385669831b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:43.493116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-82ca2335-d40a-4909-9cb5-27385669831b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:43.498510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ca2335-d40a-4909-9cb5-27385669831b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:43.498947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ca2335-d40a-4909-9cb5-27385669831b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:43.500022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ca2335-d40a-4909-9cb5-27385669831b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:43.500463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ca2335-d40a-4909-9cb5-27385669831b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:43.527439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-82ca2335-d40a-4909-9cb5-27385669831b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038576 Apr 11 19:58:43.527984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1068/1966] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:44.462437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a165c8e-3226-4e71-8637-06fa02010cb3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:44.463108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a165c8e-3226-4e71-8637-06fa02010cb3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:44.469681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a165c8e-3226-4e71-8637-06fa02010cb3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:44.470141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a165c8e-3226-4e71-8637-06fa02010cb3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:44.470891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a165c8e-3226-4e71-8637-06fa02010cb3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:44.471325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a165c8e-3226-4e71-8637-06fa02010cb3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:44.532085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a165c8e-3226-4e71-8637-06fa02010cb3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:44.539875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a165c8e-3226-4e71-8637-06fa02010cb3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.081495 Apr 11 19:58:44.540439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1069/1967] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:44 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:44.545172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83669079-cff4-4763-8540-330759ed71a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:44.546076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83669079-cff4-4763-8540-330759ed71a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:44.552038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83669079-cff4-4763-8540-330759ed71a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:44.552471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83669079-cff4-4763-8540-330759ed71a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:44.553243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83669079-cff4-4763-8540-330759ed71a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:44.553666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83669079-cff4-4763-8540-330759ed71a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:44.581540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83669079-cff4-4763-8540-330759ed71a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040054 Apr 11 19:58:44.582058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1070/1968] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:44.586449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2554b6c-9247-4b61-85b2-65e39be8e49c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:44.587330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2554b6c-9247-4b61-85b2-65e39be8e49c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:44.592936 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2554b6c-9247-4b61-85b2-65e39be8e49c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:44.593412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2554b6c-9247-4b61-85b2-65e39be8e49c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:44.594154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2554b6c-9247-4b61-85b2-65e39be8e49c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:44.594582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2554b6c-9247-4b61-85b2-65e39be8e49c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:44.622102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2554b6c-9247-4b61-85b2-65e39be8e49c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039048 Apr 11 19:58:44.622661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1071/1969] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:45.558282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd01f8ec-f194-4308-84a1-ed02ebb37f9a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:45.559017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd01f8ec-f194-4308-84a1-ed02ebb37f9a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:45.565476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd01f8ec-f194-4308-84a1-ed02ebb37f9a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:45.565955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd01f8ec-f194-4308-84a1-ed02ebb37f9a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:45.566698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd01f8ec-f194-4308-84a1-ed02ebb37f9a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:45.567122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd01f8ec-f194-4308-84a1-ed02ebb37f9a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:45.630895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd01f8ec-f194-4308-84a1-ed02ebb37f9a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:45.638808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd01f8ec-f194-4308-84a1-ed02ebb37f9a tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085246 Apr 11 19:58:45.639376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1072/1970] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:45 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:58:45.643854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee0d082f-6ea1-4e0a-9db6-76db7967cb61 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:45.644751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee0d082f-6ea1-4e0a-9db6-76db7967cb61 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:45.650789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee0d082f-6ea1-4e0a-9db6-76db7967cb61 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:45.651233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee0d082f-6ea1-4e0a-9db6-76db7967cb61 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:45.651990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee0d082f-6ea1-4e0a-9db6-76db7967cb61 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:45.652417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee0d082f-6ea1-4e0a-9db6-76db7967cb61 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:45.680362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:58:45.680985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 19:58:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f (ip 10.222.0.62) !!! Apr 11 19:58:45.682949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee0d082f-6ea1-4e0a-9db6-76db7967cb61 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042566 Apr 11 19:58:45.683529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1073/1971] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:45.688161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b172627b-058c-496a-8e7a-e51ab182fdbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:45.689299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b172627b-058c-496a-8e7a-e51ab182fdbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:45.695515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b172627b-058c-496a-8e7a-e51ab182fdbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:45.695967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b172627b-058c-496a-8e7a-e51ab182fdbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:45.696750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b172627b-058c-496a-8e7a-e51ab182fdbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:45.697212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b172627b-058c-496a-8e7a-e51ab182fdbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:45.724980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b172627b-058c-496a-8e7a-e51ab182fdbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040416 Apr 11 19:58:45.725685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1074/1972] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:46.656144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b9da870f-c493-42ee-984c-d81b66fa7c70 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:46.656791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b9da870f-c493-42ee-984c-d81b66fa7c70 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:46.663687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9da870f-c493-42ee-984c-d81b66fa7c70 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:46.664137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9da870f-c493-42ee-984c-d81b66fa7c70 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:46.664896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9da870f-c493-42ee-984c-d81b66fa7c70 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:46.665375 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9da870f-c493-42ee-984c-d81b66fa7c70 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:46.728321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9da870f-c493-42ee-984c-d81b66fa7c70 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:46.739991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b9da870f-c493-42ee-984c-d81b66fa7c70 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087677 Apr 11 19:58:46.740566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1075/1973] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:46 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:46.745343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44b508e9-94ee-4ee7-9346-141c0446adf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:46.746247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44b508e9-94ee-4ee7-9346-141c0446adf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:46.753046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44b508e9-94ee-4ee7-9346-141c0446adf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:46.753493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44b508e9-94ee-4ee7-9346-141c0446adf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:46.754259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44b508e9-94ee-4ee7-9346-141c0446adf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:46.754706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44b508e9-94ee-4ee7-9346-141c0446adf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:46.784504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44b508e9-94ee-4ee7-9346-141c0446adf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042839 Apr 11 19:58:46.785107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1076/1974] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:46.789680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13adf3de-d8a5-4275-b686-5735b4de929c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:46.790573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13adf3de-d8a5-4275-b686-5735b4de929c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:46.796781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13adf3de-d8a5-4275-b686-5735b4de929c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:46.797259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13adf3de-d8a5-4275-b686-5735b4de929c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:46.798016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13adf3de-d8a5-4275-b686-5735b4de929c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:46.798445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13adf3de-d8a5-4275-b686-5735b4de929c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:46.826331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13adf3de-d8a5-4275-b686-5735b4de929c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040230 Apr 11 19:58:46.826889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1077/1975] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:47.757786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9f0d6142-b435-428a-874a-aeed458a2e9b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:47.758468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9f0d6142-b435-428a-874a-aeed458a2e9b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:47.764811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f0d6142-b435-428a-874a-aeed458a2e9b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:47.765284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f0d6142-b435-428a-874a-aeed458a2e9b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:47.766027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f0d6142-b435-428a-874a-aeed458a2e9b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:47.766477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f0d6142-b435-428a-874a-aeed458a2e9b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:47.833065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9f0d6142-b435-428a-874a-aeed458a2e9b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:47.841080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9f0d6142-b435-428a-874a-aeed458a2e9b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087252 Apr 11 19:58:47.841634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1078/1976] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:47 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:47.846229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90b71ae2-4d01-4c92-a035-c0257a669b28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:47.847111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90b71ae2-4d01-4c92-a035-c0257a669b28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:47.853418 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90b71ae2-4d01-4c92-a035-c0257a669b28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:47.853864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90b71ae2-4d01-4c92-a035-c0257a669b28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:47.854627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90b71ae2-4d01-4c92-a035-c0257a669b28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:47.855060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90b71ae2-4d01-4c92-a035-c0257a669b28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:47.884057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90b71ae2-4d01-4c92-a035-c0257a669b28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041394 Apr 11 19:58:47.884616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1079/1977] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:47.891262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-74898e81-103c-4311-a729-3067b846097c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:47.892169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-74898e81-103c-4311-a729-3067b846097c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:47.898519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-74898e81-103c-4311-a729-3067b846097c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:47.898962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-74898e81-103c-4311-a729-3067b846097c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:47.899723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-74898e81-103c-4311-a729-3067b846097c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:47.900183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-74898e81-103c-4311-a729-3067b846097c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:47.930616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-74898e81-103c-4311-a729-3067b846097c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Apr 11 19:58:47.931176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1080/1978] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:48.859153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0af6d961-2a62-463e-8ae5-e88f0d98a1d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:48.859848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0af6d961-2a62-463e-8ae5-e88f0d98a1d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:48.866543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af6d961-2a62-463e-8ae5-e88f0d98a1d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:48.866997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af6d961-2a62-463e-8ae5-e88f0d98a1d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:48.867750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af6d961-2a62-463e-8ae5-e88f0d98a1d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:48.868182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0af6d961-2a62-463e-8ae5-e88f0d98a1d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:48.933802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0af6d961-2a62-463e-8ae5-e88f0d98a1d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:48.941935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0af6d961-2a62-463e-8ae5-e88f0d98a1d5 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086854 Apr 11 19:58:48.942492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1081/1979] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:48 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:48.947052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bed0334d-4b7e-4196-b384-e5bd526ebf60 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:48.947984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bed0334d-4b7e-4196-b384-e5bd526ebf60 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:48.954261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bed0334d-4b7e-4196-b384-e5bd526ebf60 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:48.954703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bed0334d-4b7e-4196-b384-e5bd526ebf60 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:48.955448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bed0334d-4b7e-4196-b384-e5bd526ebf60 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:48.955949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bed0334d-4b7e-4196-b384-e5bd526ebf60 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:48.985573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bed0334d-4b7e-4196-b384-e5bd526ebf60 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042104 Apr 11 19:58:48.986121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1082/1980] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:48.990661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27dcd358-9a34-4ad0-b557-09eb9e5bd5f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:48.991530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27dcd358-9a34-4ad0-b557-09eb9e5bd5f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:48.997534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27dcd358-9a34-4ad0-b557-09eb9e5bd5f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:48.997975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27dcd358-9a34-4ad0-b557-09eb9e5bd5f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:48.998710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27dcd358-9a34-4ad0-b557-09eb9e5bd5f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:48.999134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27dcd358-9a34-4ad0-b557-09eb9e5bd5f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:49.032660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27dcd358-9a34-4ad0-b557-09eb9e5bd5f4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045512 Apr 11 19:58:49.033235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1083/1981] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:49.963296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3e0c7f25-16f0-4058-8bb3-bf90d3a8b936 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:49.964382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3e0c7f25-16f0-4058-8bb3-bf90d3a8b936 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:49.974952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e0c7f25-16f0-4058-8bb3-bf90d3a8b936 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:49.975683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e0c7f25-16f0-4058-8bb3-bf90d3a8b936 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:49.976955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e0c7f25-16f0-4058-8bb3-bf90d3a8b936 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:49.977682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e0c7f25-16f0-4058-8bb3-bf90d3a8b936 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:50.045064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3e0c7f25-16f0-4058-8bb3-bf90d3a8b936 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:50.052797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3e0c7f25-16f0-4058-8bb3-bf90d3a8b936 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.096118 Apr 11 19:58:50.053355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1084/1982] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:49 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:50.058024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b303439-3d3b-434d-9293-3490e7ac1688 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:50.058918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7b303439-3d3b-434d-9293-3490e7ac1688 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:50.064654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b303439-3d3b-434d-9293-3490e7ac1688 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:50.065181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b303439-3d3b-434d-9293-3490e7ac1688 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:50.065924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b303439-3d3b-434d-9293-3490e7ac1688 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:50.066345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b303439-3d3b-434d-9293-3490e7ac1688 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:50.104039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7b303439-3d3b-434d-9293-3490e7ac1688 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049373 Apr 11 19:58:50.104932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1085/1983] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Apr 11 19:58:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:58:50.111943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc3a0684-8880-4f5c-8891-fddbfed9efda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:50.112861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc3a0684-8880-4f5c-8891-fddbfed9efda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:50.118441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc3a0684-8880-4f5c-8891-fddbfed9efda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:50.118881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc3a0684-8880-4f5c-8891-fddbfed9efda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:50.119622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc3a0684-8880-4f5c-8891-fddbfed9efda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:50.120048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc3a0684-8880-4f5c-8891-fddbfed9efda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:50.147331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc3a0684-8880-4f5c-8891-fddbfed9efda tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041151 Apr 11 19:58:50.147864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1086/1984] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:51.073726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dff909c2-3d36-4570-a192-0752c1e743cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:51.074795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dff909c2-3d36-4570-a192-0752c1e743cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:51.085196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dff909c2-3d36-4570-a192-0752c1e743cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:51.085941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dff909c2-3d36-4570-a192-0752c1e743cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:51.087182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dff909c2-3d36-4570-a192-0752c1e743cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:51.087902 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dff909c2-3d36-4570-a192-0752c1e743cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:51.152838 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dff909c2-3d36-4570-a192-0752c1e743cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:51.160823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dff909c2-3d36-4570-a192-0752c1e743cd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093601 Apr 11 19:58:51.161420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1087/1985] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:51 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:51.165988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-733ae0fd-55ec-40c0-8656-1fce874a04d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:58:51.166888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-733ae0fd-55ec-40c0-8656-1fce874a04d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:51.173036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-733ae0fd-55ec-40c0-8656-1fce874a04d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:51.173477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-733ae0fd-55ec-40c0-8656-1fce874a04d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:51.174228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-733ae0fd-55ec-40c0-8656-1fce874a04d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:51.174707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-733ae0fd-55ec-40c0-8656-1fce874a04d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:51.250183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-733ae0fd-55ec-40c0-8656-1fce874a04d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "POST /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/action" status: 200 len: 38134 microversion: 2.20 time: 0.086719 Apr 11 19:58:51.260417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1088/1986] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Apr 11 19:58:51 2022] POST /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5/action => generated 38134 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 11 19:58:51.260417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-360e3494-074c-4697-8a4a-475f282b9637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:51.261227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-360e3494-074c-4697-8a4a-475f282b9637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:51.271173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-360e3494-074c-4697-8a4a-475f282b9637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:51.271625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-360e3494-074c-4697-8a4a-475f282b9637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:51.272417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-360e3494-074c-4697-8a4a-475f282b9637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:51.272850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-360e3494-074c-4697-8a4a-475f282b9637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:51.304064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-360e3494-074c-4697-8a4a-475f282b9637 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051281 Apr 11 19:58:51.304653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1089/1987] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:52.178719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5687991-c67a-40a7-839e-755f56a9a6be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:52.179386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5687991-c67a-40a7-839e-755f56a9a6be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:52.186037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5687991-c67a-40a7-839e-755f56a9a6be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:52.186456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5687991-c67a-40a7-839e-755f56a9a6be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:52.187223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5687991-c67a-40a7-839e-755f56a9a6be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:52.187655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5687991-c67a-40a7-839e-755f56a9a6be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:52.251476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5687991-c67a-40a7-839e-755f56a9a6be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:52.259745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5687991-c67a-40a7-839e-755f56a9a6be tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.085105 Apr 11 19:58:52.260355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1090/1988] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:52 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:52.315947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af22040d-ca7d-43aa-a211-d2a653fc3722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:52.316862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-af22040d-ca7d-43aa-a211-d2a653fc3722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:52.323659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af22040d-ca7d-43aa-a211-d2a653fc3722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:52.324098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af22040d-ca7d-43aa-a211-d2a653fc3722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:52.324858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af22040d-ca7d-43aa-a211-d2a653fc3722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:52.325323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af22040d-ca7d-43aa-a211-d2a653fc3722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:52.354567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-af22040d-ca7d-43aa-a211-d2a653fc3722 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042543 Apr 11 19:58:52.355116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1091/1989] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:53.278714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6cd69dcb-45d7-4a78-81f8-d549253fba2b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:53.279424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6cd69dcb-45d7-4a78-81f8-d549253fba2b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:53.286384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cd69dcb-45d7-4a78-81f8-d549253fba2b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:53.286826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cd69dcb-45d7-4a78-81f8-d549253fba2b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:53.287584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cd69dcb-45d7-4a78-81f8-d549253fba2b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:53.288012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cd69dcb-45d7-4a78-81f8-d549253fba2b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:53.358314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6cd69dcb-45d7-4a78-81f8-d549253fba2b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:53.366595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6cd69dcb-45d7-4a78-81f8-d549253fba2b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.091708 Apr 11 19:58:53.367170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1092/1990] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:53 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:53.371770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91cf876f-80ec-43eb-97f4-566143ffcaef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:53.372660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91cf876f-80ec-43eb-97f4-566143ffcaef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:53.379316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91cf876f-80ec-43eb-97f4-566143ffcaef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:53.379756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91cf876f-80ec-43eb-97f4-566143ffcaef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:53.380503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91cf876f-80ec-43eb-97f4-566143ffcaef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:53.381008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91cf876f-80ec-43eb-97f4-566143ffcaef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:53.410162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91cf876f-80ec-43eb-97f4-566143ffcaef tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 Apr 11 19:58:53.410731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1093/1991] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:54.383431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-57622822-a4a9-4896-a0b6-89116226f4ad tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:54.384433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-57622822-a4a9-4896-a0b6-89116226f4ad tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:54.390946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57622822-a4a9-4896-a0b6-89116226f4ad tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:54.391389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57622822-a4a9-4896-a0b6-89116226f4ad tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:54.392144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57622822-a4a9-4896-a0b6-89116226f4ad tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:54.392565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57622822-a4a9-4896-a0b6-89116226f4ad tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:54.465759 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-57622822-a4a9-4896-a0b6-89116226f4ad tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:54.476570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-57622822-a4a9-4896-a0b6-89116226f4ad tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.096772 Apr 11 19:58:54.477342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1094/1992] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:54 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:54.481916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dbfb14bc-e64d-4901-b2c2-0f39c0a65e56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:54.482827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dbfb14bc-e64d-4901-b2c2-0f39c0a65e56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:54.489235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbfb14bc-e64d-4901-b2c2-0f39c0a65e56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:54.489777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbfb14bc-e64d-4901-b2c2-0f39c0a65e56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:54.490637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbfb14bc-e64d-4901-b2c2-0f39c0a65e56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:54.491058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbfb14bc-e64d-4901-b2c2-0f39c0a65e56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:54.520628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dbfb14bc-e64d-4901-b2c2-0f39c0a65e56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Apr 11 19:58:54.521251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1095/1993] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:55.494063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3871f2bb-9873-434a-9c27-40865cf71f5d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:55.494765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3871f2bb-9873-434a-9c27-40865cf71f5d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:55.501494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3871f2bb-9873-434a-9c27-40865cf71f5d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:55.501962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3871f2bb-9873-434a-9c27-40865cf71f5d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:55.502685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3871f2bb-9873-434a-9c27-40865cf71f5d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:55.503279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3871f2bb-9873-434a-9c27-40865cf71f5d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:55.570059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3871f2bb-9873-434a-9c27-40865cf71f5d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:55.578048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3871f2bb-9873-434a-9c27-40865cf71f5d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087913 Apr 11 19:58:55.578659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1096/1994] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:55 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 19:58:55.583393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1596bd80-86bf-4b51-b05e-fdb2188c4f59 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:55.584345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1596bd80-86bf-4b51-b05e-fdb2188c4f59 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:55.592303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1596bd80-86bf-4b51-b05e-fdb2188c4f59 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:55.592748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1596bd80-86bf-4b51-b05e-fdb2188c4f59 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:55.593634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1596bd80-86bf-4b51-b05e-fdb2188c4f59 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:55.594064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1596bd80-86bf-4b51-b05e-fdb2188c4f59 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:55.626474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1596bd80-86bf-4b51-b05e-fdb2188c4f59 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046757 Apr 11 19:58:55.627053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1097/1995] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:56.599679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3fe4b5ee-e0ff-4312-9734-381fe92972f3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:56.600769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3fe4b5ee-e0ff-4312-9734-381fe92972f3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:56.611175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fe4b5ee-e0ff-4312-9734-381fe92972f3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:56.611906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fe4b5ee-e0ff-4312-9734-381fe92972f3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:56.613004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fe4b5ee-e0ff-4312-9734-381fe92972f3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:56.613390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fe4b5ee-e0ff-4312-9734-381fe92972f3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:56.683386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3fe4b5ee-e0ff-4312-9734-381fe92972f3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:56.692045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3fe4b5ee-e0ff-4312-9734-381fe92972f3 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098892 Apr 11 19:58:56.692661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1098/1996] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:56 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:56.697766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a57469cd-9b0c-414c-a50b-c98f3f915018 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:56.698671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a57469cd-9b0c-414c-a50b-c98f3f915018 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:56.706721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a57469cd-9b0c-414c-a50b-c98f3f915018 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:56.707158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a57469cd-9b0c-414c-a50b-c98f3f915018 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:56.708179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a57469cd-9b0c-414c-a50b-c98f3f915018 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:56.708324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a57469cd-9b0c-414c-a50b-c98f3f915018 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:56.738167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a57469cd-9b0c-414c-a50b-c98f3f915018 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Apr 11 19:58:56.738746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1099/1997] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:57.709842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-21c7fbe2-2551-49df-8191-58d602415115 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:57.710521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-21c7fbe2-2551-49df-8191-58d602415115 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:57.717285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21c7fbe2-2551-49df-8191-58d602415115 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:57.717729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21c7fbe2-2551-49df-8191-58d602415115 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:57.718482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21c7fbe2-2551-49df-8191-58d602415115 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:57.718910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21c7fbe2-2551-49df-8191-58d602415115 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:57.780450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-21c7fbe2-2551-49df-8191-58d602415115 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:57.792946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-21c7fbe2-2551-49df-8191-58d602415115 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.086976 Apr 11 19:58:57.793571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1100/1998] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:57 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:57.798303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d1ef53bf-aa34-4278-94a3-a5b2d5d871f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:57.799266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d1ef53bf-aa34-4278-94a3-a5b2d5d871f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:57.805671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1ef53bf-aa34-4278-94a3-a5b2d5d871f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:57.806114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1ef53bf-aa34-4278-94a3-a5b2d5d871f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:57.806865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1ef53bf-aa34-4278-94a3-a5b2d5d871f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:57.807287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1ef53bf-aa34-4278-94a3-a5b2d5d871f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:57.837623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d1ef53bf-aa34-4278-94a3-a5b2d5d871f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043026 Apr 11 19:58:57.838180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1101/1999] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:58.810257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d675c287-5cbc-424e-a58b-bb7d4bdd7bbd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:58.811043 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d675c287-5cbc-424e-a58b-bb7d4bdd7bbd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:58.819386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d675c287-5cbc-424e-a58b-bb7d4bdd7bbd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:58.820389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d675c287-5cbc-424e-a58b-bb7d4bdd7bbd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:58.821273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d675c287-5cbc-424e-a58b-bb7d4bdd7bbd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:58.821949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d675c287-5cbc-424e-a58b-bb7d4bdd7bbd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:58.895251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d675c287-5cbc-424e-a58b-bb7d4bdd7bbd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:58:58.905037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d675c287-5cbc-424e-a58b-bb7d4bdd7bbd tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.098743 Apr 11 19:58:58.905575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1102/2000] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:58 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:58:58.910124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e3179dcf-7127-4180-bf7a-c1daa77c8cc5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:58.911092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e3179dcf-7127-4180-bf7a-c1daa77c8cc5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:58.916769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3179dcf-7127-4180-bf7a-c1daa77c8cc5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:58.917250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3179dcf-7127-4180-bf7a-c1daa77c8cc5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:58.917997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3179dcf-7127-4180-bf7a-c1daa77c8cc5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:58.918453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3179dcf-7127-4180-bf7a-c1daa77c8cc5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:58.950908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e3179dcf-7127-4180-bf7a-c1daa77c8cc5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Apr 11 19:58:58.951687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1103/2001] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:58:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:58:59.922386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-47a62a87-5d44-4370-a11e-72921052c43d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:58:59.923137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-47a62a87-5d44-4370-a11e-72921052c43d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:58:59.930109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47a62a87-5d44-4370-a11e-72921052c43d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:59.930549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47a62a87-5d44-4370-a11e-72921052c43d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:59.931298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47a62a87-5d44-4370-a11e-72921052c43d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:58:59.931719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47a62a87-5d44-4370-a11e-72921052c43d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:58:59.997055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47a62a87-5d44-4370-a11e-72921052c43d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:59:00.005744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-47a62a87-5d44-4370-a11e-72921052c43d tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.087244 Apr 11 19:59:00.006335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1104/2002] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:58:59 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:59:00.010941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4bb74f2e-9630-4732-807d-655a7b3bd389 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:00.011841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4bb74f2e-9630-4732-807d-655a7b3bd389 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:00.019266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bb74f2e-9630-4732-807d-655a7b3bd389 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:00.019904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bb74f2e-9630-4732-807d-655a7b3bd389 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:00.021105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bb74f2e-9630-4732-807d-655a7b3bd389 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:00.021656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bb74f2e-9630-4732-807d-655a7b3bd389 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:00.053533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4bb74f2e-9630-4732-807d-655a7b3bd389 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046194 Apr 11 19:59:00.054090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1105/2003] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:59:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:59:01.023013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d28d5be7-b5e1-4cdf-bee0-aa66610fd9b0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:01.023726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d28d5be7-b5e1-4cdf-bee0-aa66610fd9b0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:01.030446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d28d5be7-b5e1-4cdf-bee0-aa66610fd9b0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:01.030899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d28d5be7-b5e1-4cdf-bee0-aa66610fd9b0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:01.031659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d28d5be7-b5e1-4cdf-bee0-aa66610fd9b0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:01.032069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d28d5be7-b5e1-4cdf-bee0-aa66610fd9b0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:01.100439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d28d5be7-b5e1-4cdf-bee0-aa66610fd9b0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:59:01.108461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d28d5be7-b5e1-4cdf-bee0-aa66610fd9b0 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.089484 Apr 11 19:59:01.109257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1106/2004] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:59:01 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:59:01.113821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b0664e96-9c93-4762-b839-7b113431a554 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:01.114731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b0664e96-9c93-4762-b839-7b113431a554 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:01.120736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0664e96-9c93-4762-b839-7b113431a554 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:01.121212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0664e96-9c93-4762-b839-7b113431a554 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:01.121964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0664e96-9c93-4762-b839-7b113431a554 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:01.122412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0664e96-9c93-4762-b839-7b113431a554 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:01.151546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b0664e96-9c93-4762-b839-7b113431a554 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041373 Apr 11 19:59:01.152079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1107/2005] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:59:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:59:02.125213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-819002d2-a537-4dc1-9224-5ccb216ebb85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:02.126096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-819002d2-a537-4dc1-9224-5ccb216ebb85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:02.132522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-819002d2-a537-4dc1-9224-5ccb216ebb85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:02.132988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-819002d2-a537-4dc1-9224-5ccb216ebb85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:02.133750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-819002d2-a537-4dc1-9224-5ccb216ebb85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:02.134176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-819002d2-a537-4dc1-9224-5ccb216ebb85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:02.205680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-819002d2-a537-4dc1-9224-5ccb216ebb85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:59:02.214158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-819002d2-a537-4dc1-9224-5ccb216ebb85 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.093199 Apr 11 19:59:02.214778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1108/2006] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:59:02 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:59:02.219557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b5c568a-27b8-48e4-b419-9f3f86c8346e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:02.220480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b5c568a-27b8-48e4-b419-9f3f86c8346e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:02.227165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b5c568a-27b8-48e4-b419-9f3f86c8346e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:02.227604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b5c568a-27b8-48e4-b419-9f3f86c8346e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:02.228365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b5c568a-27b8-48e4-b419-9f3f86c8346e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:02.228786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b5c568a-27b8-48e4-b419-9f3f86c8346e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:02.274230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b5c568a-27b8-48e4-b419-9f3f86c8346e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058069 Apr 11 19:59:02.275132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1109/2007] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:59:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:59:03.231549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-483b9155-b1b6-47b9-a86a-40c0493c6bb4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:03.232246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-483b9155-b1b6-47b9-a86a-40c0493c6bb4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:03.240049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-483b9155-b1b6-47b9-a86a-40c0493c6bb4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:03.240475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-483b9155-b1b6-47b9-a86a-40c0493c6bb4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:03.241285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-483b9155-b1b6-47b9-a86a-40c0493c6bb4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:03.241722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-483b9155-b1b6-47b9-a86a-40c0493c6bb4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:03.311010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-483b9155-b1b6-47b9-a86a-40c0493c6bb4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:59:03.319152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-483b9155-b1b6-47b9-a86a-40c0493c6bb4 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.091558 Apr 11 19:59:03.319735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1110/2008] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:59:03 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:59:03.324250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e1c98e5d-775f-4b46-a202-9a99f5036c4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:03.325203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e1c98e5d-775f-4b46-a202-9a99f5036c4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:03.330948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c98e5d-775f-4b46-a202-9a99f5036c4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:03.331440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c98e5d-775f-4b46-a202-9a99f5036c4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:03.332180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c98e5d-775f-4b46-a202-9a99f5036c4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:03.332633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c98e5d-775f-4b46-a202-9a99f5036c4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:03.360913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e1c98e5d-775f-4b46-a202-9a99f5036c4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040138 Apr 11 19:59:03.361480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1111/2009] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 19:59:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 19:59:04.337476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-264b2e70-1988-45c1-9428-ebd50003d2e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:04.338219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-264b2e70-1988-45c1-9428-ebd50003d2e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:04.345150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-264b2e70-1988-45c1-9428-ebd50003d2e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:04.345599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-264b2e70-1988-45c1-9428-ebd50003d2e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:04.346366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-264b2e70-1988-45c1-9428-ebd50003d2e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:04.346798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-264b2e70-1988-45c1-9428-ebd50003d2e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:04.408368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-264b2e70-1988-45c1-9428-ebd50003d2e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 19:59:04.416268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-264b2e70-1988-45c1-9428-ebd50003d2e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083517 Apr 11 19:59:04.416831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1112/2010] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 19:59:04 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 19:59:04.421445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ec97f618-126e-4bf5-b5f8-551f234205be tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 19:59:04.422414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ec97f618-126e-4bf5-b5f8-551f234205be tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:04.428439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec97f618-126e-4bf5-b5f8-551f234205be tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:04.428886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec97f618-126e-4bf5-b5f8-551f234205be tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:04.429668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec97f618-126e-4bf5-b5f8-551f234205be tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:04.430100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec97f618-126e-4bf5-b5f8-551f234205be tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:04.504687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ec97f618-126e-4bf5-b5f8-551f234205be tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/action" status: 200 len: 82337 microversion: 2.1 time: 0.086473 Apr 11 19:59:04.506278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1113/2011] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 19:59:04 2022] POST /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/action => generated 82337 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 19:59:04.532649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 19:59:04.533314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 19:59:04.540602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:04.541093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:04.541848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 19:59:04.542291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 19:59:24.626981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:59:24.628206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 19:59:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b (ip 10.222.0.62) !!! Apr 11 19:59:43.476007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:59:43.476533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 19:59:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f (ip 10.222.0.62) !!! Apr 11 19:59:58.431461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 19:59:58.432382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 19:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f (ip 10.222.0.62) !!! Apr 11 20:00:05.336212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f385fa23-e738-4ae6-9eac-c77fe19342ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f" status: 202 len: 0 microversion: 2.1 time: 120.183539 Apr 11 20:00:05.336958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 899/2012] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 19:58:05 2022] DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f => generated 0 bytes in 120185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:00:05.343295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:00:05.343861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:00:05.350290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:00:05.350745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:00:05.351527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:00:05.352014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:00:05.584874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lazy-loading 'services' on Instance uuid 4f85f237-46f1-47d2-badc-2e3cffe85c90 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:00:20.724372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'services' on Instance uuid c9ab5394-5558-4afd-b34d-c75fc0dfd907 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:00:20.755416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6315b015-dc4e-4323-89c5-d618be3c87ff) Apr 11 20:00:20.756313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6315b015-dc4e-4323-89c5-d618be3c87ff) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:00:20.756875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ef439184-2f68-446c-b5f7-eb8ed762b4fd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b" status: 400 len: 269 microversion: 2.1 time: 76.228704 Apr 11 20:00:20.757522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1114/2013] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 19:59:04 2022] DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b => generated 269 bytes in 76230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:00:20.763020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a008372f-41c7-4d94-8497-6be96bc014c6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:00:20.766603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a008372f-41c7-4d94-8497-6be96bc014c6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:00:20.770843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a008372f-41c7-4d94-8497-6be96bc014c6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:00:20.771299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a008372f-41c7-4d94-8497-6be96bc014c6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:00:20.772068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a008372f-41c7-4d94-8497-6be96bc014c6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:00:20.772507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a008372f-41c7-4d94-8497-6be96bc014c6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:00:20.850347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a008372f-41c7-4d94-8497-6be96bc014c6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:00:20.858001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a008372f-41c7-4d94-8497-6be96bc014c6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.099451 Apr 11 20:00:20.858580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1115/2014] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:00:20 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:00:20.863120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:00:20.863618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:00:20.876881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:00:20.877326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:00:20.878105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:00:20.878608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:02:05.690060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:02:05.691075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f (ip 10.222.0.62) !!! Apr 11 20:02:05.819046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d5e564c-0c2c-4bed-be7a-070893092d66) Apr 11 20:02:05.819763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d5e564c-0c2c-4bed-be7a-070893092d66) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:02:05.820686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0160dfe2-63cc-4df9-ae6b-fb7cdc522b5f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f" status: 400 len: 269 microversion: 2.1 time: 120.482563 Apr 11 20:02:05.821385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 900/2015] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:00:05 2022] DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f => generated 269 bytes in 120484 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:02:05.827188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:02:05.827677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:02:05.833648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:02:05.834098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:02:05.834857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:02:05.835291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:02:05.866057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lazy-loading 'services' on Instance uuid 4f85f237-46f1-47d2-badc-2e3cffe85c90 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:02:20.975014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'services' on Instance uuid c9ab5394-5558-4afd-b34d-c75fc0dfd907 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:02:21.003813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e51df81-4634-40f4-8f76-d2ba6b768441) Apr 11 20:02:21.004489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e51df81-4634-40f4-8f76-d2ba6b768441) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:02:21.005442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9056cc6-1ea7-474f-946b-42bb1e533a23 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b" status: 400 len: 269 microversion: 2.1 time: 120.145981 Apr 11 20:02:21.006076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1116/2016] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:00:20 2022] DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b => generated 269 bytes in 120147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:02:21.143796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95447ae5-3947-4134-9d6a-3d45ab631944 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:02:21.144463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95447ae5-3947-4134-9d6a-3d45ab631944 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:02:21.151225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95447ae5-3947-4134-9d6a-3d45ab631944 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:02:21.151743 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95447ae5-3947-4134-9d6a-3d45ab631944 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:02:21.152568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95447ae5-3947-4134-9d6a-3d45ab631944 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:02:21.153029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95447ae5-3947-4134-9d6a-3d45ab631944 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:02:21.215149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95447ae5-3947-4134-9d6a-3d45ab631944 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:02:21.222596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95447ae5-3947-4134-9d6a-3d45ab631944 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.215357 Apr 11 20:02:21.223153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1117/2017] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:02:21 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:02:21.227770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:02:21.228252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:02:21.233691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:02:21.234138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:02:21.234882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:02:21.235310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:02:44.638745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:02:44.639529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:02:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b (ip 10.222.0.62) !!! Apr 11 20:03:03.484951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:03:03.485455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f (ip 10.222.0.62) !!! Apr 11 20:03:18.441414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:03:18.441414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f (ip 10.222.0.62) !!! Apr 11 20:04:06.388693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85f48cfc-a34a-46b0-9677-9376dba44039) Apr 11 20:04:06.390407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85f48cfc-a34a-46b0-9677-9376dba44039) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:06.390407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0d84e74a-0d44-4e6b-bd1c-26106776e562 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f" status: 400 len: 269 microversion: 2.1 time: 120.567595 Apr 11 20:04:06.391338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 901/2018] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:02:05 2022] DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f => generated 269 bytes in 120569 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:06.397130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:06.397632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:06.406781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:06.407480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:06.408825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:06.409783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:06.498036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lazy-loading 'services' on Instance uuid 4f85f237-46f1-47d2-badc-2e3cffe85c90 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:07.117530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'services' on Instance uuid c9ab5394-5558-4afd-b34d-c75fc0dfd907 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:07.146052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-641cbab1-3522-4bd8-bd82-797c9ee7a910) Apr 11 20:04:07.146668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-641cbab1-3522-4bd8-bd82-797c9ee7a910) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:07.147512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68728c62-c564-4684-aa5e-1fdce6848095 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b" status: 400 len: 269 microversion: 2.1 time: 105.923326 Apr 11 20:04:07.148066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1118/2019] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:02:21 2022] DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b => generated 269 bytes in 105924 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:07.153457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e0e203f-dba4-481e-baef-50522d1155e6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:07.154065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e0e203f-dba4-481e-baef-50522d1155e6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:07.160547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e0e203f-dba4-481e-baef-50522d1155e6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:07.160996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e0e203f-dba4-481e-baef-50522d1155e6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:07.161765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e0e203f-dba4-481e-baef-50522d1155e6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:07.162192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e0e203f-dba4-481e-baef-50522d1155e6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:07.225488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e0e203f-dba4-481e-baef-50522d1155e6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:07.232935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e0e203f-dba4-481e-baef-50522d1155e6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1225 microversion: 2.1 time: 0.083807 Apr 11 20:04:07.233523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1119/2020] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:07 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:07.238261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:07.238744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:07.244670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:07.245154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:07.245912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:07.246345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.250742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5339d9-7183-4458-a4b5-453dce2d5ce6) Apr 11 20:04:21.251446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5339d9-7183-4458-a4b5-453dce2d5ce6) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:21.252569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2b4c6570-1868-483d-987d-adaf24edde36 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f" status: 400 len: 269 microversion: 2.1 time: 14.860287 Apr 11 20:04:21.253588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 902/2021] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:04:06 2022] DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f => generated 269 bytes in 14862 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:21.258425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:21.258955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:21.265321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.265768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.266582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.267102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.317531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lazy-loading 'services' on Instance uuid 4f85f237-46f1-47d2-badc-2e3cffe85c90 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:21.501684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'services' on Instance uuid c9ab5394-5558-4afd-b34d-c75fc0dfd907 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:21.534617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e3e891b-6cde-445a-803d-a1f306152cd0) Apr 11 20:04:21.536211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e3e891b-6cde-445a-803d-a1f306152cd0) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:21.537162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-48d7ea9f-e185-4da6-ad7c-072fdb8f3ef7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b" status: 400 len: 269 microversion: 2.1 time: 14.302592 Apr 11 20:04:21.537728 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1120/2022] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:04:07 2022] DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b => generated 269 bytes in 14304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:21.542985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:21.543771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:21.551064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.551500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.552239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.552856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.587987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.588765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.589486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lazy-loading 'fault' on Instance uuid 2b2485fb-c412-422f-84b0-26e9200f5940 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:21.639184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef6c7d7ab9a47d4bb332b73e60ce67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0666647cc4f0410a90947d91ddbccf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:21.649342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e404b253-aa03-48fd-9312-19f5c07fe78b tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 200 len: 1230 microversion: 2.1 time: 0.110148 Apr 11 20:04:21.650387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1121/2023] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:21 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:21.651358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb563076-ad47-4d23-8552-7080e367d2e3) Apr 11 20:04:21.652707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb563076-ad47-4d23-8552-7080e367d2e3) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:21.654516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-267c931a-e37a-4e3e-bad6-046338627a37 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f" status: 400 len: 269 microversion: 2.1 time: 0.399982 Apr 11 20:04:21.655784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 903/2024] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:04:21 2022] DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f => generated 269 bytes in 402 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:21.659960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:21.660503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:21.665720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:21.666947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:21.671176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.671628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.672553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.673303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.675798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.676488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.677409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.677876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.777147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lazy-loading 'services' on Instance uuid 4f85f237-46f1-47d2-badc-2e3cffe85c90 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:21.815873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'services' on Instance uuid c9ab5394-5558-4afd-b34d-c75fc0dfd907 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:21.844874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8931de3-f2d8-440f-af12-0b1cbfbc3ff9) Apr 11 20:04:21.845505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8931de3-f2d8-440f-af12-0b1cbfbc3ff9) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:21.846338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26bddd93-d03d-4638-9774-7a46ba793f12 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b" status: 400 len: 269 microversion: 2.1 time: 0.193239 Apr 11 20:04:21.846894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1122/2025] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:04:21 2022] DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b => generated 269 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:21.851552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:21.852185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:21.858922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.859410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.860214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.860716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.874325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] HTTP exception thrown: Instance 2b2485fb-c412-422f-84b0-26e9200f5940 could not be found. Apr 11 20:04:21.874914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Returning 404 to user: Instance 2b2485fb-c412-422f-84b0-26e9200f5940 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:21.875742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-838e7079-f817-46e2-93ce-e23eee9bcc75 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 404 len: 111 microversion: 2.1 time: 0.027891 Apr 11 20:04:21.876460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1123/2026] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:21 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:04:21.881185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:21.881538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:21.883179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f729ab97-b258-4ce5-9bae-070539393b33) Apr 11 20:04:21.883887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f729ab97-b258-4ce5-9bae-070539393b33) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:21.884724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6167e02-b659-4e57-b708-d7803034ec22 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f" status: 400 len: 269 microversion: 2.1 time: 0.226339 Apr 11 20:04:21.885284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 904/2027] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:04:21 2022] DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f => generated 269 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:21.887368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.887812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.888567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.889018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.889951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:21.890461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:21.897629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.898105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.898856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:21.899281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:21.971088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lazy-loading 'services' on Instance uuid 4f85f237-46f1-47d2-badc-2e3cffe85c90 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:22.011859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lazy-loading 'services' on Instance uuid c9ab5394-5558-4afd-b34d-c75fc0dfd907 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:04:22.047215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74ccd6d0-8200-4673-9746-e50f1a78d1ec) Apr 11 20:04:22.047876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74ccd6d0-8200-4673-9746-e50f1a78d1ec) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:22.048708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-490393bc-25ef-499a-83fd-5b1500b18635 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b" status: 400 len: 269 microversion: 2.1 time: 0.171412 Apr 11 20:04:22.049643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1124/2028] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:04:21 2022] DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90/os-volume_attachments/e0aed9fa-cade-4d37-b5d1-7717b51dd09b => generated 269 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:22.058010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:22.059159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:22.068712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:22.069269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:22.070291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:22.071104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:22.084244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-36959bd8-63ed-4258-bcc0-21cac9532cab) Apr 11 20:04:22.085010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-36959bd8-63ed-4258-bcc0-21cac9532cab) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:22.086409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f1dbacf0-5af8-42e9-a92e-969aa029b7fb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f" status: 400 len: 269 microversion: 2.1 time: 0.199900 Apr 11 20:04:22.087227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 905/2029] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:04:21 2022] DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907/os-volume_attachments/d53c3021-0490-4e72-9f54-b9779066977f => generated 269 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:22.092500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] HTTP exception thrown: Instance 2b2485fb-c412-422f-84b0-26e9200f5940 could not be found. Apr 11 20:04:22.093536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Returning 404 to user: Instance 2b2485fb-c412-422f-84b0-26e9200f5940 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:22.094780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b75514d-79ba-4a40-83c9-8260e1dcd153 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 404 len: 111 microversion: 2.1 time: 0.043938 Apr 11 20:04:22.096604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1125/2030] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:22 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:04:22.096741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec7824ed-4184-4b6f-bb45-89057cf6ed53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:22.096741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec7824ed-4184-4b6f-bb45-89057cf6ed53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:22.103191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec7824ed-4184-4b6f-bb45-89057cf6ed53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:22.103755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec7824ed-4184-4b6f-bb45-89057cf6ed53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:22.104954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec7824ed-4184-4b6f-bb45-89057cf6ed53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:22.105417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec7824ed-4184-4b6f-bb45-89057cf6ed53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:22.132213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec7824ed-4184-4b6f-bb45-89057cf6ed53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:04:22.169597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1184544115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1088380937", "security_groups": [{"name": "tempest-secgroup-smoke-152647840"}], "block_device_mapping_v2": [{"uuid": "31271bd6-d562-4f77-b2b4-44541048aa5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fdfe6bd8-d9b7-4af1-b14f-56b45ed38fc2"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:04:22.233570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec7824ed-4184-4b6f-bb45-89057cf6ed53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 204 len: 0 microversion: 2.1 time: 0.141104 Apr 11 20:04:22.234331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 906/2031] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:04:22 2022] DELETE /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:04:22.246429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-41f985e3-0757-46a6-a2ba-d381509c1af0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:22.247124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-41f985e3-0757-46a6-a2ba-d381509c1af0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:22.253260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41f985e3-0757-46a6-a2ba-d381509c1af0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:22.253868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41f985e3-0757-46a6-a2ba-d381509c1af0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:22.254480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41f985e3-0757-46a6-a2ba-d381509c1af0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:22.254911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41f985e3-0757-46a6-a2ba-d381509c1af0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:22.378430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] validate_networks() for [('fdfe6bd8-d9b7-4af1-b14f-56b45ed38fc2', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 20:04:22.481173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-41f985e3-0757-46a6-a2ba-d381509c1af0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:22.495863 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-41f985e3-0757-46a6-a2ba-d381509c1af0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1727 microversion: 2.1 time: 0.252974 Apr 11 20:04:22.501131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 907/2032] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1727 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:04:22.865320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:04:22.865744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:04:22.866244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:04:22.866637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:04:22.867048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:04:22.877745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:22.878185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:22.878950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:22.879372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:22.899733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Getting quotas for project 0666647cc4f0410a90947d91ddbccf87. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:04:22.903837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Getting quotas for user bef6c7d7ab9a47d4bb332b73e60ce67c and project 0666647cc4f0410a90947d91ddbccf87. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:04:22.970781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 20:04:22.972890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: f8c68147-90be-4950-936b-cedddbf8320e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31271bd6-d562-4f77-b2b4-44541048aa5e',volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 20:04:23.042509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 31271bd6-d562-4f77-b2b4-44541048aa5e status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-fb13c876-4cd1-47ed-97b7-23f5e5d6cad3) Apr 11 20:04:23.043115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 31271bd6-d562-4f77-b2b4-44541048aa5e status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-fb13c876-4cd1-47ed-97b7-23f5e5d6cad3) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:23.043960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84cfd558-ae18-4a30-a1be-3f7d3991d5e7 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 0.878365 Apr 11 20:04:23.044529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1126/2033] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 20:04:22 2022] POST /compute/v2.1/servers => generated 295 bytes in 879 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:04:23.515948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9f04be1a-d984-45d7-b085-8730bb15de22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:23.517745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9f04be1a-d984-45d7-b085-8730bb15de22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:23.530281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:23.530933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:23.531109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f04be1a-d984-45d7-b085-8730bb15de22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:23.531493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f04be1a-d984-45d7-b085-8730bb15de22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:23.532269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f04be1a-d984-45d7-b085-8730bb15de22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:23.533082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f04be1a-d984-45d7-b085-8730bb15de22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:23.540021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:23.540444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:23.541426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:23.542017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:23.557179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] HTTP exception thrown: Instance 2b2485fb-c412-422f-84b0-26e9200f5940 could not be found. Apr 11 20:04:23.557986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Returning 404 to user: Instance 2b2485fb-c412-422f-84b0-26e9200f5940 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:23.559035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13ad047e-9131-4860-a1ca-e1e1eedf4c01 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 404 len: 111 microversion: 2.1 time: 0.033026 Apr 11 20:04:23.560315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1127/2034] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:04:23 2022] DELETE /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 20:04:23.568701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:23.569710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] [instance: 2b2485fb-c412-422f-84b0-26e9200f5940] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:23.576918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:23.577595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:23.578551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:23.579201 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:23.594524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] HTTP exception thrown: Instance 2b2485fb-c412-422f-84b0-26e9200f5940 could not be found. Apr 11 20:04:23.595146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Returning 404 to user: Instance 2b2485fb-c412-422f-84b0-26e9200f5940 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:04:23.596158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ce23e8d-d9c1-432c-b3a1-073c739b69d6 tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940" status: 404 len: 111 microversion: 2.1 time: 0.031992 Apr 11 20:04:23.596713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1128/2035] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:23 2022] GET /compute/v2.1/servers/2b2485fb-c412-422f-84b0-26e9200f5940 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:04:23.689831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9f04be1a-d984-45d7-b085-8730bb15de22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:23.700194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9f04be1a-d984-45d7-b085-8730bb15de22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1727 microversion: 2.1 time: 0.187232 Apr 11 20:04:23.702485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 908/2036] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:24.131204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-6fae7337-03e8-4e52-ab5a-d30dc53a64da req-78f64698-f2a8-4a10-8233-242a68631be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4", "name": "network-vif-deleted", "tag": "acea41a3-8241-49f7-8452-ffb966c45bfa"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:04:24.140164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-6fae7337-03e8-4e52-ab5a-d30dc53a64da req-78f64698-f2a8-4a10-8233-242a68631be5 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:24.140806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-6fae7337-03e8-4e52-ab5a-d30dc53a64da req-78f64698-f2a8-4a10-8233-242a68631be5 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:24.160726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-6fae7337-03e8-4e52-ab5a-d30dc53a64da req-78f64698-f2a8-4a10-8233-242a68631be5 service nova] Creating event network-vif-deleted:acea41a3-8241-49f7-8452-ffb966c45bfa for instance 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 on hv-cinder-83078 Apr 11 20:04:24.165053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: ERROR oslo.messaging._drivers.impl_rabbit [req-6fae7337-03e8-4e52-ab5a-d30dc53a64da req-78f64698-f2a8-4a10-8233-242a68631be5 service nova] [c7a12c81-ef87-493b-8488-17a424001478] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 20:04:24.717600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-97201d22-aad2-4053-bc61-78048cba2a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:24.718173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-97201d22-aad2-4053-bc61-78048cba2a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:24.724868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97201d22-aad2-4053-bc61-78048cba2a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:24.725562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97201d22-aad2-4053-bc61-78048cba2a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:24.726519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97201d22-aad2-4053-bc61-78048cba2a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:24.727126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97201d22-aad2-4053-bc61-78048cba2a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:24.792004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97201d22-aad2-4053-bc61-78048cba2a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:24.800492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-97201d22-aad2-4053-bc61-78048cba2a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086830 Apr 11 20:04:24.801123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 909/2037] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:25.178806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [req-6fae7337-03e8-4e52-ab5a-d30dc53a64da req-78f64698-f2a8-4a10-8233-242a68631be5 service nova] [c7a12c81-ef87-493b-8488-17a424001478] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 35274. Apr 11 20:04:25.182555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-6fae7337-03e8-4e52-ab5a-d30dc53a64da req-78f64698-f2a8-4a10-8233-242a68631be5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.168373 Apr 11 20:04:25.183509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1129/2038] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:04:25.820632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43f72820-fb59-47bc-8411-f93c0b4fa33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:25.821680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43f72820-fb59-47bc-8411-f93c0b4fa33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:25.831378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43f72820-fb59-47bc-8411-f93c0b4fa33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:25.831827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43f72820-fb59-47bc-8411-f93c0b4fa33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:25.832589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43f72820-fb59-47bc-8411-f93c0b4fa33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:25.833057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43f72820-fb59-47bc-8411-f93c0b4fa33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:25.894061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43f72820-fb59-47bc-8411-f93c0b4fa33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:25.904196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43f72820-fb59-47bc-8411-f93c0b4fa33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089389 Apr 11 20:04:25.905083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 910/2039] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:26.931756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26590ba8-0618-444c-9052-ce31c4c96ca7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:26.932890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-26590ba8-0618-444c-9052-ce31c4c96ca7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:26.941627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26590ba8-0618-444c-9052-ce31c4c96ca7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:26.942064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26590ba8-0618-444c-9052-ce31c4c96ca7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:26.942786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26590ba8-0618-444c-9052-ce31c4c96ca7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:26.943234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26590ba8-0618-444c-9052-ce31c4c96ca7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:27.010968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-26590ba8-0618-444c-9052-ce31c4c96ca7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:27.024206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26590ba8-0618-444c-9052-ce31c4c96ca7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099801 Apr 11 20:04:27.024993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1130/2040] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:27.587417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:04:27.587417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:04:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:04:28.043841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc6ff409-96c5-4782-9016-e9534b1e1822 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:28.044516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc6ff409-96c5-4782-9016-e9534b1e1822 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:28.052076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc6ff409-96c5-4782-9016-e9534b1e1822 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:28.052525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc6ff409-96c5-4782-9016-e9534b1e1822 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:28.053326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc6ff409-96c5-4782-9016-e9534b1e1822 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:28.053758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc6ff409-96c5-4782-9016-e9534b1e1822 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:28.118964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc6ff409-96c5-4782-9016-e9534b1e1822 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:28.127890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc6ff409-96c5-4782-9016-e9534b1e1822 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087917 Apr 11 20:04:28.128474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 911/2041] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:29.145272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66c02fc4-d8d5-467e-9708-196f8ef82a35 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:29.145857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66c02fc4-d8d5-467e-9708-196f8ef82a35 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:29.152469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66c02fc4-d8d5-467e-9708-196f8ef82a35 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:29.152935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66c02fc4-d8d5-467e-9708-196f8ef82a35 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:29.153704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66c02fc4-d8d5-467e-9708-196f8ef82a35 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:29.154140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66c02fc4-d8d5-467e-9708-196f8ef82a35 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:29.223448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-66c02fc4-d8d5-467e-9708-196f8ef82a35 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:29.233618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66c02fc4-d8d5-467e-9708-196f8ef82a35 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091914 Apr 11 20:04:29.234208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1131/2042] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:30.252648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f3b1656-f5c7-4635-8be5-1349da4f91ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:30.253435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f3b1656-f5c7-4635-8be5-1349da4f91ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:30.259414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f3b1656-f5c7-4635-8be5-1349da4f91ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:30.259858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f3b1656-f5c7-4635-8be5-1349da4f91ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:30.260633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f3b1656-f5c7-4635-8be5-1349da4f91ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:30.261106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f3b1656-f5c7-4635-8be5-1349da4f91ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:30.322212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f3b1656-f5c7-4635-8be5-1349da4f91ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:30.330795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f3b1656-f5c7-4635-8be5-1349da4f91ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082511 Apr 11 20:04:30.331357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 912/2043] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:31.349441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d7d545d3-3b0b-40af-8488-2d26408f107e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:31.350050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d7d545d3-3b0b-40af-8488-2d26408f107e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:31.356496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7d545d3-3b0b-40af-8488-2d26408f107e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:31.356993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7d545d3-3b0b-40af-8488-2d26408f107e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:31.357741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7d545d3-3b0b-40af-8488-2d26408f107e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:31.358163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7d545d3-3b0b-40af-8488-2d26408f107e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:31.421006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d7d545d3-3b0b-40af-8488-2d26408f107e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:31.429181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d7d545d3-3b0b-40af-8488-2d26408f107e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083623 Apr 11 20:04:31.429741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1132/2044] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:32.446577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e35b7a3-4568-494b-8380-be741b087c8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:32.447150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e35b7a3-4568-494b-8380-be741b087c8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:32.454179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e35b7a3-4568-494b-8380-be741b087c8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:32.454637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e35b7a3-4568-494b-8380-be741b087c8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:32.455412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e35b7a3-4568-494b-8380-be741b087c8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:32.455845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e35b7a3-4568-494b-8380-be741b087c8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:32.516882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e35b7a3-4568-494b-8380-be741b087c8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:32.525050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e35b7a3-4568-494b-8380-be741b087c8e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082644 Apr 11 20:04:32.525601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 913/2045] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:33.542788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-87e1e9ea-fb6f-4568-bdd6-ea040a84e2ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:33.544706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-87e1e9ea-fb6f-4568-bdd6-ea040a84e2ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:33.552433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87e1e9ea-fb6f-4568-bdd6-ea040a84e2ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:33.552922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87e1e9ea-fb6f-4568-bdd6-ea040a84e2ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:33.553707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87e1e9ea-fb6f-4568-bdd6-ea040a84e2ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:33.554133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87e1e9ea-fb6f-4568-bdd6-ea040a84e2ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:33.617945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-87e1e9ea-fb6f-4568-bdd6-ea040a84e2ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:33.626640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-87e1e9ea-fb6f-4568-bdd6-ea040a84e2ec tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088687 Apr 11 20:04:33.627214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1133/2046] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:34.644798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d644c2d8-7d0c-48b2-a592-95b7e894e036 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:34.645407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d644c2d8-7d0c-48b2-a592-95b7e894e036 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:34.653259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d644c2d8-7d0c-48b2-a592-95b7e894e036 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:34.653259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d644c2d8-7d0c-48b2-a592-95b7e894e036 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:34.653524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d644c2d8-7d0c-48b2-a592-95b7e894e036 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:34.653887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d644c2d8-7d0c-48b2-a592-95b7e894e036 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:34.715333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d644c2d8-7d0c-48b2-a592-95b7e894e036 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:34.723822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d644c2d8-7d0c-48b2-a592-95b7e894e036 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083067 Apr 11 20:04:34.724392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 914/2047] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:35.741427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e33722c-3918-4283-852a-66060b5c73fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:35.742004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e33722c-3918-4283-852a-66060b5c73fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:35.748608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e33722c-3918-4283-852a-66060b5c73fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:35.749401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e33722c-3918-4283-852a-66060b5c73fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:35.750168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e33722c-3918-4283-852a-66060b5c73fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:35.750648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e33722c-3918-4283-852a-66060b5c73fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:35.811118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e33722c-3918-4283-852a-66060b5c73fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:35.819463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e33722c-3918-4283-852a-66060b5c73fd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082121 Apr 11 20:04:35.820025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1134/2048] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:36.836382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9313a39f-7333-471b-8e42-8b38a2def575 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:36.836992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9313a39f-7333-471b-8e42-8b38a2def575 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:36.843926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9313a39f-7333-471b-8e42-8b38a2def575 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:36.844348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9313a39f-7333-471b-8e42-8b38a2def575 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:36.845288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9313a39f-7333-471b-8e42-8b38a2def575 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:36.845719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9313a39f-7333-471b-8e42-8b38a2def575 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:36.906892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9313a39f-7333-471b-8e42-8b38a2def575 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:36.915210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9313a39f-7333-471b-8e42-8b38a2def575 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082790 Apr 11 20:04:36.915775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 915/2049] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:37.933572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-40f21686-9daa-4441-be3b-47b6e9fc9bad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:37.934272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-40f21686-9daa-4441-be3b-47b6e9fc9bad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:37.941252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40f21686-9daa-4441-be3b-47b6e9fc9bad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:37.941670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40f21686-9daa-4441-be3b-47b6e9fc9bad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:37.942418 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40f21686-9daa-4441-be3b-47b6e9fc9bad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:37.942845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40f21686-9daa-4441-be3b-47b6e9fc9bad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:38.002772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-40f21686-9daa-4441-be3b-47b6e9fc9bad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:38.010944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-40f21686-9daa-4441-be3b-47b6e9fc9bad tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081245 Apr 11 20:04:38.011503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1135/2050] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:39.030206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a8982231-8617-4d17-8f1a-ac6020d6f0b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:39.030806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a8982231-8617-4d17-8f1a-ac6020d6f0b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:39.037852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8982231-8617-4d17-8f1a-ac6020d6f0b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:39.038292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8982231-8617-4d17-8f1a-ac6020d6f0b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:39.039046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8982231-8617-4d17-8f1a-ac6020d6f0b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:39.039484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8982231-8617-4d17-8f1a-ac6020d6f0b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:39.105128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a8982231-8617-4d17-8f1a-ac6020d6f0b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:39.114777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a8982231-8617-4d17-8f1a-ac6020d6f0b7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089163 Apr 11 20:04:39.115364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 916/2051] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:40.132937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3eff99ef-d969-447e-9b64-351274614f4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:40.133564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3eff99ef-d969-447e-9b64-351274614f4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:40.140250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3eff99ef-d969-447e-9b64-351274614f4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:40.140692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3eff99ef-d969-447e-9b64-351274614f4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:40.141578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3eff99ef-d969-447e-9b64-351274614f4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:40.141997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3eff99ef-d969-447e-9b64-351274614f4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:40.204127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3eff99ef-d969-447e-9b64-351274614f4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:40.212269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3eff99ef-d969-447e-9b64-351274614f4e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083212 Apr 11 20:04:40.212820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1136/2052] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:41.229371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-44e7cc71-a510-4ff6-9968-aabe308c344c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:41.229944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-44e7cc71-a510-4ff6-9968-aabe308c344c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:41.236679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e7cc71-a510-4ff6-9968-aabe308c344c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:41.237198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e7cc71-a510-4ff6-9968-aabe308c344c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:41.237927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e7cc71-a510-4ff6-9968-aabe308c344c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:41.238361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e7cc71-a510-4ff6-9968-aabe308c344c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:41.300167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44e7cc71-a510-4ff6-9968-aabe308c344c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:41.308468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-44e7cc71-a510-4ff6-9968-aabe308c344c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083009 Apr 11 20:04:41.309402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 917/2053] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:42.325719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a55b96c-c2e7-4e8d-8880-c4044aebb97b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:42.326429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a55b96c-c2e7-4e8d-8880-c4044aebb97b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:42.333318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a55b96c-c2e7-4e8d-8880-c4044aebb97b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:42.333767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a55b96c-c2e7-4e8d-8880-c4044aebb97b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:42.334534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a55b96c-c2e7-4e8d-8880-c4044aebb97b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:42.334965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a55b96c-c2e7-4e8d-8880-c4044aebb97b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:42.400018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a55b96c-c2e7-4e8d-8880-c4044aebb97b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:42.409274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a55b96c-c2e7-4e8d-8880-c4044aebb97b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087295 Apr 11 20:04:42.409863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1137/2054] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:43.426826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-35c5643d-0a5c-4f77-89e1-03fc0c0adb34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:43.427453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-35c5643d-0a5c-4f77-89e1-03fc0c0adb34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:43.434129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35c5643d-0a5c-4f77-89e1-03fc0c0adb34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:43.434571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35c5643d-0a5c-4f77-89e1-03fc0c0adb34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:43.435326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35c5643d-0a5c-4f77-89e1-03fc0c0adb34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:43.435752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35c5643d-0a5c-4f77-89e1-03fc0c0adb34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:43.499254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-35c5643d-0a5c-4f77-89e1-03fc0c0adb34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:43.507793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-35c5643d-0a5c-4f77-89e1-03fc0c0adb34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084876 Apr 11 20:04:43.508376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 918/2055] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:44.525106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0923241d-dce7-483e-ab8f-92a2b6ac945c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:44.525703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0923241d-dce7-483e-ab8f-92a2b6ac945c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:44.532276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0923241d-dce7-483e-ab8f-92a2b6ac945c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:44.532729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0923241d-dce7-483e-ab8f-92a2b6ac945c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:44.533550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0923241d-dce7-483e-ab8f-92a2b6ac945c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:44.533965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0923241d-dce7-483e-ab8f-92a2b6ac945c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:44.595079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0923241d-dce7-483e-ab8f-92a2b6ac945c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:44.603114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0923241d-dce7-483e-ab8f-92a2b6ac945c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082033 Apr 11 20:04:44.603689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1138/2056] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:45.620486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4781851f-0488-48f2-99e4-49610a19c69f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:45.621061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4781851f-0488-48f2-99e4-49610a19c69f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:45.627859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4781851f-0488-48f2-99e4-49610a19c69f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:45.628312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4781851f-0488-48f2-99e4-49610a19c69f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:45.629114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4781851f-0488-48f2-99e4-49610a19c69f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:45.629542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4781851f-0488-48f2-99e4-49610a19c69f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:45.690512 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4781851f-0488-48f2-99e4-49610a19c69f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:45.698858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4781851f-0488-48f2-99e4-49610a19c69f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082381 Apr 11 20:04:45.699430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 919/2057] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:46.716202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ccad192b-9cf3-41e9-aab0-da1dccd2e56c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:46.716861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ccad192b-9cf3-41e9-aab0-da1dccd2e56c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:46.723662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccad192b-9cf3-41e9-aab0-da1dccd2e56c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:46.724085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccad192b-9cf3-41e9-aab0-da1dccd2e56c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:46.724836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccad192b-9cf3-41e9-aab0-da1dccd2e56c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:46.725297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccad192b-9cf3-41e9-aab0-da1dccd2e56c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:46.785188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ccad192b-9cf3-41e9-aab0-da1dccd2e56c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:46.793581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ccad192b-9cf3-41e9-aab0-da1dccd2e56c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081406 Apr 11 20:04:46.794132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1139/2058] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:47.811233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-86e8690f-310a-4097-a23b-cfd2621e4c52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:47.811825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-86e8690f-310a-4097-a23b-cfd2621e4c52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:47.821486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86e8690f-310a-4097-a23b-cfd2621e4c52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:47.821931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86e8690f-310a-4097-a23b-cfd2621e4c52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:47.822748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86e8690f-310a-4097-a23b-cfd2621e4c52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:47.823181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86e8690f-310a-4097-a23b-cfd2621e4c52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:47.886887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-86e8690f-310a-4097-a23b-cfd2621e4c52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:47.895115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-86e8690f-310a-4097-a23b-cfd2621e4c52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087860 Apr 11 20:04:47.895692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 920/2059] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:48.911883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-98302669-e391-438a-92a5-c172a814f974 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:48.912504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-98302669-e391-438a-92a5-c172a814f974 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:48.919289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98302669-e391-438a-92a5-c172a814f974 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:48.919738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98302669-e391-438a-92a5-c172a814f974 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:48.920496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98302669-e391-438a-92a5-c172a814f974 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:48.920937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98302669-e391-438a-92a5-c172a814f974 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:48.982543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-98302669-e391-438a-92a5-c172a814f974 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:48.990698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-98302669-e391-438a-92a5-c172a814f974 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082695 Apr 11 20:04:48.991267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1140/2060] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:50.008258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0a4d3c7c-f403-42f0-8613-3dc40f035fcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:50.008887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0a4d3c7c-f403-42f0-8613-3dc40f035fcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:50.015685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a4d3c7c-f403-42f0-8613-3dc40f035fcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:50.016251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a4d3c7c-f403-42f0-8613-3dc40f035fcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:50.017046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a4d3c7c-f403-42f0-8613-3dc40f035fcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:50.017596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a4d3c7c-f403-42f0-8613-3dc40f035fcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:50.077537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a4d3c7c-f403-42f0-8613-3dc40f035fcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:50.085796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0a4d3c7c-f403-42f0-8613-3dc40f035fcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081581 Apr 11 20:04:50.086373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 921/2061] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:51.103564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6c2a398-c7dd-4a92-a67a-78e7452e2a68 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:51.104246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6c2a398-c7dd-4a92-a67a-78e7452e2a68 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:51.111063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6c2a398-c7dd-4a92-a67a-78e7452e2a68 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:51.111508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6c2a398-c7dd-4a92-a67a-78e7452e2a68 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:51.112282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6c2a398-c7dd-4a92-a67a-78e7452e2a68 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:51.112717 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6c2a398-c7dd-4a92-a67a-78e7452e2a68 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:51.173924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6c2a398-c7dd-4a92-a67a-78e7452e2a68 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:51.181988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6c2a398-c7dd-4a92-a67a-78e7452e2a68 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082393 Apr 11 20:04:51.182572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1141/2062] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:52.198553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-46df58d4-a22f-4a6e-a21e-dd10a140beba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:52.199117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-46df58d4-a22f-4a6e-a21e-dd10a140beba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:52.205848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46df58d4-a22f-4a6e-a21e-dd10a140beba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:52.206295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46df58d4-a22f-4a6e-a21e-dd10a140beba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:52.207055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46df58d4-a22f-4a6e-a21e-dd10a140beba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:52.207486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46df58d4-a22f-4a6e-a21e-dd10a140beba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:52.270467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-46df58d4-a22f-4a6e-a21e-dd10a140beba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:52.279084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-46df58d4-a22f-4a6e-a21e-dd10a140beba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084420 Apr 11 20:04:52.279634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 922/2063] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:53.296736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3cd2411b-b726-4e32-aed3-120f0b453ccc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:53.297359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3cd2411b-b726-4e32-aed3-120f0b453ccc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:53.303851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cd2411b-b726-4e32-aed3-120f0b453ccc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:53.304294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cd2411b-b726-4e32-aed3-120f0b453ccc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:53.305072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cd2411b-b726-4e32-aed3-120f0b453ccc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:53.305501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cd2411b-b726-4e32-aed3-120f0b453ccc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:53.568022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3cd2411b-b726-4e32-aed3-120f0b453ccc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:53.576175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3cd2411b-b726-4e32-aed3-120f0b453ccc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.283470 Apr 11 20:04:53.576739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1142/2064] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:54.593281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc399dd3-e84e-4886-9c3f-03fb1097b2b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:54.593862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc399dd3-e84e-4886-9c3f-03fb1097b2b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:54.600524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc399dd3-e84e-4886-9c3f-03fb1097b2b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:54.600992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc399dd3-e84e-4886-9c3f-03fb1097b2b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:54.601755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc399dd3-e84e-4886-9c3f-03fb1097b2b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:54.602185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc399dd3-e84e-4886-9c3f-03fb1097b2b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:54.664324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc399dd3-e84e-4886-9c3f-03fb1097b2b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:54.672243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc399dd3-e84e-4886-9c3f-03fb1097b2b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083060 Apr 11 20:04:54.672807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 923/2065] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:55.688799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-320e8308-75e8-48de-ba81-db4105a4a855 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:55.689442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-320e8308-75e8-48de-ba81-db4105a4a855 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:55.696177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-320e8308-75e8-48de-ba81-db4105a4a855 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:55.696623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-320e8308-75e8-48de-ba81-db4105a4a855 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:55.697414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-320e8308-75e8-48de-ba81-db4105a4a855 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:55.697836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-320e8308-75e8-48de-ba81-db4105a4a855 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:55.762113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-320e8308-75e8-48de-ba81-db4105a4a855 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:55.770676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-320e8308-75e8-48de-ba81-db4105a4a855 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085962 Apr 11 20:04:55.771221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1143/2066] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:56.787760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-466c9790-6bb2-4657-ac74-1a620d74477b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:56.788375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-466c9790-6bb2-4657-ac74-1a620d74477b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:56.795012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-466c9790-6bb2-4657-ac74-1a620d74477b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:56.795452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-466c9790-6bb2-4657-ac74-1a620d74477b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:56.796209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-466c9790-6bb2-4657-ac74-1a620d74477b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:56.796638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-466c9790-6bb2-4657-ac74-1a620d74477b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:56.857271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-466c9790-6bb2-4657-ac74-1a620d74477b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:56.865728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-466c9790-6bb2-4657-ac74-1a620d74477b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081786 Apr 11 20:04:56.866307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 924/2067] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:57.883507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48f633e9-3b62-4bd6-a674-5b0d32aa3193 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:57.884105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-48f633e9-3b62-4bd6-a674-5b0d32aa3193 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:57.891390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48f633e9-3b62-4bd6-a674-5b0d32aa3193 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:57.891837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48f633e9-3b62-4bd6-a674-5b0d32aa3193 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:57.892595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48f633e9-3b62-4bd6-a674-5b0d32aa3193 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:57.893059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48f633e9-3b62-4bd6-a674-5b0d32aa3193 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:57.955309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-48f633e9-3b62-4bd6-a674-5b0d32aa3193 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:57.963495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-48f633e9-3b62-4bd6-a674-5b0d32aa3193 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083849 Apr 11 20:04:57.964063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1144/2068] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:04:58.981730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3307a17d-cac8-4887-a417-29dd71cb3a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:04:58.982547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3307a17d-cac8-4887-a417-29dd71cb3a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:04:58.989404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3307a17d-cac8-4887-a417-29dd71cb3a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:58.989831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3307a17d-cac8-4887-a417-29dd71cb3a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:58.990597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3307a17d-cac8-4887-a417-29dd71cb3a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:04:58.991014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3307a17d-cac8-4887-a417-29dd71cb3a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:04:59.059237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3307a17d-cac8-4887-a417-29dd71cb3a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:04:59.068213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3307a17d-cac8-4887-a417-29dd71cb3a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090573 Apr 11 20:04:59.068899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 925/2069] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:04:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:00.085509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-480a3f83-cd3d-458e-92a7-ab91c51fcfd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:00.086141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-480a3f83-cd3d-458e-92a7-ab91c51fcfd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:00.092779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-480a3f83-cd3d-458e-92a7-ab91c51fcfd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:00.093251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-480a3f83-cd3d-458e-92a7-ab91c51fcfd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:00.094066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-480a3f83-cd3d-458e-92a7-ab91c51fcfd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:00.094492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-480a3f83-cd3d-458e-92a7-ab91c51fcfd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:00.155351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-480a3f83-cd3d-458e-92a7-ab91c51fcfd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:00.163883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-480a3f83-cd3d-458e-92a7-ab91c51fcfd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082354 Apr 11 20:05:00.164445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1145/2070] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:01.181037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ae15b9c-753f-46d3-a0f3-63ab5219daf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:01.181637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ae15b9c-753f-46d3-a0f3-63ab5219daf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:01.188397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ae15b9c-753f-46d3-a0f3-63ab5219daf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:01.188840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ae15b9c-753f-46d3-a0f3-63ab5219daf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:01.189961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ae15b9c-753f-46d3-a0f3-63ab5219daf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:01.190086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ae15b9c-753f-46d3-a0f3-63ab5219daf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:01.251270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1ae15b9c-753f-46d3-a0f3-63ab5219daf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:01.259700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ae15b9c-753f-46d3-a0f3-63ab5219daf3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082575 Apr 11 20:05:01.260287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 926/2071] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:02.277617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f95bb4a-9726-4458-b479-3ab3c04c7094 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:02.278250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f95bb4a-9726-4458-b479-3ab3c04c7094 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:02.285143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f95bb4a-9726-4458-b479-3ab3c04c7094 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:02.285592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f95bb4a-9726-4458-b479-3ab3c04c7094 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:02.286336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f95bb4a-9726-4458-b479-3ab3c04c7094 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:02.286762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f95bb4a-9726-4458-b479-3ab3c04c7094 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:02.347280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f95bb4a-9726-4458-b479-3ab3c04c7094 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:02.355680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f95bb4a-9726-4458-b479-3ab3c04c7094 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082250 Apr 11 20:05:02.356255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1146/2072] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:03.373032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c4586c6b-ce7e-4584-9812-e3f830a454cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:03.373997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c4586c6b-ce7e-4584-9812-e3f830a454cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:03.380541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4586c6b-ce7e-4584-9812-e3f830a454cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:03.381027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4586c6b-ce7e-4584-9812-e3f830a454cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:03.381791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4586c6b-ce7e-4584-9812-e3f830a454cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:03.382226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4586c6b-ce7e-4584-9812-e3f830a454cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:03.451150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c4586c6b-ce7e-4584-9812-e3f830a454cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:03.460756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c4586c6b-ce7e-4584-9812-e3f830a454cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091643 Apr 11 20:05:03.461490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 927/2073] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:04.487805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-98e996a5-d8f5-42b9-a7bb-0f2902b42d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:04.488463 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-98e996a5-d8f5-42b9-a7bb-0f2902b42d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:04.498079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98e996a5-d8f5-42b9-a7bb-0f2902b42d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:04.498498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98e996a5-d8f5-42b9-a7bb-0f2902b42d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:04.499508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98e996a5-d8f5-42b9-a7bb-0f2902b42d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:04.499935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98e996a5-d8f5-42b9-a7bb-0f2902b42d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:04.574546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-98e996a5-d8f5-42b9-a7bb-0f2902b42d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:04.583207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-98e996a5-d8f5-42b9-a7bb-0f2902b42d0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099804 Apr 11 20:05:04.583792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1147/2074] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:05.600613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6b2e6a26-a8ff-4d4d-adc9-8332ade96ee3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:05.601331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6b2e6a26-a8ff-4d4d-adc9-8332ade96ee3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:05.608202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b2e6a26-a8ff-4d4d-adc9-8332ade96ee3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:05.608653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b2e6a26-a8ff-4d4d-adc9-8332ade96ee3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:05.609497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b2e6a26-a8ff-4d4d-adc9-8332ade96ee3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:05.609946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b2e6a26-a8ff-4d4d-adc9-8332ade96ee3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:05.670934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6b2e6a26-a8ff-4d4d-adc9-8332ade96ee3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:05.679149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6b2e6a26-a8ff-4d4d-adc9-8332ade96ee3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082483 Apr 11 20:05:05.679725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 928/2075] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:06.696478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f3d2bf1-5b91-4637-88fa-03fe035966f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:06.697108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f3d2bf1-5b91-4637-88fa-03fe035966f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:06.703872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f3d2bf1-5b91-4637-88fa-03fe035966f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:06.704325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f3d2bf1-5b91-4637-88fa-03fe035966f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:06.705120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f3d2bf1-5b91-4637-88fa-03fe035966f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:06.705544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f3d2bf1-5b91-4637-88fa-03fe035966f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:06.768866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f3d2bf1-5b91-4637-88fa-03fe035966f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:06.777396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f3d2bf1-5b91-4637-88fa-03fe035966f4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084697 Apr 11 20:05:06.777988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1148/2076] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:07.795164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-935a1d9c-fbc4-4d22-9537-93808fbac665 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:07.795815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-935a1d9c-fbc4-4d22-9537-93808fbac665 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:07.802257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935a1d9c-fbc4-4d22-9537-93808fbac665 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:07.802712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935a1d9c-fbc4-4d22-9537-93808fbac665 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:07.803466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935a1d9c-fbc4-4d22-9537-93808fbac665 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:07.803895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935a1d9c-fbc4-4d22-9537-93808fbac665 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:07.871537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-935a1d9c-fbc4-4d22-9537-93808fbac665 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:07.880434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-935a1d9c-fbc4-4d22-9537-93808fbac665 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089190 Apr 11 20:05:07.881040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 929/2077] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:08.898609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07a074d3-5e9e-413d-84b5-fa8649c6bb91 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:08.899225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07a074d3-5e9e-413d-84b5-fa8649c6bb91 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:08.907573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07a074d3-5e9e-413d-84b5-fa8649c6bb91 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:08.908052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07a074d3-5e9e-413d-84b5-fa8649c6bb91 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:08.908777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07a074d3-5e9e-413d-84b5-fa8649c6bb91 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:08.909251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07a074d3-5e9e-413d-84b5-fa8649c6bb91 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:08.976949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07a074d3-5e9e-413d-84b5-fa8649c6bb91 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:08.986048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07a074d3-5e9e-413d-84b5-fa8649c6bb91 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091956 Apr 11 20:05:08.986634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1149/2078] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:10.007570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c85cfd94-31f1-4e61-8e56-ccbf860c3d15 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:10.008156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c85cfd94-31f1-4e61-8e56-ccbf860c3d15 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:10.017248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c85cfd94-31f1-4e61-8e56-ccbf860c3d15 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:10.017689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c85cfd94-31f1-4e61-8e56-ccbf860c3d15 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:10.018444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c85cfd94-31f1-4e61-8e56-ccbf860c3d15 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:10.018869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c85cfd94-31f1-4e61-8e56-ccbf860c3d15 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:10.085154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c85cfd94-31f1-4e61-8e56-ccbf860c3d15 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:10.093486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c85cfd94-31f1-4e61-8e56-ccbf860c3d15 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092318 Apr 11 20:05:10.094119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 930/2079] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:11.111091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-710b0ca7-d381-404b-8388-9e5513dd0909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:11.111664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-710b0ca7-d381-404b-8388-9e5513dd0909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:11.118611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-710b0ca7-d381-404b-8388-9e5513dd0909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:11.119051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-710b0ca7-d381-404b-8388-9e5513dd0909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:11.119806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-710b0ca7-d381-404b-8388-9e5513dd0909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:11.120229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-710b0ca7-d381-404b-8388-9e5513dd0909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:11.211724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-710b0ca7-d381-404b-8388-9e5513dd0909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:11.222101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-710b0ca7-d381-404b-8388-9e5513dd0909 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.115092 Apr 11 20:05:11.222703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1150/2080] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:12.240188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d86ed282-d665-4397-84e4-7836ebf577dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:12.240764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d86ed282-d665-4397-84e4-7836ebf577dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:12.247685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86ed282-d665-4397-84e4-7836ebf577dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:12.248139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86ed282-d665-4397-84e4-7836ebf577dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:12.249250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86ed282-d665-4397-84e4-7836ebf577dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:12.249689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86ed282-d665-4397-84e4-7836ebf577dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:12.315935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d86ed282-d665-4397-84e4-7836ebf577dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:12.323998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d86ed282-d665-4397-84e4-7836ebf577dd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087780 Apr 11 20:05:12.324561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 931/2081] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:13.342407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d2201cf-0c73-4186-98fd-b0bfba45f0ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:13.343011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d2201cf-0c73-4186-98fd-b0bfba45f0ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:13.349772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d2201cf-0c73-4186-98fd-b0bfba45f0ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:13.350222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d2201cf-0c73-4186-98fd-b0bfba45f0ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:13.350980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d2201cf-0c73-4186-98fd-b0bfba45f0ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:13.351410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d2201cf-0c73-4186-98fd-b0bfba45f0ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:13.567258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d2201cf-0c73-4186-98fd-b0bfba45f0ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:13.575245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d2201cf-0c73-4186-98fd-b0bfba45f0ab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.236817 Apr 11 20:05:13.575808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1151/2082] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:14.593662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e7d9891c-d5a7-4f26-9df7-c7b41dc66bd6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:14.594255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e7d9891c-d5a7-4f26-9df7-c7b41dc66bd6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:14.600783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7d9891c-d5a7-4f26-9df7-c7b41dc66bd6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:14.601251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7d9891c-d5a7-4f26-9df7-c7b41dc66bd6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:14.602139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7d9891c-d5a7-4f26-9df7-c7b41dc66bd6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:14.602564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7d9891c-d5a7-4f26-9df7-c7b41dc66bd6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:14.667098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7d9891c-d5a7-4f26-9df7-c7b41dc66bd6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:14.676094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e7d9891c-d5a7-4f26-9df7-c7b41dc66bd6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086545 Apr 11 20:05:14.676678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 932/2083] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:15.697383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-32d41990-eb60-4b1e-85bb-173f5c9fc602 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:15.698408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-32d41990-eb60-4b1e-85bb-173f5c9fc602 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:15.709087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32d41990-eb60-4b1e-85bb-173f5c9fc602 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:15.709840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32d41990-eb60-4b1e-85bb-173f5c9fc602 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:15.711140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32d41990-eb60-4b1e-85bb-173f5c9fc602 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:15.711866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32d41990-eb60-4b1e-85bb-173f5c9fc602 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:15.775863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-32d41990-eb60-4b1e-85bb-173f5c9fc602 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:15.784155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-32d41990-eb60-4b1e-85bb-173f5c9fc602 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093301 Apr 11 20:05:15.784708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1152/2084] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:16.806349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-781d8af1-5f50-4fb9-8876-0c954a8f0fab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:16.806940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-781d8af1-5f50-4fb9-8876-0c954a8f0fab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:16.813666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-781d8af1-5f50-4fb9-8876-0c954a8f0fab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:16.814120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-781d8af1-5f50-4fb9-8876-0c954a8f0fab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:16.814875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-781d8af1-5f50-4fb9-8876-0c954a8f0fab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:16.815306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-781d8af1-5f50-4fb9-8876-0c954a8f0fab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:16.876312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-781d8af1-5f50-4fb9-8876-0c954a8f0fab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:16.884882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-781d8af1-5f50-4fb9-8876-0c954a8f0fab tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082728 Apr 11 20:05:16.885493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 933/2085] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:17.906859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b3ca53ec-a9b4-45eb-9ae2-a5c01afd7f88 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:17.907672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b3ca53ec-a9b4-45eb-9ae2-a5c01afd7f88 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:17.916567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3ca53ec-a9b4-45eb-9ae2-a5c01afd7f88 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:17.917221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3ca53ec-a9b4-45eb-9ae2-a5c01afd7f88 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:17.918233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3ca53ec-a9b4-45eb-9ae2-a5c01afd7f88 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:17.918860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3ca53ec-a9b4-45eb-9ae2-a5c01afd7f88 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:17.987218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b3ca53ec-a9b4-45eb-9ae2-a5c01afd7f88 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:17.999524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b3ca53ec-a9b4-45eb-9ae2-a5c01afd7f88 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.098956 Apr 11 20:05:18.000380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1153/2086] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:19.017237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cc050f75-ff0e-4c94-b9ab-1e4e994e6686 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:19.017888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc050f75-ff0e-4c94-b9ab-1e4e994e6686 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:19.024618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc050f75-ff0e-4c94-b9ab-1e4e994e6686 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:19.025095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc050f75-ff0e-4c94-b9ab-1e4e994e6686 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:19.025864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc050f75-ff0e-4c94-b9ab-1e4e994e6686 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:19.026294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc050f75-ff0e-4c94-b9ab-1e4e994e6686 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:19.092347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc050f75-ff0e-4c94-b9ab-1e4e994e6686 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:19.100927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cc050f75-ff0e-4c94-b9ab-1e4e994e6686 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087729 Apr 11 20:05:19.101510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 934/2087] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:20.120666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-706ea5db-ba05-4c6d-82f2-85699922f75d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:20.121717 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-706ea5db-ba05-4c6d-82f2-85699922f75d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:20.129868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-706ea5db-ba05-4c6d-82f2-85699922f75d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:20.130310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-706ea5db-ba05-4c6d-82f2-85699922f75d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:20.131066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-706ea5db-ba05-4c6d-82f2-85699922f75d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:20.131490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-706ea5db-ba05-4c6d-82f2-85699922f75d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:20.204919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-706ea5db-ba05-4c6d-82f2-85699922f75d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:20.213731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-706ea5db-ba05-4c6d-82f2-85699922f75d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099305 Apr 11 20:05:20.214300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1154/2088] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:21.231753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4d4676fb-f604-4cd1-8062-12d667bfac62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:21.232384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4d4676fb-f604-4cd1-8062-12d667bfac62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:21.239457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d4676fb-f604-4cd1-8062-12d667bfac62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:21.239907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d4676fb-f604-4cd1-8062-12d667bfac62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:21.240758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d4676fb-f604-4cd1-8062-12d667bfac62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:21.241250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d4676fb-f604-4cd1-8062-12d667bfac62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:21.304162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4d4676fb-f604-4cd1-8062-12d667bfac62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:21.312308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4d4676fb-f604-4cd1-8062-12d667bfac62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084517 Apr 11 20:05:21.312873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 935/2089] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:22.332464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-706dd10d-44c4-44aa-939e-74320a9040d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:22.333105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-706dd10d-44c4-44aa-939e-74320a9040d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:22.340483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-706dd10d-44c4-44aa-939e-74320a9040d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:22.340930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-706dd10d-44c4-44aa-939e-74320a9040d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:22.341804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-706dd10d-44c4-44aa-939e-74320a9040d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:22.342255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-706dd10d-44c4-44aa-939e-74320a9040d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:22.403303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-706dd10d-44c4-44aa-939e-74320a9040d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:22.411764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-706dd10d-44c4-44aa-939e-74320a9040d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084373 Apr 11 20:05:22.412327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1155/2090] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:23.429033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5af46995-1713-4af5-a80f-9df6aba379c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:23.429646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5af46995-1713-4af5-a80f-9df6aba379c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:23.436698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5af46995-1713-4af5-a80f-9df6aba379c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:23.437171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5af46995-1713-4af5-a80f-9df6aba379c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:23.438025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5af46995-1713-4af5-a80f-9df6aba379c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:23.438452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5af46995-1713-4af5-a80f-9df6aba379c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:23.501367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5af46995-1713-4af5-a80f-9df6aba379c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:23.511401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5af46995-1713-4af5-a80f-9df6aba379c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086336 Apr 11 20:05:23.511970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 936/2091] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:24.528788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1edd141e-22b8-4aea-b3dd-8b6abf3d1450 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:24.529393 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1edd141e-22b8-4aea-b3dd-8b6abf3d1450 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:24.535516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1edd141e-22b8-4aea-b3dd-8b6abf3d1450 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:24.535964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1edd141e-22b8-4aea-b3dd-8b6abf3d1450 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:24.536721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1edd141e-22b8-4aea-b3dd-8b6abf3d1450 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:24.537178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1edd141e-22b8-4aea-b3dd-8b6abf3d1450 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:24.601374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1edd141e-22b8-4aea-b3dd-8b6abf3d1450 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:24.609499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1edd141e-22b8-4aea-b3dd-8b6abf3d1450 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084785 Apr 11 20:05:24.610106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1156/2092] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:25.627406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-631b47bd-4d45-4ed9-9377-60694eeaf6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:25.627977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-631b47bd-4d45-4ed9-9377-60694eeaf6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:25.634822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-631b47bd-4d45-4ed9-9377-60694eeaf6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:25.635271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-631b47bd-4d45-4ed9-9377-60694eeaf6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:25.636029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-631b47bd-4d45-4ed9-9377-60694eeaf6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:25.636458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-631b47bd-4d45-4ed9-9377-60694eeaf6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:25.697017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-631b47bd-4d45-4ed9-9377-60694eeaf6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:25.702998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:05:25.703201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 (ip 10.222.0.62) !!! Apr 11 20:05:25.706434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-631b47bd-4d45-4ed9-9377-60694eeaf6e6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083483 Apr 11 20:05:25.707713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 937/2093] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:26.724130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-704d8a30-658f-46a5-b7ea-742da83e8786 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:26.724740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-704d8a30-658f-46a5-b7ea-742da83e8786 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:26.731784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-704d8a30-658f-46a5-b7ea-742da83e8786 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:26.732226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-704d8a30-658f-46a5-b7ea-742da83e8786 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:26.733015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-704d8a30-658f-46a5-b7ea-742da83e8786 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:26.733442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-704d8a30-658f-46a5-b7ea-742da83e8786 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:26.794892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-704d8a30-658f-46a5-b7ea-742da83e8786 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:26.803055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-704d8a30-658f-46a5-b7ea-742da83e8786 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083000 Apr 11 20:05:26.803608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1157/2094] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:27.819964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-021fb3c0-9903-48fa-ba80-dfcbbdc90cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:27.820589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-021fb3c0-9903-48fa-ba80-dfcbbdc90cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:27.827419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-021fb3c0-9903-48fa-ba80-dfcbbdc90cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:27.827862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-021fb3c0-9903-48fa-ba80-dfcbbdc90cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:27.828646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-021fb3c0-9903-48fa-ba80-dfcbbdc90cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:27.829109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-021fb3c0-9903-48fa-ba80-dfcbbdc90cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:27.892434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-021fb3c0-9903-48fa-ba80-dfcbbdc90cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:27.900822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-021fb3c0-9903-48fa-ba80-dfcbbdc90cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084771 Apr 11 20:05:27.901438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 938/2095] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:28.919156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fbc58768-b6f3-454d-a0b7-30a3ec48f772 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:28.919723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fbc58768-b6f3-454d-a0b7-30a3ec48f772 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:28.926646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbc58768-b6f3-454d-a0b7-30a3ec48f772 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:28.927089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbc58768-b6f3-454d-a0b7-30a3ec48f772 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:28.927833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbc58768-b6f3-454d-a0b7-30a3ec48f772 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:28.928253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbc58768-b6f3-454d-a0b7-30a3ec48f772 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:28.991825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fbc58768-b6f3-454d-a0b7-30a3ec48f772 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:29.000055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fbc58768-b6f3-454d-a0b7-30a3ec48f772 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084842 Apr 11 20:05:29.000938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1158/2096] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:30.017541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4d0dbd72-c672-4b74-ad9a-ec6df7b3eae5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:30.018164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4d0dbd72-c672-4b74-ad9a-ec6df7b3eae5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:30.024799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d0dbd72-c672-4b74-ad9a-ec6df7b3eae5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:30.025280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d0dbd72-c672-4b74-ad9a-ec6df7b3eae5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:30.026063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d0dbd72-c672-4b74-ad9a-ec6df7b3eae5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:30.026475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d0dbd72-c672-4b74-ad9a-ec6df7b3eae5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:30.086987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4d0dbd72-c672-4b74-ad9a-ec6df7b3eae5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:30.095166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4d0dbd72-c672-4b74-ad9a-ec6df7b3eae5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081805 Apr 11 20:05:30.095731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 939/2097] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:31.114944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-21c99332-3e8d-41de-95bd-27af7c8b3578 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:31.115847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-21c99332-3e8d-41de-95bd-27af7c8b3578 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:31.125986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21c99332-3e8d-41de-95bd-27af7c8b3578 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:31.126609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21c99332-3e8d-41de-95bd-27af7c8b3578 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:31.127760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21c99332-3e8d-41de-95bd-27af7c8b3578 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:31.128338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21c99332-3e8d-41de-95bd-27af7c8b3578 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:31.194291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-21c99332-3e8d-41de-95bd-27af7c8b3578 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:31.202512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-21c99332-3e8d-41de-95bd-27af7c8b3578 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093539 Apr 11 20:05:31.203071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1159/2098] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:32.222101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c935720-604e-4ab4-8454-d1b1a67f772e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:32.222719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c935720-604e-4ab4-8454-d1b1a67f772e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:32.229650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c935720-604e-4ab4-8454-d1b1a67f772e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:32.230093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c935720-604e-4ab4-8454-d1b1a67f772e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:32.230887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c935720-604e-4ab4-8454-d1b1a67f772e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:32.231323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c935720-604e-4ab4-8454-d1b1a67f772e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:32.295466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c935720-604e-4ab4-8454-d1b1a67f772e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:32.304419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c935720-604e-4ab4-8454-d1b1a67f772e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087967 Apr 11 20:05:32.305003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 940/2099] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:33.324100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27cddbd9-8617-49b5-ab1a-125f4e0d3f36 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:33.324772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27cddbd9-8617-49b5-ab1a-125f4e0d3f36 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:33.331628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27cddbd9-8617-49b5-ab1a-125f4e0d3f36 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:33.332077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27cddbd9-8617-49b5-ab1a-125f4e0d3f36 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:33.332871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27cddbd9-8617-49b5-ab1a-125f4e0d3f36 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:33.333332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27cddbd9-8617-49b5-ab1a-125f4e0d3f36 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:33.401031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27cddbd9-8617-49b5-ab1a-125f4e0d3f36 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:33.409330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27cddbd9-8617-49b5-ab1a-125f4e0d3f36 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089137 Apr 11 20:05:33.409895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1160/2100] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:34.427314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e98f22bb-f2d6-41e9-acf1-496a652bdeb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:34.427963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e98f22bb-f2d6-41e9-acf1-496a652bdeb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:34.434786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e98f22bb-f2d6-41e9-acf1-496a652bdeb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:34.435243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e98f22bb-f2d6-41e9-acf1-496a652bdeb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:34.436016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e98f22bb-f2d6-41e9-acf1-496a652bdeb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:34.436445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e98f22bb-f2d6-41e9-acf1-496a652bdeb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:34.497391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e98f22bb-f2d6-41e9-acf1-496a652bdeb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:34.506416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e98f22bb-f2d6-41e9-acf1-496a652bdeb9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083095 Apr 11 20:05:34.507217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 941/2101] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:35.524238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09ab3d90-fae5-4f17-b1c6-cdfb41485eca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:35.524851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09ab3d90-fae5-4f17-b1c6-cdfb41485eca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:35.531756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09ab3d90-fae5-4f17-b1c6-cdfb41485eca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:35.532203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09ab3d90-fae5-4f17-b1c6-cdfb41485eca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:35.533103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09ab3d90-fae5-4f17-b1c6-cdfb41485eca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:35.533537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09ab3d90-fae5-4f17-b1c6-cdfb41485eca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:35.597094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09ab3d90-fae5-4f17-b1c6-cdfb41485eca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:35.605855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09ab3d90-fae5-4f17-b1c6-cdfb41485eca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085550 Apr 11 20:05:35.606462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1161/2102] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:36.624218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5d6003b7-8638-41e8-86a5-a4c263b0b5f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:36.624830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5d6003b7-8638-41e8-86a5-a4c263b0b5f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:36.631409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d6003b7-8638-41e8-86a5-a4c263b0b5f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:36.631869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d6003b7-8638-41e8-86a5-a4c263b0b5f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:36.632634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d6003b7-8638-41e8-86a5-a4c263b0b5f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:36.633108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d6003b7-8638-41e8-86a5-a4c263b0b5f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:36.694035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d6003b7-8638-41e8-86a5-a4c263b0b5f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:36.702189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5d6003b7-8638-41e8-86a5-a4c263b0b5f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082411 Apr 11 20:05:36.702764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 942/2103] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:37.719842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-367215b2-3316-4215-98d0-37d6b2ac542a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:37.720488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-367215b2-3316-4215-98d0-37d6b2ac542a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:37.727426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-367215b2-3316-4215-98d0-37d6b2ac542a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:37.727884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-367215b2-3316-4215-98d0-37d6b2ac542a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:37.728642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-367215b2-3316-4215-98d0-37d6b2ac542a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:37.729122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-367215b2-3316-4215-98d0-37d6b2ac542a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:37.793878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-367215b2-3316-4215-98d0-37d6b2ac542a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:37.802191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-367215b2-3316-4215-98d0-37d6b2ac542a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086316 Apr 11 20:05:37.802757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1162/2104] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:38.820016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-83b4718f-6fb0-4d7c-9222-24970ce08fdb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:38.820728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-83b4718f-6fb0-4d7c-9222-24970ce08fdb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:38.829846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83b4718f-6fb0-4d7c-9222-24970ce08fdb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:38.830379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83b4718f-6fb0-4d7c-9222-24970ce08fdb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:38.831167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83b4718f-6fb0-4d7c-9222-24970ce08fdb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:38.831629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83b4718f-6fb0-4d7c-9222-24970ce08fdb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:38.897888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-83b4718f-6fb0-4d7c-9222-24970ce08fdb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:38.907009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-83b4718f-6fb0-4d7c-9222-24970ce08fdb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091082 Apr 11 20:05:38.907612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 943/2105] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:39.926842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-994e7e06-037d-4df3-80d6-9bff9a23cdcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:39.927593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-994e7e06-037d-4df3-80d6-9bff9a23cdcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:39.934519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-994e7e06-037d-4df3-80d6-9bff9a23cdcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:39.935085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-994e7e06-037d-4df3-80d6-9bff9a23cdcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:39.935885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-994e7e06-037d-4df3-80d6-9bff9a23cdcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:39.936322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-994e7e06-037d-4df3-80d6-9bff9a23cdcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:40.009495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-994e7e06-037d-4df3-80d6-9bff9a23cdcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:40.018492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-994e7e06-037d-4df3-80d6-9bff9a23cdcc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096550 Apr 11 20:05:40.019060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1163/2106] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:41.037063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c803d63c-4ff2-4734-9f78-f9262b083d05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:41.037954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c803d63c-4ff2-4734-9f78-f9262b083d05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:41.046129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c803d63c-4ff2-4734-9f78-f9262b083d05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:41.046691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c803d63c-4ff2-4734-9f78-f9262b083d05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:41.047453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c803d63c-4ff2-4734-9f78-f9262b083d05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:41.047912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c803d63c-4ff2-4734-9f78-f9262b083d05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:41.116663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c803d63c-4ff2-4734-9f78-f9262b083d05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:41.125083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c803d63c-4ff2-4734-9f78-f9262b083d05 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092802 Apr 11 20:05:41.125610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 944/2107] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:42.142350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a15b841f-8e64-43ef-a781-553957db5fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:42.143046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a15b841f-8e64-43ef-a781-553957db5fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:42.149921 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a15b841f-8e64-43ef-a781-553957db5fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:42.150365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a15b841f-8e64-43ef-a781-553957db5fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:42.151136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a15b841f-8e64-43ef-a781-553957db5fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:42.151565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a15b841f-8e64-43ef-a781-553957db5fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:42.216830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a15b841f-8e64-43ef-a781-553957db5fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:42.225328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a15b841f-8e64-43ef-a781-553957db5fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086980 Apr 11 20:05:42.225878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1164/2108] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:43.243045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4646b7ad-6faa-4d17-aef7-b950f60e9cba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:43.243663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4646b7ad-6faa-4d17-aef7-b950f60e9cba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:43.250757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4646b7ad-6faa-4d17-aef7-b950f60e9cba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:43.251199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4646b7ad-6faa-4d17-aef7-b950f60e9cba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:43.251993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4646b7ad-6faa-4d17-aef7-b950f60e9cba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:43.252423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4646b7ad-6faa-4d17-aef7-b950f60e9cba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:43.314610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4646b7ad-6faa-4d17-aef7-b950f60e9cba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:43.323181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4646b7ad-6faa-4d17-aef7-b950f60e9cba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084152 Apr 11 20:05:43.323768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 945/2109] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:44.340371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5eb6cb8-80e7-4499-b53a-5b25f2b2d5a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:44.341049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5eb6cb8-80e7-4499-b53a-5b25f2b2d5a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:44.348051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eb6cb8-80e7-4499-b53a-5b25f2b2d5a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:44.348524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eb6cb8-80e7-4499-b53a-5b25f2b2d5a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:44.349414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eb6cb8-80e7-4499-b53a-5b25f2b2d5a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:44.349851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eb6cb8-80e7-4499-b53a-5b25f2b2d5a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:44.424553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5eb6cb8-80e7-4499-b53a-5b25f2b2d5a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:44.437051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5eb6cb8-80e7-4499-b53a-5b25f2b2d5a2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.100611 Apr 11 20:05:44.437978 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1165/2110] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:45.456590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5e6be667-9ec2-4807-9ad3-f1b317a31fa0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:45.457269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5e6be667-9ec2-4807-9ad3-f1b317a31fa0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:45.463885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e6be667-9ec2-4807-9ad3-f1b317a31fa0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:45.464330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e6be667-9ec2-4807-9ad3-f1b317a31fa0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:45.465172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e6be667-9ec2-4807-9ad3-f1b317a31fa0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:45.465593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e6be667-9ec2-4807-9ad3-f1b317a31fa0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:45.529663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5e6be667-9ec2-4807-9ad3-f1b317a31fa0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:45.538130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5e6be667-9ec2-4807-9ad3-f1b317a31fa0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085753 Apr 11 20:05:45.538710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 946/2111] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:46.558627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-79999d84-0d34-40e8-b907-3cde94b9a67e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:46.559204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-79999d84-0d34-40e8-b907-3cde94b9a67e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:46.567060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79999d84-0d34-40e8-b907-3cde94b9a67e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:46.567504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79999d84-0d34-40e8-b907-3cde94b9a67e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:46.568273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79999d84-0d34-40e8-b907-3cde94b9a67e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:46.568734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79999d84-0d34-40e8-b907-3cde94b9a67e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:46.635455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-79999d84-0d34-40e8-b907-3cde94b9a67e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:46.646625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-79999d84-0d34-40e8-b907-3cde94b9a67e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094698 Apr 11 20:05:46.647200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1166/2112] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:47.664398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8bc2e297-d418-4377-894d-af88912a17de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:47.665011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8bc2e297-d418-4377-894d-af88912a17de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:47.673400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bc2e297-d418-4377-894d-af88912a17de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:47.673905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bc2e297-d418-4377-894d-af88912a17de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:47.674852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bc2e297-d418-4377-894d-af88912a17de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:47.675277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bc2e297-d418-4377-894d-af88912a17de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:47.737864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8bc2e297-d418-4377-894d-af88912a17de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:47.746819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8bc2e297-d418-4377-894d-af88912a17de tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086673 Apr 11 20:05:47.747445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 947/2113] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:48.767702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-69706c35-6222-4bc3-b881-edda0b928e8d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:48.768379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-69706c35-6222-4bc3-b881-edda0b928e8d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:48.776588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69706c35-6222-4bc3-b881-edda0b928e8d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:48.777064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69706c35-6222-4bc3-b881-edda0b928e8d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:48.777832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69706c35-6222-4bc3-b881-edda0b928e8d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:48.778268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69706c35-6222-4bc3-b881-edda0b928e8d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:48.843180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-69706c35-6222-4bc3-b881-edda0b928e8d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:48.851640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-69706c35-6222-4bc3-b881-edda0b928e8d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090292 Apr 11 20:05:48.852349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1167/2114] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:49.874213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-29ad2d75-6fb8-44df-b3c1-fca530e4868f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:49.874885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-29ad2d75-6fb8-44df-b3c1-fca530e4868f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:49.881760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29ad2d75-6fb8-44df-b3c1-fca530e4868f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:49.882203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29ad2d75-6fb8-44df-b3c1-fca530e4868f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:49.882960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29ad2d75-6fb8-44df-b3c1-fca530e4868f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:49.883379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29ad2d75-6fb8-44df-b3c1-fca530e4868f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:49.954486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29ad2d75-6fb8-44df-b3c1-fca530e4868f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:49.965450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-29ad2d75-6fb8-44df-b3c1-fca530e4868f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095486 Apr 11 20:05:49.966031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 948/2115] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:50.983113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b98b44ba-4fa6-4f64-8249-6c60739bbb6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:50.983794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b98b44ba-4fa6-4f64-8249-6c60739bbb6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:50.990529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b98b44ba-4fa6-4f64-8249-6c60739bbb6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:50.991002 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b98b44ba-4fa6-4f64-8249-6c60739bbb6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:50.991830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b98b44ba-4fa6-4f64-8249-6c60739bbb6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:50.992275 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b98b44ba-4fa6-4f64-8249-6c60739bbb6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:51.058615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b98b44ba-4fa6-4f64-8249-6c60739bbb6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:51.067345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b98b44ba-4fa6-4f64-8249-6c60739bbb6c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088208 Apr 11 20:05:51.067947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1168/2116] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:52.085299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-184b6ed2-4af0-448c-83be-64566efae4b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:52.085901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-184b6ed2-4af0-448c-83be-64566efae4b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:52.093907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184b6ed2-4af0-448c-83be-64566efae4b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:52.094353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184b6ed2-4af0-448c-83be-64566efae4b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:52.095131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184b6ed2-4af0-448c-83be-64566efae4b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:52.095556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184b6ed2-4af0-448c-83be-64566efae4b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:52.162780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-184b6ed2-4af0-448c-83be-64566efae4b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:52.173327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-184b6ed2-4af0-448c-83be-64566efae4b6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091979 Apr 11 20:05:52.173925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 949/2117] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:53.191096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07581978-2569-4873-978d-887b31faedd1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:53.191685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07581978-2569-4873-978d-887b31faedd1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:53.198848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07581978-2569-4873-978d-887b31faedd1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:53.199406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07581978-2569-4873-978d-887b31faedd1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:53.200197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07581978-2569-4873-978d-887b31faedd1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:53.200619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07581978-2569-4873-978d-887b31faedd1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:53.263356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07581978-2569-4873-978d-887b31faedd1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:53.272197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07581978-2569-4873-978d-887b31faedd1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085389 Apr 11 20:05:53.272838 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1169/2118] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:54.289705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-31c9a8f7-c26e-4c8d-8514-5633290c65a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:54.290357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-31c9a8f7-c26e-4c8d-8514-5633290c65a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:54.297436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31c9a8f7-c26e-4c8d-8514-5633290c65a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:54.297885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31c9a8f7-c26e-4c8d-8514-5633290c65a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:54.298725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31c9a8f7-c26e-4c8d-8514-5633290c65a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:54.299152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31c9a8f7-c26e-4c8d-8514-5633290c65a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:54.365103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-31c9a8f7-c26e-4c8d-8514-5633290c65a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:54.374266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-31c9a8f7-c26e-4c8d-8514-5633290c65a6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088310 Apr 11 20:05:54.374878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 950/2119] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:55.392150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1b76dbd5-2649-4116-ab7b-10c4a9688bd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:55.392732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1b76dbd5-2649-4116-ab7b-10c4a9688bd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:55.399573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b76dbd5-2649-4116-ab7b-10c4a9688bd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:55.399944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b76dbd5-2649-4116-ab7b-10c4a9688bd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:55.400715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b76dbd5-2649-4116-ab7b-10c4a9688bd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:55.401193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b76dbd5-2649-4116-ab7b-10c4a9688bd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:55.467597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1b76dbd5-2649-4116-ab7b-10c4a9688bd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:55.478012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1b76dbd5-2649-4116-ab7b-10c4a9688bd4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089896 Apr 11 20:05:55.478764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1170/2120] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:56.501143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c564ea96-1106-45fb-8063-b7a44d4b72f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:56.501869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c564ea96-1106-45fb-8063-b7a44d4b72f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:56.508693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c564ea96-1106-45fb-8063-b7a44d4b72f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:56.509189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c564ea96-1106-45fb-8063-b7a44d4b72f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:56.509934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c564ea96-1106-45fb-8063-b7a44d4b72f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:56.510370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c564ea96-1106-45fb-8063-b7a44d4b72f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:56.574369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c564ea96-1106-45fb-8063-b7a44d4b72f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:56.586508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c564ea96-1106-45fb-8063-b7a44d4b72f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090564 Apr 11 20:05:56.587220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 951/2121] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:57.608225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5f40e016-3c93-4105-aa8c-35171670b966 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:57.609160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5f40e016-3c93-4105-aa8c-35171670b966 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:57.617093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f40e016-3c93-4105-aa8c-35171670b966 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:57.617512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f40e016-3c93-4105-aa8c-35171670b966 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:57.618267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f40e016-3c93-4105-aa8c-35171670b966 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:57.618696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f40e016-3c93-4105-aa8c-35171670b966 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:57.681119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5f40e016-3c93-4105-aa8c-35171670b966 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:57.689649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5f40e016-3c93-4105-aa8c-35171670b966 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088204 Apr 11 20:05:57.690221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1171/2122] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:58.710624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4f015f9-b0a2-4deb-bb29-c67d55f7deae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:58.711487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4f015f9-b0a2-4deb-bb29-c67d55f7deae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:58.721354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4f015f9-b0a2-4deb-bb29-c67d55f7deae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:58.721990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4f015f9-b0a2-4deb-bb29-c67d55f7deae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:58.723100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4f015f9-b0a2-4deb-bb29-c67d55f7deae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:58.723716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4f015f9-b0a2-4deb-bb29-c67d55f7deae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:58.785542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b4f015f9-b0a2-4deb-bb29-c67d55f7deae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:58.794081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4f015f9-b0a2-4deb-bb29-c67d55f7deae tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089463 Apr 11 20:05:58.794664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 952/2123] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:05:59.819599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fd3d3914-8ac7-476c-867a-54c7686ce237 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:05:59.820229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fd3d3914-8ac7-476c-867a-54c7686ce237 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:05:59.830006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd3d3914-8ac7-476c-867a-54c7686ce237 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:59.830589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd3d3914-8ac7-476c-867a-54c7686ce237 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:59.831572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd3d3914-8ac7-476c-867a-54c7686ce237 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:05:59.832126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd3d3914-8ac7-476c-867a-54c7686ce237 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:05:59.901310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fd3d3914-8ac7-476c-867a-54c7686ce237 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:05:59.913809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fd3d3914-8ac7-476c-867a-54c7686ce237 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.100202 Apr 11 20:05:59.914568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1172/2124] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:05:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:00.939823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-22005d1c-72e4-471e-8027-69229718b436 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:00.940819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-22005d1c-72e4-471e-8027-69229718b436 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:00.949877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22005d1c-72e4-471e-8027-69229718b436 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:00.950326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22005d1c-72e4-471e-8027-69229718b436 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:00.951089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22005d1c-72e4-471e-8027-69229718b436 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:00.951531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22005d1c-72e4-471e-8027-69229718b436 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:01.015235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-22005d1c-72e4-471e-8027-69229718b436 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:01.027989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-22005d1c-72e4-471e-8027-69229718b436 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094438 Apr 11 20:06:01.028846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 953/2125] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:02.049495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-796218d4-b42e-42f4-b6b0-2069fe8510ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:02.050444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-796218d4-b42e-42f4-b6b0-2069fe8510ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:02.059269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796218d4-b42e-42f4-b6b0-2069fe8510ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:02.059714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796218d4-b42e-42f4-b6b0-2069fe8510ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:02.060464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796218d4-b42e-42f4-b6b0-2069fe8510ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:02.060887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796218d4-b42e-42f4-b6b0-2069fe8510ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:02.122123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-796218d4-b42e-42f4-b6b0-2069fe8510ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:02.130439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-796218d4-b42e-42f4-b6b0-2069fe8510ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087485 Apr 11 20:06:02.131001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1173/2126] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:03.151040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4bdfd285-c85e-47ff-b6c3-2576e8407f32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:03.151971 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4bdfd285-c85e-47ff-b6c3-2576e8407f32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:03.160854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bdfd285-c85e-47ff-b6c3-2576e8407f32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:03.161336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bdfd285-c85e-47ff-b6c3-2576e8407f32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:03.162088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bdfd285-c85e-47ff-b6c3-2576e8407f32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:03.162522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bdfd285-c85e-47ff-b6c3-2576e8407f32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:03.225990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4bdfd285-c85e-47ff-b6c3-2576e8407f32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:03.234497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4bdfd285-c85e-47ff-b6c3-2576e8407f32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090152 Apr 11 20:06:03.235065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 954/2127] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:04.257437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e8c5ed69-d77b-45ee-84b8-3378c58a6b59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:04.258035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e8c5ed69-d77b-45ee-84b8-3378c58a6b59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:04.264687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8c5ed69-d77b-45ee-84b8-3378c58a6b59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:04.265163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8c5ed69-d77b-45ee-84b8-3378c58a6b59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:04.265915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8c5ed69-d77b-45ee-84b8-3378c58a6b59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:04.266344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8c5ed69-d77b-45ee-84b8-3378c58a6b59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:04.330514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e8c5ed69-d77b-45ee-84b8-3378c58a6b59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:04.338508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e8c5ed69-d77b-45ee-84b8-3378c58a6b59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085049 Apr 11 20:06:04.339073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1174/2128] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:04.648109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:06:04.648464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:06:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:06:05.359667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4b92057d-2366-4426-bf44-ad4a5642aa2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:05.360748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4b92057d-2366-4426-bf44-ad4a5642aa2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:05.371096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b92057d-2366-4426-bf44-ad4a5642aa2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:05.371824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b92057d-2366-4426-bf44-ad4a5642aa2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:05.373120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b92057d-2366-4426-bf44-ad4a5642aa2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:05.374231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b92057d-2366-4426-bf44-ad4a5642aa2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:05.442053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b92057d-2366-4426-bf44-ad4a5642aa2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:05.450602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4b92057d-2366-4426-bf44-ad4a5642aa2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097477 Apr 11 20:06:05.451172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 955/2129] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:06.471768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f58195c-abdf-470e-8c65-fb80875cc4a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:06.472768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f58195c-abdf-470e-8c65-fb80875cc4a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:06.483279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f58195c-abdf-470e-8c65-fb80875cc4a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:06.484013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f58195c-abdf-470e-8c65-fb80875cc4a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:06.485322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f58195c-abdf-470e-8c65-fb80875cc4a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:06.486037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f58195c-abdf-470e-8c65-fb80875cc4a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:06.552280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f58195c-abdf-470e-8c65-fb80875cc4a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:06.562911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f58195c-abdf-470e-8c65-fb80875cc4a5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097421 Apr 11 20:06:06.563713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1175/2130] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:07.579806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4a4a22d-0cb5-4f62-9e06-b616593d0402 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:07.580424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4a4a22d-0cb5-4f62-9e06-b616593d0402 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:07.587022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4a4a22d-0cb5-4f62-9e06-b616593d0402 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:07.587480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4a4a22d-0cb5-4f62-9e06-b616593d0402 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:07.588255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4a4a22d-0cb5-4f62-9e06-b616593d0402 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:07.588684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4a4a22d-0cb5-4f62-9e06-b616593d0402 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:07.651872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b4a4a22d-0cb5-4f62-9e06-b616593d0402 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:07.660028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4a4a22d-0cb5-4f62-9e06-b616593d0402 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084143 Apr 11 20:06:07.660752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 956/2131] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:07.719611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5e249a27-5e7a-44ba-b72d-5fb5174ace79 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:07.720164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5e249a27-5e7a-44ba-b72d-5fb5174ace79 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:07.726648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e249a27-5e7a-44ba-b72d-5fb5174ace79 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:07.727095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e249a27-5e7a-44ba-b72d-5fb5174ace79 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:07.727937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e249a27-5e7a-44ba-b72d-5fb5174ace79 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:07.728371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e249a27-5e7a-44ba-b72d-5fb5174ace79 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:07.754324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5e249a27-5e7a-44ba-b72d-5fb5174ace79 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:06:07.837066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5e249a27-5e7a-44ba-b72d-5fb5174ace79 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 204 len: 0 microversion: 2.20 time: 0.121013 Apr 11 20:06:07.837630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1176/2132] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Apr 11 20:06:07 2022] DELETE /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:06:07.846110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:07.846716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:07.852480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:07.853018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:07.853773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:07.854204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:07.990574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:07.999906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:08.001403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:08.002563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-849cea8f-99db-4c95-930f-847374cb5530 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.160482 Apr 11 20:06:08.003117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 957/2133] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:08.681656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b916ad5a-da73-4c17-91d9-41c144c21749 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:08.682353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b916ad5a-da73-4c17-91d9-41c144c21749 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:08.689082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b916ad5a-da73-4c17-91d9-41c144c21749 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:08.689527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b916ad5a-da73-4c17-91d9-41c144c21749 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:08.690286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b916ad5a-da73-4c17-91d9-41c144c21749 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:08.690716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b916ad5a-da73-4c17-91d9-41c144c21749 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:08.759572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b916ad5a-da73-4c17-91d9-41c144c21749 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:08.767567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b916ad5a-da73-4c17-91d9-41c144c21749 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092896 Apr 11 20:06:08.768122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1177/2134] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:09.026206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:09.027103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:09.037746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:09.038476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:09.039766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:09.040556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:09.179579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:09.190710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:09.193145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:09.194924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4de36e85-d166-4669-8f2d-a6f94b0e71d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.175193 Apr 11 20:06:09.195753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 958/2135] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:09.788729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-47012ce1-e6b5-421a-8583-84d9d0d56bc1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:09.789775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-47012ce1-e6b5-421a-8583-84d9d0d56bc1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:09.796827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47012ce1-e6b5-421a-8583-84d9d0d56bc1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:09.797308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47012ce1-e6b5-421a-8583-84d9d0d56bc1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:09.798081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47012ce1-e6b5-421a-8583-84d9d0d56bc1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:09.798507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47012ce1-e6b5-421a-8583-84d9d0d56bc1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:09.862679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47012ce1-e6b5-421a-8583-84d9d0d56bc1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:09.870801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-47012ce1-e6b5-421a-8583-84d9d0d56bc1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088387 Apr 11 20:06:09.871403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1178/2136] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:10.215652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:10.216268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:10.222930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:10.223369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:10.224121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:10.224547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:10.351445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:10.360475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:10.361986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:10.363131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-039628dd-2511-48e2-b860-685430f81055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.152228 Apr 11 20:06:10.363705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 959/2137] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:10.892173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-39a2ed9d-20c6-4f5e-87b7-5db4a39c8f77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:10.893209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-39a2ed9d-20c6-4f5e-87b7-5db4a39c8f77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:10.902587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39a2ed9d-20c6-4f5e-87b7-5db4a39c8f77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:10.903030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39a2ed9d-20c6-4f5e-87b7-5db4a39c8f77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:10.903779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39a2ed9d-20c6-4f5e-87b7-5db4a39c8f77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:10.904205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39a2ed9d-20c6-4f5e-87b7-5db4a39c8f77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:10.966181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-39a2ed9d-20c6-4f5e-87b7-5db4a39c8f77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:10.978678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-39a2ed9d-20c6-4f5e-87b7-5db4a39c8f77 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092659 Apr 11 20:06:10.979446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1179/2138] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:11.386188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:11.387252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:11.397748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:11.398482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:11.399748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:11.400428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:11.537256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:11.547147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:11.548600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:11.549831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a24ad36f-7e8f-4787-afa3-223e0155e0f5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170348 Apr 11 20:06:11.550385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 960/2139] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:12.000380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-836b353f-dd5d-4462-ab98-3da067e563e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:12.001015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-836b353f-dd5d-4462-ab98-3da067e563e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:12.007775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-836b353f-dd5d-4462-ab98-3da067e563e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:12.008221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-836b353f-dd5d-4462-ab98-3da067e563e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:12.009118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-836b353f-dd5d-4462-ab98-3da067e563e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:12.009552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-836b353f-dd5d-4462-ab98-3da067e563e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:12.081019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-836b353f-dd5d-4462-ab98-3da067e563e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:12.089270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-836b353f-dd5d-4462-ab98-3da067e563e1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093114 Apr 11 20:06:12.089865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1180/2140] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:12.572350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:12.573392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:12.583979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:12.584713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:12.586015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:12.586733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:12.713949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:12.722427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:12.723933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:12.725119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-13ab4ad4-d738-4619-a461-8f0d06b58cb6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159373 Apr 11 20:06:12.725687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 961/2141] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:13.110783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d629f6e-2c7a-45d0-8ea6-70aba0baa860 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:13.111801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6d629f6e-2c7a-45d0-8ea6-70aba0baa860 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:13.121087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d629f6e-2c7a-45d0-8ea6-70aba0baa860 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:13.121538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d629f6e-2c7a-45d0-8ea6-70aba0baa860 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:13.122304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d629f6e-2c7a-45d0-8ea6-70aba0baa860 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:13.122735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d629f6e-2c7a-45d0-8ea6-70aba0baa860 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:13.187527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6d629f6e-2c7a-45d0-8ea6-70aba0baa860 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:13.199031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6d629f6e-2c7a-45d0-8ea6-70aba0baa860 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094587 Apr 11 20:06:13.199769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1181/2142] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:13.747083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:13.747983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:13.758190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:13.759006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:13.759812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:13.760250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:13.898640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:13.907654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:13.909243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:13.910384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-de7ddfd4-3565-456f-a2da-039a66833542 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169528 Apr 11 20:06:13.911210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 962/2143] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:14.216657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a227556-aa69-4c7e-a391-32174cc6083a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:14.217625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a227556-aa69-4c7e-a391-32174cc6083a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:14.224499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a227556-aa69-4c7e-a391-32174cc6083a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:14.225064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a227556-aa69-4c7e-a391-32174cc6083a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:14.226022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a227556-aa69-4c7e-a391-32174cc6083a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:14.226453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a227556-aa69-4c7e-a391-32174cc6083a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:14.287911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a227556-aa69-4c7e-a391-32174cc6083a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:14.296001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a227556-aa69-4c7e-a391-32174cc6083a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083251 Apr 11 20:06:14.296559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1182/2144] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:14.930489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:14.931297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:14.938928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:14.939448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:14.940333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:14.940837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:15.078204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:15.090908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:15.093259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:15.095016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce3722c6-b058-46b4-9a80-54c54aa05347 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168879 Apr 11 20:06:15.095775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 963/2145] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:15.318929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-98ff8a5c-d975-4b27-8d67-d9cc369078d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:15.319539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-98ff8a5c-d975-4b27-8d67-d9cc369078d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:15.326606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98ff8a5c-d975-4b27-8d67-d9cc369078d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:15.327054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98ff8a5c-d975-4b27-8d67-d9cc369078d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:15.327811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98ff8a5c-d975-4b27-8d67-d9cc369078d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:15.328240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98ff8a5c-d975-4b27-8d67-d9cc369078d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:15.396133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-98ff8a5c-d975-4b27-8d67-d9cc369078d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:15.405794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-98ff8a5c-d975-4b27-8d67-d9cc369078d1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090992 Apr 11 20:06:15.406354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1183/2146] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:16.117843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:16.118707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:16.125831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:16.126276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:16.127025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:16.127446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:16.259960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:16.272707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:16.274883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:16.276046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df0eb640-e64d-4322-b989-1c5759ab2236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164804 Apr 11 20:06:16.276610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 964/2147] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:16.427864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-71f5ad93-c784-41f2-962c-e097914ec392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:16.428827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-71f5ad93-c784-41f2-962c-e097914ec392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:16.436321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71f5ad93-c784-41f2-962c-e097914ec392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:16.436768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71f5ad93-c784-41f2-962c-e097914ec392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:16.437563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71f5ad93-c784-41f2-962c-e097914ec392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:16.437994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71f5ad93-c784-41f2-962c-e097914ec392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:16.510736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-71f5ad93-c784-41f2-962c-e097914ec392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:16.520000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-71f5ad93-c784-41f2-962c-e097914ec392 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099132 Apr 11 20:06:16.520576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1184/2148] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:17.297442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:17.298440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:17.309067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:17.309854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:17.311108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:17.311828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:17.452787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:17.464617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:17.467190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:17.469134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd093332-1137-4d5c-a631-5b42ce51247f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.178112 Apr 11 20:06:17.470033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 965/2149] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:17.537239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3eaa0d2-ae83-4cd0-851a-83914aa009c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:17.537798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3eaa0d2-ae83-4cd0-851a-83914aa009c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:17.544928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3eaa0d2-ae83-4cd0-851a-83914aa009c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:17.545387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3eaa0d2-ae83-4cd0-851a-83914aa009c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:17.546136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3eaa0d2-ae83-4cd0-851a-83914aa009c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:17.546562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3eaa0d2-ae83-4cd0-851a-83914aa009c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:17.606605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3eaa0d2-ae83-4cd0-851a-83914aa009c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:17.614598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3eaa0d2-ae83-4cd0-851a-83914aa009c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081298 Apr 11 20:06:17.615178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1185/2150] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:18.492058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:18.492950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:18.500134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:18.500577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:18.501381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:18.501804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:18.632126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-86b4f338-e3b0-461b-b007-b7e80effead7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:18.632733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-86b4f338-e3b0-461b-b007-b7e80effead7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:18.637290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:18.639295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86b4f338-e3b0-461b-b007-b7e80effead7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:18.639752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86b4f338-e3b0-461b-b007-b7e80effead7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:18.640562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86b4f338-e3b0-461b-b007-b7e80effead7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:18.641689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86b4f338-e3b0-461b-b007-b7e80effead7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:18.645668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:18.647124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:18.648317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23541cca-b97b-4705-8798-34f2b6a0146f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162948 Apr 11 20:06:18.648944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 966/2151] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:18.707663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-86b4f338-e3b0-461b-b007-b7e80effead7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:18.715902 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-86b4f338-e3b0-461b-b007-b7e80effead7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087775 Apr 11 20:06:18.716466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1186/2152] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:19.667188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:19.667803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:19.674550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:19.675001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:19.675755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:19.676188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:19.733049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-793ea634-c236-4fe5-b777-724406ca536a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:19.733652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-793ea634-c236-4fe5-b777-724406ca536a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:19.740250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-793ea634-c236-4fe5-b777-724406ca536a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:19.740689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-793ea634-c236-4fe5-b777-724406ca536a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:19.741460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-793ea634-c236-4fe5-b777-724406ca536a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:19.741889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-793ea634-c236-4fe5-b777-724406ca536a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:19.804849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-793ea634-c236-4fe5-b777-724406ca536a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:19.813351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-793ea634-c236-4fe5-b777-724406ca536a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084105 Apr 11 20:06:19.813895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1187/2153] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:19.828876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:19.837206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:19.838879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:19.840048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0233df33-ffdd-4761-9319-ec8881388af1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.177060 Apr 11 20:06:19.840645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 967/2154] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:20.837137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2afda08-ed58-4b2e-bc35-ebde72387de9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:20.838084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2afda08-ed58-4b2e-bc35-ebde72387de9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:20.845794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2afda08-ed58-4b2e-bc35-ebde72387de9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:20.846260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2afda08-ed58-4b2e-bc35-ebde72387de9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:20.847042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2afda08-ed58-4b2e-bc35-ebde72387de9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:20.847488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2afda08-ed58-4b2e-bc35-ebde72387de9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:20.859244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:20.859990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:20.868565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:20.869160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:20.870414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:20.870935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:20.923976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c2afda08-ed58-4b2e-bc35-ebde72387de9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:20.932128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2afda08-ed58-4b2e-bc35-ebde72387de9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.101413 Apr 11 20:06:20.933144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1188/2155] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:21.017359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:21.030878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:21.033297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:21.035094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2b9f95fe-bb6a-48ca-8167-1c5eed6b6868 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179682 Apr 11 20:06:21.035874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 968/2156] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:21.951902 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8956f827-8ba3-436f-acf4-9b8af7e218ef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:21.952531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8956f827-8ba3-436f-acf4-9b8af7e218ef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:21.959444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8956f827-8ba3-436f-acf4-9b8af7e218ef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:21.959870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8956f827-8ba3-436f-acf4-9b8af7e218ef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:21.960645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8956f827-8ba3-436f-acf4-9b8af7e218ef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:21.961132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8956f827-8ba3-436f-acf4-9b8af7e218ef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:22.040028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8956f827-8ba3-436f-acf4-9b8af7e218ef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:22.048470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8956f827-8ba3-436f-acf4-9b8af7e218ef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.101113 Apr 11 20:06:22.049070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1189/2157] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:22.056090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:22.056705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:22.063361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:22.063807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:22.064564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:22.065041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:22.210778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:22.221002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:22.222486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:22.223667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-30da6d17-dc56-4155-ba3f-6afd32a7998a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171468 Apr 11 20:06:22.224245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 969/2158] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:23.070055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84e0e0f6-9cfb-42a1-88d2-86c3f1ce15d7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:23.071063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84e0e0f6-9cfb-42a1-88d2-86c3f1ce15d7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:23.081281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84e0e0f6-9cfb-42a1-88d2-86c3f1ce15d7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:23.082025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84e0e0f6-9cfb-42a1-88d2-86c3f1ce15d7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:23.083280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84e0e0f6-9cfb-42a1-88d2-86c3f1ce15d7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:23.084041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84e0e0f6-9cfb-42a1-88d2-86c3f1ce15d7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:23.147044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84e0e0f6-9cfb-42a1-88d2-86c3f1ce15d7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:23.155195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84e0e0f6-9cfb-42a1-88d2-86c3f1ce15d7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091843 Apr 11 20:06:23.155780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1190/2159] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:23.246792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:23.247392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:23.255878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:23.256338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:23.257127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:23.257556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:23.385686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:23.396877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:23.398813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:23.400383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba6a4d8f-c037-4907-9cb9-d966e89f5cc6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159636 Apr 11 20:06:23.401162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 970/2160] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:23.494075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:06:23.494348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:06:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:06:24.172373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95d4557a-a074-40fd-88c9-d4b8c47d16ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:24.173031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95d4557a-a074-40fd-88c9-d4b8c47d16ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:24.179811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95d4557a-a074-40fd-88c9-d4b8c47d16ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:24.180260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95d4557a-a074-40fd-88c9-d4b8c47d16ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:24.181085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95d4557a-a074-40fd-88c9-d4b8c47d16ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:24.181467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95d4557a-a074-40fd-88c9-d4b8c47d16ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:24.253992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95d4557a-a074-40fd-88c9-d4b8c47d16ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:24.262081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95d4557a-a074-40fd-88c9-d4b8c47d16ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093626 Apr 11 20:06:24.262984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1191/2161] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:24.429021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:24.429608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:24.437802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:24.438258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:24.439028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:24.439461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:24.576935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:24.585886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:24.587388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:24.588571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-27129a3c-bd89-4f92-8844-a2527d88d048 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165916 Apr 11 20:06:24.589161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 971/2162] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:25.282287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8a73e4bf-f497-4407-a4fd-e88d63fa1d50 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:25.283100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8a73e4bf-f497-4407-a4fd-e88d63fa1d50 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:25.291500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a73e4bf-f497-4407-a4fd-e88d63fa1d50 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:25.292062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a73e4bf-f497-4407-a4fd-e88d63fa1d50 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:25.293307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a73e4bf-f497-4407-a4fd-e88d63fa1d50 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:25.293842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a73e4bf-f497-4407-a4fd-e88d63fa1d50 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:25.358840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a73e4bf-f497-4407-a4fd-e88d63fa1d50 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:25.371236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8a73e4bf-f497-4407-a4fd-e88d63fa1d50 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094641 Apr 11 20:06:25.371976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1192/2163] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:25.611445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:25.612427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:25.623137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:25.624264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:25.625579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:25.626296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:25.760682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:25.769489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:25.770978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:25.772145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a12746f5-9122-436c-a9db-436506724704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.167629 Apr 11 20:06:25.772699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 972/2164] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:26.398371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fea97a02-e2c8-413e-bcf2-0b9feaae1ac3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:26.399197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fea97a02-e2c8-413e-bcf2-0b9feaae1ac3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:26.410413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fea97a02-e2c8-413e-bcf2-0b9feaae1ac3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:26.411150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fea97a02-e2c8-413e-bcf2-0b9feaae1ac3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:26.412427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fea97a02-e2c8-413e-bcf2-0b9feaae1ac3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:26.413222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fea97a02-e2c8-413e-bcf2-0b9feaae1ac3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:26.475824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fea97a02-e2c8-413e-bcf2-0b9feaae1ac3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:26.484249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fea97a02-e2c8-413e-bcf2-0b9feaae1ac3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092720 Apr 11 20:06:26.484827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1193/2165] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:26.794659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:26.795668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:26.806502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:26.807253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:26.808508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:26.809301 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:26.949076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:26.958555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:26.960029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:26.961214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ccdcb51-36a7-40f2-b3bd-1169c978a8d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.173132 Apr 11 20:06:26.961770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 973/2166] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:27.503313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c78368ab-9027-47e6-be4e-927efdf7a084 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:27.503914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c78368ab-9027-47e6-be4e-927efdf7a084 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:27.510849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c78368ab-9027-47e6-be4e-927efdf7a084 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:27.511291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c78368ab-9027-47e6-be4e-927efdf7a084 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:27.512073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c78368ab-9027-47e6-be4e-927efdf7a084 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:27.512508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c78368ab-9027-47e6-be4e-927efdf7a084 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:27.576024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c78368ab-9027-47e6-be4e-927efdf7a084 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:27.584310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c78368ab-9027-47e6-be4e-927efdf7a084 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084936 Apr 11 20:06:27.584882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1194/2167] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:27.979908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:27.980631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:27.987578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:27.988039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:27.988846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:27.989317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:28.128730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:28.141124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:28.143342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:28.145135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37d630a4-bc9d-4561-b48a-10de02fe7cf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168987 Apr 11 20:06:28.145929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 974/2168] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:28.605031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95398fe6-e46a-45a5-ae07-5cd8df4b0b34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:28.606131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95398fe6-e46a-45a5-ae07-5cd8df4b0b34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:28.613508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95398fe6-e46a-45a5-ae07-5cd8df4b0b34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:28.613984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95398fe6-e46a-45a5-ae07-5cd8df4b0b34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:28.614780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95398fe6-e46a-45a5-ae07-5cd8df4b0b34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:28.615227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95398fe6-e46a-45a5-ae07-5cd8df4b0b34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:28.677811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95398fe6-e46a-45a5-ae07-5cd8df4b0b34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:28.685931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95398fe6-e46a-45a5-ae07-5cd8df4b0b34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087305 Apr 11 20:06:28.686492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1195/2169] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:29.168275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:29.169191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:29.176846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:29.177333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:29.178106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:29.178539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:29.318923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:29.329889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:29.331356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:29.332590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53590568-fd9c-4765-be8a-8cabef817ca1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171098 Apr 11 20:06:29.333167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 975/2170] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:29.706325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0b8e843-1cfb-46ce-a340-288c567a529b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:29.707082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0b8e843-1cfb-46ce-a340-288c567a529b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:29.716781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0b8e843-1cfb-46ce-a340-288c567a529b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:29.717580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0b8e843-1cfb-46ce-a340-288c567a529b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:29.718362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0b8e843-1cfb-46ce-a340-288c567a529b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:29.718797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0b8e843-1cfb-46ce-a340-288c567a529b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:29.794530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d0b8e843-1cfb-46ce-a340-288c567a529b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:29.803378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0b8e843-1cfb-46ce-a340-288c567a529b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.103024 Apr 11 20:06:29.803991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1196/2171] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:30.354646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:30.355603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:30.366494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:30.367314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:30.368578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:30.369403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:30.529411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:30.538530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:30.540014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:30.541206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ade5e933-3ece-4014-ae0a-8540be7d4290 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.193202 Apr 11 20:06:30.541770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 976/2172] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:30.821203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-032c0c39-2a36-461e-abd0-4088eb328676 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:30.821781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-032c0c39-2a36-461e-abd0-4088eb328676 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:30.828790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-032c0c39-2a36-461e-abd0-4088eb328676 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:30.829259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-032c0c39-2a36-461e-abd0-4088eb328676 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:30.830003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-032c0c39-2a36-461e-abd0-4088eb328676 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:30.830431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-032c0c39-2a36-461e-abd0-4088eb328676 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:30.918425 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-032c0c39-2a36-461e-abd0-4088eb328676 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:30.927015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-032c0c39-2a36-461e-abd0-4088eb328676 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.110031 Apr 11 20:06:30.927593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1197/2173] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:31.563767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:31.564644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:31.575023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:31.575752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:31.577002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:31.577689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:31.727435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:31.736626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:31.738161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:31.739348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-59f57a5b-ce51-4b78-9519-8fdc557c1496 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.182263 Apr 11 20:06:31.739911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 977/2174] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:31.948252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0153133-7556-46f1-a8db-ed5e889348b2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:31.949341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0153133-7556-46f1-a8db-ed5e889348b2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:31.959993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0153133-7556-46f1-a8db-ed5e889348b2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:31.960719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0153133-7556-46f1-a8db-ed5e889348b2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:31.962037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0153133-7556-46f1-a8db-ed5e889348b2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:31.962749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0153133-7556-46f1-a8db-ed5e889348b2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:32.037881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d0153133-7556-46f1-a8db-ed5e889348b2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:32.049372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0153133-7556-46f1-a8db-ed5e889348b2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.107629 Apr 11 20:06:32.049931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1198/2175] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:32.765092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:32.766096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:32.776733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:32.777604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:32.778942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:32.779601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:32.911413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:32.920241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:32.921761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:32.922966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dc1b0bcb-70eb-4263-bee0-a38f9db8e532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164431 Apr 11 20:06:32.923522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 978/2176] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:33.070470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9e82437d-9760-4582-a14e-b4bc77538d06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:33.071308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9e82437d-9760-4582-a14e-b4bc77538d06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:33.080802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e82437d-9760-4582-a14e-b4bc77538d06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:33.081277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e82437d-9760-4582-a14e-b4bc77538d06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:33.082027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e82437d-9760-4582-a14e-b4bc77538d06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:33.082453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e82437d-9760-4582-a14e-b4bc77538d06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:33.159526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9e82437d-9760-4582-a14e-b4bc77538d06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:33.168747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9e82437d-9760-4582-a14e-b4bc77538d06 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.104956 Apr 11 20:06:33.169360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1199/2177] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:33.945906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:33.946843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:33.957561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:33.958304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:33.959552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:33.960268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:34.090583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:34.099134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:34.100625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:34.101817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6aaa18df-2f03-476f-95cf-40e4b2839c67 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162529 Apr 11 20:06:34.102375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 979/2178] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:34.189388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-85a09e73-c6a8-4d7a-b037-30e356b7c0fb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:34.189949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-85a09e73-c6a8-4d7a-b037-30e356b7c0fb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:34.196753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85a09e73-c6a8-4d7a-b037-30e356b7c0fb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:34.197133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85a09e73-c6a8-4d7a-b037-30e356b7c0fb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:34.197883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85a09e73-c6a8-4d7a-b037-30e356b7c0fb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:34.198311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85a09e73-c6a8-4d7a-b037-30e356b7c0fb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:34.263088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-85a09e73-c6a8-4d7a-b037-30e356b7c0fb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:34.271153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-85a09e73-c6a8-4d7a-b037-30e356b7c0fb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087686 Apr 11 20:06:34.271731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1200/2179] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:35.125089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:35.126013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:35.136794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:35.137586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:35.138838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:35.139555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:35.279506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:35.288036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d5b3f5b6-9ee9-4ca4-ab34-a7022de10839 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:35.288593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:35.288736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d5b3f5b6-9ee9-4ca4-ab34-a7022de10839 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:35.290197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:35.291240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a1ce66b-3895-4522-8ea1-b371a5bf2e57 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.173261 Apr 11 20:06:35.291764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 980/2180] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:35.295316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5b3f5b6-9ee9-4ca4-ab34-a7022de10839 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:35.295763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5b3f5b6-9ee9-4ca4-ab34-a7022de10839 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:35.296517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5b3f5b6-9ee9-4ca4-ab34-a7022de10839 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:35.296926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5b3f5b6-9ee9-4ca4-ab34-a7022de10839 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:35.356514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d5b3f5b6-9ee9-4ca4-ab34-a7022de10839 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:35.364383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d5b3f5b6-9ee9-4ca4-ab34-a7022de10839 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.080256 Apr 11 20:06:35.365006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1201/2181] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:36.310424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:36.310975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:36.317722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:36.318163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:36.318922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:36.319341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:36.388192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c02f95f0-f74a-4520-80e3-b03f2300d110 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:36.388983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c02f95f0-f74a-4520-80e3-b03f2300d110 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:36.397757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c02f95f0-f74a-4520-80e3-b03f2300d110 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:36.398501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c02f95f0-f74a-4520-80e3-b03f2300d110 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:36.399716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c02f95f0-f74a-4520-80e3-b03f2300d110 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:36.400476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c02f95f0-f74a-4520-80e3-b03f2300d110 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:36.474522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c02f95f0-f74a-4520-80e3-b03f2300d110 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:36.477912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:36.482654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c02f95f0-f74a-4520-80e3-b03f2300d110 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099983 Apr 11 20:06:36.483242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1202/2182] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:36.486670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:36.488164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:36.489372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-90630765-6218-435a-8d6f-a94e3f0e3d5a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.182926 Apr 11 20:06:36.489931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 981/2183] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:37.504281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-30f346a7-c25d-4785-9991-fcbdeb13eae4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:37.505188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-30f346a7-c25d-4785-9991-fcbdeb13eae4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:37.511514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:37.512504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:37.516236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30f346a7-c25d-4785-9991-fcbdeb13eae4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:37.517125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30f346a7-c25d-4785-9991-fcbdeb13eae4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:37.517894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30f346a7-c25d-4785-9991-fcbdeb13eae4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:37.518324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30f346a7-c25d-4785-9991-fcbdeb13eae4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:37.520800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:37.521279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:37.522038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:37.522457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:37.584518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-30f346a7-c25d-4785-9991-fcbdeb13eae4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:37.592395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-30f346a7-c25d-4785-9991-fcbdeb13eae4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095135 Apr 11 20:06:37.592951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1203/2184] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:37.669869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:37.678345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:37.679815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:37.681000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c16f94a-0033-4900-9e3b-e0ad92e9b488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.176125 Apr 11 20:06:37.681543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 982/2185] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:38.613543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-305f64ad-e51d-428e-abab-469297a3d61c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:38.614367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-305f64ad-e51d-428e-abab-469297a3d61c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:38.625482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-305f64ad-e51d-428e-abab-469297a3d61c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:38.626350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-305f64ad-e51d-428e-abab-469297a3d61c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:38.627134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-305f64ad-e51d-428e-abab-469297a3d61c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:38.627584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-305f64ad-e51d-428e-abab-469297a3d61c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:38.693550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-305f64ad-e51d-428e-abab-469297a3d61c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:38.702656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:38.703229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:38.703348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-305f64ad-e51d-428e-abab-469297a3d61c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096460 Apr 11 20:06:38.703903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1204/2186] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:38.710729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:38.711176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:38.711934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:38.712394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:38.840154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:38.848490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:38.849980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:38.851124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec18d5fe-7b67-4416-8fca-fa762c36bf2d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.152383 Apr 11 20:06:38.851649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 983/2187] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:39.724715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-29939347-301f-4552-b669-71d50d356af2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:39.725725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-29939347-301f-4552-b669-71d50d356af2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:39.736207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29939347-301f-4552-b669-71d50d356af2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:39.736672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29939347-301f-4552-b669-71d50d356af2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:39.737505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29939347-301f-4552-b669-71d50d356af2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:39.737950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29939347-301f-4552-b669-71d50d356af2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:39.800189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-29939347-301f-4552-b669-71d50d356af2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:39.808210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-29939347-301f-4552-b669-71d50d356af2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089962 Apr 11 20:06:39.808768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1205/2188] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:39.871728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:39.872569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:39.881919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:39.882516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:39.883550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:39.884158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:40.026194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:40.036162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:40.037745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:40.038984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-97ba183e-f3ec-4753-9ad5-ddb39b36f241 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.172585 Apr 11 20:06:40.039511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 984/2189] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:40.829120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-676e9755-1b16-4bfe-93dd-8b55dfdd6e04 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:40.830135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-676e9755-1b16-4bfe-93dd-8b55dfdd6e04 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:40.841744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-676e9755-1b16-4bfe-93dd-8b55dfdd6e04 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:40.842507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-676e9755-1b16-4bfe-93dd-8b55dfdd6e04 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:40.843750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-676e9755-1b16-4bfe-93dd-8b55dfdd6e04 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:40.844470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-676e9755-1b16-4bfe-93dd-8b55dfdd6e04 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:40.916757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-676e9755-1b16-4bfe-93dd-8b55dfdd6e04 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:40.924932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-676e9755-1b16-4bfe-93dd-8b55dfdd6e04 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.102343 Apr 11 20:06:40.925515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1206/2190] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:41.061432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:41.062437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:41.073190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:41.073941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:41.075199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:41.075914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:41.202705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:41.211370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:41.212855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:41.214059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6cafdbcf-68c5-44aa-8f68-3dbb426e9756 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159173 Apr 11 20:06:41.214620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 985/2191] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:41.946186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-961547aa-2580-4389-9a98-cd0e6eae356b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:41.947135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-961547aa-2580-4389-9a98-cd0e6eae356b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:41.956571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-961547aa-2580-4389-9a98-cd0e6eae356b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:41.957014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-961547aa-2580-4389-9a98-cd0e6eae356b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:41.957790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-961547aa-2580-4389-9a98-cd0e6eae356b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:41.958214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-961547aa-2580-4389-9a98-cd0e6eae356b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:42.022948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-961547aa-2580-4389-9a98-cd0e6eae356b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:42.035111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-961547aa-2580-4389-9a98-cd0e6eae356b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095146 Apr 11 20:06:42.035846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1207/2192] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:42.236414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:42.237205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:42.246634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:42.247319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:42.248472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:42.249544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:42.374300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:42.382878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:42.384364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:42.385563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9525934c-8a47-4b09-ab70-7b57b3a27748 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.155316 Apr 11 20:06:42.386126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 986/2193] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:43.061352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b99d17e2-166c-4f78-9a5b-3df9f6371357 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:43.062442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b99d17e2-166c-4f78-9a5b-3df9f6371357 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:43.069757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b99d17e2-166c-4f78-9a5b-3df9f6371357 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:43.070210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b99d17e2-166c-4f78-9a5b-3df9f6371357 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:43.070975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b99d17e2-166c-4f78-9a5b-3df9f6371357 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:43.071408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b99d17e2-166c-4f78-9a5b-3df9f6371357 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:43.133139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b99d17e2-166c-4f78-9a5b-3df9f6371357 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:43.141689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b99d17e2-166c-4f78-9a5b-3df9f6371357 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087117 Apr 11 20:06:43.142209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1208/2194] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:43.408776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:43.409847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:43.420794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:43.421599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:43.422939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:43.423528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:43.784572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:43.793711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:43.795184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:43.796415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a98c9483-587c-4939-8f6a-2033eb473910 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.394497 Apr 11 20:06:43.796997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 987/2195] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:44.161067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-abc9a4b8-302d-4d16-8804-488c1329f8ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:44.161939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-abc9a4b8-302d-4d16-8804-488c1329f8ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:44.170512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abc9a4b8-302d-4d16-8804-488c1329f8ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:44.171101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abc9a4b8-302d-4d16-8804-488c1329f8ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:44.172355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abc9a4b8-302d-4d16-8804-488c1329f8ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:44.173256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abc9a4b8-302d-4d16-8804-488c1329f8ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:44.235808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-abc9a4b8-302d-4d16-8804-488c1329f8ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:44.243760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-abc9a4b8-302d-4d16-8804-488c1329f8ba tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087238 Apr 11 20:06:44.244327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1209/2196] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:44.818703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:44.819712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:44.830306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:44.830759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:44.831531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:44.831965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:44.973023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:44.981792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:44.983286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:44.984459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dab30259-b244-4f7d-916e-9a9753be75f9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.172422 Apr 11 20:06:44.985044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 988/2197] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:45.265389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15c530c6-93c3-4051-95d4-6382b124df07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:45.266388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15c530c6-93c3-4051-95d4-6382b124df07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:45.276977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c530c6-93c3-4051-95d4-6382b124df07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:45.277842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c530c6-93c3-4051-95d4-6382b124df07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:45.279093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c530c6-93c3-4051-95d4-6382b124df07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:45.279807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c530c6-93c3-4051-95d4-6382b124df07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:45.345418 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15c530c6-93c3-4051-95d4-6382b124df07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:45.356644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15c530c6-93c3-4051-95d4-6382b124df07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097816 Apr 11 20:06:45.357262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1210/2198] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:46.004630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:46.005237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:46.011750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:46.012199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:46.012992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:46.013627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:46.158050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:46.167633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:46.168326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:46.169544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-75479ada-e5e7-4e48-95d7-8361c714c71d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169832 Apr 11 20:06:46.170350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 989/2199] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:46.378963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15f4f448-c07c-4bd1-8679-e824d820f218 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:46.379875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15f4f448-c07c-4bd1-8679-e824d820f218 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:46.390935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f4f448-c07c-4bd1-8679-e824d820f218 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:46.391739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f4f448-c07c-4bd1-8679-e824d820f218 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:46.393014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f4f448-c07c-4bd1-8679-e824d820f218 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:46.393963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f4f448-c07c-4bd1-8679-e824d820f218 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:46.454135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15f4f448-c07c-4bd1-8679-e824d820f218 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:46.462786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15f4f448-c07c-4bd1-8679-e824d820f218 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090777 Apr 11 20:06:46.463356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1211/2200] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:47.192379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:47.193346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:47.204069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:47.204796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:47.205912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:47.206601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:47.347316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:47.357249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:47.358743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:47.359916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-acf27199-4aa7-47f5-a58b-25dca7d96de3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.173509 Apr 11 20:06:47.360481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 990/2201] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:47.485262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d7e20b18-9550-402a-8372-1110cde9a3f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:47.485826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d7e20b18-9550-402a-8372-1110cde9a3f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:47.492484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7e20b18-9550-402a-8372-1110cde9a3f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:47.492947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7e20b18-9550-402a-8372-1110cde9a3f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:47.493706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7e20b18-9550-402a-8372-1110cde9a3f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:47.494502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7e20b18-9550-402a-8372-1110cde9a3f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:47.556832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d7e20b18-9550-402a-8372-1110cde9a3f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:47.565221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d7e20b18-9550-402a-8372-1110cde9a3f1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083976 Apr 11 20:06:47.565850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1212/2202] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:48.386806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:48.387850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:48.398526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:48.399263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:48.400514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:48.401281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:48.534463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:48.547766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:48.550409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:48.551870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c7d409a-b55f-467c-bac6-b18a09b855f1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171648 Apr 11 20:06:48.552435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 991/2203] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:48.582376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53476d9a-c8e3-4d8a-bab0-4e45d8c051d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:48.582986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53476d9a-c8e3-4d8a-bab0-4e45d8c051d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:48.589721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53476d9a-c8e3-4d8a-bab0-4e45d8c051d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:48.590165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53476d9a-c8e3-4d8a-bab0-4e45d8c051d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:48.590944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53476d9a-c8e3-4d8a-bab0-4e45d8c051d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:48.591376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53476d9a-c8e3-4d8a-bab0-4e45d8c051d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:48.660772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-53476d9a-c8e3-4d8a-bab0-4e45d8c051d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:48.669642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53476d9a-c8e3-4d8a-bab0-4e45d8c051d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091247 Apr 11 20:06:48.670185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1213/2204] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:49.575198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:49.576036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:49.584765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:49.585253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:49.586001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:49.586427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:49.687115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-14c3c56d-cd3f-47f5-b432-98995022201a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:49.687707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-14c3c56d-cd3f-47f5-b432-98995022201a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:49.694485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14c3c56d-cd3f-47f5-b432-98995022201a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:49.694935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14c3c56d-cd3f-47f5-b432-98995022201a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:49.695696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14c3c56d-cd3f-47f5-b432-98995022201a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:49.696130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14c3c56d-cd3f-47f5-b432-98995022201a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:49.720626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:49.729567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:49.731113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:49.732338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9dbcb507-40fd-4f8a-b4fc-f71588ee0ce9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.163964 Apr 11 20:06:49.733097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 992/2205] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:49.756053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-14c3c56d-cd3f-47f5-b432-98995022201a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:49.764617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-14c3c56d-cd3f-47f5-b432-98995022201a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081688 Apr 11 20:06:49.765215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1214/2206] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:50.754487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:50.755416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:50.766097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:50.766831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:50.768070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:50.768896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:50.781903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-677d1595-ad2b-4d9f-b728-083a36c4f660 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:50.782546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-677d1595-ad2b-4d9f-b728-083a36c4f660 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:50.788837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-677d1595-ad2b-4d9f-b728-083a36c4f660 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:50.789477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-677d1595-ad2b-4d9f-b728-083a36c4f660 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:50.790144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-677d1595-ad2b-4d9f-b728-083a36c4f660 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:50.790575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-677d1595-ad2b-4d9f-b728-083a36c4f660 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:50.865474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-677d1595-ad2b-4d9f-b728-083a36c4f660 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:50.874042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-677d1595-ad2b-4d9f-b728-083a36c4f660 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095632 Apr 11 20:06:50.874623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1215/2207] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:50.921768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:50.930068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:50.931568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:50.932922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dc05ff77-de3f-4acf-9b32-178860eac738 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.185201 Apr 11 20:06:50.933983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 993/2208] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:51.893257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6600a731-9014-46a8-aa9a-db92cd85fc62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:51.894205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6600a731-9014-46a8-aa9a-db92cd85fc62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:51.902775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6600a731-9014-46a8-aa9a-db92cd85fc62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:51.903373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6600a731-9014-46a8-aa9a-db92cd85fc62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:51.904375 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6600a731-9014-46a8-aa9a-db92cd85fc62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:51.904964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6600a731-9014-46a8-aa9a-db92cd85fc62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:51.951758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:51.952384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:51.959032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:51.959477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:51.960228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:51.960651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:51.967694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6600a731-9014-46a8-aa9a-db92cd85fc62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:51.975977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6600a731-9014-46a8-aa9a-db92cd85fc62 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087886 Apr 11 20:06:51.976529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1216/2209] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:52.094162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:52.103532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:52.105018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:52.106171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6cf88e0f-3b74-4c73-bf37-76c6e5d1f3fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158381 Apr 11 20:06:52.106722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 994/2210] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:52.997565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ddcc68d-2e86-4212-a96e-c483ed17d92c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:52.998947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ddcc68d-2e86-4212-a96e-c483ed17d92c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:53.009230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ddcc68d-2e86-4212-a96e-c483ed17d92c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:53.009976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ddcc68d-2e86-4212-a96e-c483ed17d92c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:53.011222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ddcc68d-2e86-4212-a96e-c483ed17d92c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:53.011934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ddcc68d-2e86-4212-a96e-c483ed17d92c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:53.074075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8ddcc68d-2e86-4212-a96e-c483ed17d92c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:53.082464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ddcc68d-2e86-4212-a96e-c483ed17d92c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091701 Apr 11 20:06:53.083050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1217/2211] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:53.126456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:53.127096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:53.135084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:53.135795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:53.137043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:53.137631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:53.272395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:53.281057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:53.282825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:53.284069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-564352b7-8953-4603-8f4e-c532a4e53b13 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.163771 Apr 11 20:06:53.284813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 995/2212] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:54.099134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50777cb5-904d-4ff1-9d65-3f423f1b3b19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:54.100398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50777cb5-904d-4ff1-9d65-3f423f1b3b19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:54.107235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50777cb5-904d-4ff1-9d65-3f423f1b3b19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:54.107698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50777cb5-904d-4ff1-9d65-3f423f1b3b19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:54.108437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50777cb5-904d-4ff1-9d65-3f423f1b3b19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:54.108877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50777cb5-904d-4ff1-9d65-3f423f1b3b19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:54.172261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50777cb5-904d-4ff1-9d65-3f423f1b3b19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:54.180517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50777cb5-904d-4ff1-9d65-3f423f1b3b19 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085354 Apr 11 20:06:54.181098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1218/2213] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:54.306169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:54.306766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:54.316083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:54.316535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:54.317341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:54.317778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:54.468383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:54.478063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:54.479544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:54.480747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8df04d98-c15c-4a25-a286-7ac6dc5999ea tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.180709 Apr 11 20:06:54.481349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 996/2214] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:55.198068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-81227193-e3cb-48b9-b38f-e8031abe9ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:55.198695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-81227193-e3cb-48b9-b38f-e8031abe9ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:55.205451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81227193-e3cb-48b9-b38f-e8031abe9ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:55.205897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81227193-e3cb-48b9-b38f-e8031abe9ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:55.206654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81227193-e3cb-48b9-b38f-e8031abe9ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:55.207083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81227193-e3cb-48b9-b38f-e8031abe9ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:55.268057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-81227193-e3cb-48b9-b38f-e8031abe9ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:55.276525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-81227193-e3cb-48b9-b38f-e8031abe9ce5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082421 Apr 11 20:06:55.277130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1219/2215] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:55.504154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:55.505207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:55.516488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:55.517300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:55.518550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:55.519303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:55.656095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:55.665832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:55.667310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:55.668475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-edcdecb5-bd9d-4a06-9fe6-002047825a28 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171252 Apr 11 20:06:55.669056 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 997/2216] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:56.297754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-24aaa09c-3fb1-441e-9d25-4b0bce5fbaf7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:56.298610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-24aaa09c-3fb1-441e-9d25-4b0bce5fbaf7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:56.306296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24aaa09c-3fb1-441e-9d25-4b0bce5fbaf7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:56.306741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24aaa09c-3fb1-441e-9d25-4b0bce5fbaf7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:56.307496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24aaa09c-3fb1-441e-9d25-4b0bce5fbaf7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:56.307924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24aaa09c-3fb1-441e-9d25-4b0bce5fbaf7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:56.369338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-24aaa09c-3fb1-441e-9d25-4b0bce5fbaf7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:56.378344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-24aaa09c-3fb1-441e-9d25-4b0bce5fbaf7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087254 Apr 11 20:06:56.378894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1220/2217] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:56.690365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:56.691363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:56.698304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:56.698752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:56.699521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:56.699950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:56.830114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:56.839130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:56.840618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:56.841814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-680a886d-3e5a-4960-9870-fcbfbe5e4c34 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158090 Apr 11 20:06:56.842380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 998/2218] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:57.399848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c5830e8a-e3a5-4330-95b3-f41f662d8723 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:57.400703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c5830e8a-e3a5-4330-95b3-f41f662d8723 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:57.411612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5830e8a-e3a5-4330-95b3-f41f662d8723 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:57.412053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5830e8a-e3a5-4330-95b3-f41f662d8723 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:57.412801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5830e8a-e3a5-4330-95b3-f41f662d8723 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:57.413327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5830e8a-e3a5-4330-95b3-f41f662d8723 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:57.479810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c5830e8a-e3a5-4330-95b3-f41f662d8723 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:57.488330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c5830e8a-e3a5-4330-95b3-f41f662d8723 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095182 Apr 11 20:06:57.489031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1221/2219] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:57.863910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:57.864879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:57.875861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:57.876610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:57.878260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:57.879112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:58.017356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:58.025992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:58.027471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:58.028638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c2be6596-ff1b-4b60-9761-40cec47923c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171345 Apr 11 20:06:58.029241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 999/2220] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:58.511679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-df89114e-dc69-4386-a2ad-9789f8c6aa3d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:58.513243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-df89114e-dc69-4386-a2ad-9789f8c6aa3d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:58.523587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df89114e-dc69-4386-a2ad-9789f8c6aa3d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:58.524027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df89114e-dc69-4386-a2ad-9789f8c6aa3d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:58.524784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df89114e-dc69-4386-a2ad-9789f8c6aa3d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:58.525239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df89114e-dc69-4386-a2ad-9789f8c6aa3d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:58.588496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-df89114e-dc69-4386-a2ad-9789f8c6aa3d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:58.596716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-df89114e-dc69-4386-a2ad-9789f8c6aa3d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093486 Apr 11 20:06:58.597288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1222/2221] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:06:59.047046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:59.047659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:59.054356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:59.054795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:59.055547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:59.055971 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:59.185995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:59.194315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:59.195796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:59.196978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-55d8815a-0326-467d-a6d9-3ac52c0c5e41 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.153945 Apr 11 20:06:59.197549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1000/2222] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:06:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:06:59.618422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e933a352-e01d-41b4-9ce1-bec527c5be46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:06:59.619070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e933a352-e01d-41b4-9ce1-bec527c5be46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:06:59.625961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e933a352-e01d-41b4-9ce1-bec527c5be46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:59.626433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e933a352-e01d-41b4-9ce1-bec527c5be46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:59.627195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e933a352-e01d-41b4-9ce1-bec527c5be46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:06:59.627624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e933a352-e01d-41b4-9ce1-bec527c5be46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:06:59.688420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e933a352-e01d-41b4-9ce1-bec527c5be46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:06:59.696915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e933a352-e01d-41b4-9ce1-bec527c5be46 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082494 Apr 11 20:06:59.697491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1223/2223] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:06:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:00.218708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:00.219305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:00.227017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:00.227462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:00.228220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:00.228650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:00.360477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:00.373134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:00.376024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:00.377980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9630bd5c-9c7a-4d69-8a7a-e8aa7a2b686a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165346 Apr 11 20:07:00.378865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1001/2224] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:00.714511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-32f2faa4-67fd-42a8-8397-584bd1893f52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:00.715133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-32f2faa4-67fd-42a8-8397-584bd1893f52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:00.721949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32f2faa4-67fd-42a8-8397-584bd1893f52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:00.722389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32f2faa4-67fd-42a8-8397-584bd1893f52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:00.723172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32f2faa4-67fd-42a8-8397-584bd1893f52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:00.723612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32f2faa4-67fd-42a8-8397-584bd1893f52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:00.783397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-32f2faa4-67fd-42a8-8397-584bd1893f52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:00.791835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-32f2faa4-67fd-42a8-8397-584bd1893f52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081282 Apr 11 20:07:00.792398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1224/2225] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:01.408264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:01.409325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:01.420772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:01.421581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:01.422829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:01.423547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:01.573457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:01.585248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:01.586733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:01.588228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a1a51179-6817-4182-aea4-76a38e4ecccb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.186178 Apr 11 20:07:01.588792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1002/2226] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:01.811960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-137a6f2b-8cbb-4e68-9269-dd0d37e2d0d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:01.812522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-137a6f2b-8cbb-4e68-9269-dd0d37e2d0d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:01.819031 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-137a6f2b-8cbb-4e68-9269-dd0d37e2d0d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:01.819474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-137a6f2b-8cbb-4e68-9269-dd0d37e2d0d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:01.820218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-137a6f2b-8cbb-4e68-9269-dd0d37e2d0d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:01.820642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-137a6f2b-8cbb-4e68-9269-dd0d37e2d0d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:01.891968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-137a6f2b-8cbb-4e68-9269-dd0d37e2d0d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:01.904188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-137a6f2b-8cbb-4e68-9269-dd0d37e2d0d8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095949 Apr 11 20:07:01.904961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1225/2227] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:02.611242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:02.612103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:02.624197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:02.625003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:02.626228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:02.626941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:02.760248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:02.774077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:02.776414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:02.778316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6716fc3b-f95f-445e-8ed0-5d3c0ddbe3fd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.173564 Apr 11 20:07:02.779079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1003/2228] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:02.925551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9b0ca8ea-da7e-4a00-a67e-e42cea508365 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:02.926572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9b0ca8ea-da7e-4a00-a67e-e42cea508365 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:02.937273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b0ca8ea-da7e-4a00-a67e-e42cea508365 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:02.938052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b0ca8ea-da7e-4a00-a67e-e42cea508365 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:02.939253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b0ca8ea-da7e-4a00-a67e-e42cea508365 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:02.939967 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b0ca8ea-da7e-4a00-a67e-e42cea508365 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:03.000575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9b0ca8ea-da7e-4a00-a67e-e42cea508365 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:03.009296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9b0ca8ea-da7e-4a00-a67e-e42cea508365 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090147 Apr 11 20:07:03.009854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1226/2229] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:03.803446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:03.804401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:03.815070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:03.815818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:03.816946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:03.817414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:03.954576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:03.964541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:03.966068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:03.967230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b6462381-0602-467a-90cc-56ab3ed45991 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170484 Apr 11 20:07:03.967785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1004/2230] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:04.029807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ad3f06e-6f35-4ed7-8094-c2f6e8fa1256 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:04.030825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ad3f06e-6f35-4ed7-8094-c2f6e8fa1256 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:04.041628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ad3f06e-6f35-4ed7-8094-c2f6e8fa1256 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:04.042401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ad3f06e-6f35-4ed7-8094-c2f6e8fa1256 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:04.043632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ad3f06e-6f35-4ed7-8094-c2f6e8fa1256 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:04.044344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ad3f06e-6f35-4ed7-8094-c2f6e8fa1256 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:04.109706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8ad3f06e-6f35-4ed7-8094-c2f6e8fa1256 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:04.117829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ad3f06e-6f35-4ed7-8094-c2f6e8fa1256 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094408 Apr 11 20:07:04.118368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1227/2231] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:04.989593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:04.990682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:05.001726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:05.002458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:05.003697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:05.004400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:05.135960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1734d11f-2f71-4c1e-bf03-0307c2c559bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:05.136806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1734d11f-2f71-4c1e-bf03-0307c2c559bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:05.140984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:05.144010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1734d11f-2f71-4c1e-bf03-0307c2c559bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:05.144460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1734d11f-2f71-4c1e-bf03-0307c2c559bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:05.145271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1734d11f-2f71-4c1e-bf03-0307c2c559bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:05.145696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1734d11f-2f71-4c1e-bf03-0307c2c559bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:05.151464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:05.153794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:05.155666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d61a0dad-a32b-4954-b7f4-988b7ad907c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.172308 Apr 11 20:07:05.156578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1005/2232] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:05.210572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1734d11f-2f71-4c1e-bf03-0307c2c559bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:05.218969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1734d11f-2f71-4c1e-bf03-0307c2c559bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086970 Apr 11 20:07:05.219519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1228/2233] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:06.179656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:06.180290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:06.187006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:06.187446 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:06.188203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:06.188629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:06.235866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee8a6b52-cbc2-4eb3-af89-1c842ebc8a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:06.236469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee8a6b52-cbc2-4eb3-af89-1c842ebc8a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:06.243251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee8a6b52-cbc2-4eb3-af89-1c842ebc8a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:06.243699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee8a6b52-cbc2-4eb3-af89-1c842ebc8a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:06.244464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee8a6b52-cbc2-4eb3-af89-1c842ebc8a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:06.244890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee8a6b52-cbc2-4eb3-af89-1c842ebc8a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:06.318652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee8a6b52-cbc2-4eb3-af89-1c842ebc8a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:06.326550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee8a6b52-cbc2-4eb3-af89-1c842ebc8a07 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094633 Apr 11 20:07:06.327372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1229/2234] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:06.340002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:06.348646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:06.350166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:06.351329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e5bfb470-0bce-4303-9ed7-462795eb425c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.177582 Apr 11 20:07:06.351884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1006/2235] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:07.345062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-efc44803-5391-4e7a-9c4a-797f13718c64 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:07.345724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-efc44803-5391-4e7a-9c4a-797f13718c64 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:07.353041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-efc44803-5391-4e7a-9c4a-797f13718c64 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:07.353493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-efc44803-5391-4e7a-9c4a-797f13718c64 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:07.354253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-efc44803-5391-4e7a-9c4a-797f13718c64 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:07.354683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-efc44803-5391-4e7a-9c4a-797f13718c64 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:07.369733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:07.370315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:07.377202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:07.377641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:07.378400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:07.378825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:07.418594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-efc44803-5391-4e7a-9c4a-797f13718c64 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:07.427062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-efc44803-5391-4e7a-9c4a-797f13718c64 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086346 Apr 11 20:07:07.427651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1230/2236] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:07.509303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:07.517946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:07.519417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:07.520568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09563e90-a4b3-42b5-84ca-1b953fe2ebc2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.154708 Apr 11 20:07:07.521150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1007/2237] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:08.448200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59481498-515c-4195-b92e-124100732acb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:08.449338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59481498-515c-4195-b92e-124100732acb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:08.459541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59481498-515c-4195-b92e-124100732acb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:08.459989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59481498-515c-4195-b92e-124100732acb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:08.460747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59481498-515c-4195-b92e-124100732acb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:08.461212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59481498-515c-4195-b92e-124100732acb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:08.527800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-59481498-515c-4195-b92e-124100732acb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:08.537637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59481498-515c-4195-b92e-124100732acb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095964 Apr 11 20:07:08.538195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1231/2238] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:08.539786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:08.540391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:08.547380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:08.547836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:08.548604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:08.549089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:08.683418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:08.691863 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:08.693382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:08.694549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0858abd6-b9dc-48d2-8598-657e242e3e37 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158612 Apr 11 20:07:08.695116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1008/2239] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:09.558509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0bd357d1-964a-4dff-8a34-e9ed7f87413a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:09.559408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0bd357d1-964a-4dff-8a34-e9ed7f87413a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:09.569472 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd357d1-964a-4dff-8a34-e9ed7f87413a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:09.569908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd357d1-964a-4dff-8a34-e9ed7f87413a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:09.570654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd357d1-964a-4dff-8a34-e9ed7f87413a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:09.571080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd357d1-964a-4dff-8a34-e9ed7f87413a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:09.635767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0bd357d1-964a-4dff-8a34-e9ed7f87413a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:09.643977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0bd357d1-964a-4dff-8a34-e9ed7f87413a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092112 Apr 11 20:07:09.644538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1232/2240] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:09.717050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:09.718076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:09.727097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:09.727538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:09.728286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:09.728713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:09.857098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:09.865775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:09.867254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:09.868429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5c249de-397d-43c8-ad87-d7400580f655 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158054 Apr 11 20:07:09.869033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1009/2241] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:10.665439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56570c1d-17c2-4980-ac5a-5bab8927c824 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:10.667280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56570c1d-17c2-4980-ac5a-5bab8927c824 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:10.678430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56570c1d-17c2-4980-ac5a-5bab8927c824 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:10.678874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56570c1d-17c2-4980-ac5a-5bab8927c824 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:10.679619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56570c1d-17c2-4980-ac5a-5bab8927c824 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:10.680041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56570c1d-17c2-4980-ac5a-5bab8927c824 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:10.740948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56570c1d-17c2-4980-ac5a-5bab8927c824 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:10.749610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56570c1d-17c2-4980-ac5a-5bab8927c824 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090609 Apr 11 20:07:10.750181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1233/2242] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:10.896972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:10.897731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:10.905894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:10.906456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:10.907401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:10.907948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:11.041278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:11.049967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:11.051482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:11.052699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f235db7e-62bb-41bb-9222-1fd040d610fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162372 Apr 11 20:07:11.053298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1010/2243] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:11.769992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ea11d590-91b8-44ac-8f68-c25a6ec80e56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:11.771025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ea11d590-91b8-44ac-8f68-c25a6ec80e56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:11.781731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea11d590-91b8-44ac-8f68-c25a6ec80e56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:11.782483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea11d590-91b8-44ac-8f68-c25a6ec80e56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:11.783723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea11d590-91b8-44ac-8f68-c25a6ec80e56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:11.784445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea11d590-91b8-44ac-8f68-c25a6ec80e56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:11.848226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea11d590-91b8-44ac-8f68-c25a6ec80e56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:11.856277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ea11d590-91b8-44ac-8f68-c25a6ec80e56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092809 Apr 11 20:07:11.856842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1234/2244] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:12.075211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:12.076080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:12.085612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:12.086135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:12.086907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:12.087342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:12.220700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:12.229502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:12.230982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:12.232163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7b64507-df6c-49c4-8d89-bef36dc385e3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164044 Apr 11 20:07:12.232723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1011/2245] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:12.877713 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ffd6e38-0e94-4cf9-aa88-5854c3a7042b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:12.878704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ffd6e38-0e94-4cf9-aa88-5854c3a7042b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:12.889792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ffd6e38-0e94-4cf9-aa88-5854c3a7042b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:12.890537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ffd6e38-0e94-4cf9-aa88-5854c3a7042b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:12.891799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ffd6e38-0e94-4cf9-aa88-5854c3a7042b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:12.892523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ffd6e38-0e94-4cf9-aa88-5854c3a7042b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:12.956800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ffd6e38-0e94-4cf9-aa88-5854c3a7042b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:12.965116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ffd6e38-0e94-4cf9-aa88-5854c3a7042b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094260 Apr 11 20:07:12.965729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1235/2246] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:13.253536 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:13.254417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:13.261623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:13.262079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:13.262835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:13.263269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:13.403671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:13.412844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:13.414379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:13.415538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-91050535-bca3-4f23-9980-00e087c43e9f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168865 Apr 11 20:07:13.416077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1012/2247] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:13.986579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc9750ce-3462-4dbb-97d3-74202c05df85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:13.987493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc9750ce-3462-4dbb-97d3-74202c05df85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:13.998478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc9750ce-3462-4dbb-97d3-74202c05df85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:13.999558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc9750ce-3462-4dbb-97d3-74202c05df85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:14.000791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc9750ce-3462-4dbb-97d3-74202c05df85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:14.001542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc9750ce-3462-4dbb-97d3-74202c05df85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:14.064409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dc9750ce-3462-4dbb-97d3-74202c05df85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:14.072568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc9750ce-3462-4dbb-97d3-74202c05df85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092519 Apr 11 20:07:14.073140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1236/2248] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:14.438264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:14.439242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:14.449869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:14.450631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:14.451865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:14.452579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:14.589379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:14.598087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:14.599572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:14.600764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e4f4390d-6b77-4ee7-990e-59efaf0bfb8a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169152 Apr 11 20:07:14.601354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1013/2249] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:15.094143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d1dcc250-d1ba-45b4-9e33-24cb7d1fd22d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:15.095142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d1dcc250-d1ba-45b4-9e33-24cb7d1fd22d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:15.105788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1dcc250-d1ba-45b4-9e33-24cb7d1fd22d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:15.106537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1dcc250-d1ba-45b4-9e33-24cb7d1fd22d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:15.107792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1dcc250-d1ba-45b4-9e33-24cb7d1fd22d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:15.108513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1dcc250-d1ba-45b4-9e33-24cb7d1fd22d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:15.178299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d1dcc250-d1ba-45b4-9e33-24cb7d1fd22d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:15.186707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d1dcc250-d1ba-45b4-9e33-24cb7d1fd22d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099369 Apr 11 20:07:15.187284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1237/2250] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:15 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:15.628829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:15.629739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:15.637422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:15.637876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:15.638639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:15.639095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:15.774298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:15.783093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:15.784581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:15.785777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89d0922a-950f-43da-9c0a-10b44d7672c5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164337 Apr 11 20:07:15.786338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1014/2251] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:16.209844 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90355738-e514-4ded-8926-a1392eb7d4f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:16.210464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90355738-e514-4ded-8926-a1392eb7d4f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:16.217298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90355738-e514-4ded-8926-a1392eb7d4f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:16.217745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90355738-e514-4ded-8926-a1392eb7d4f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:16.218494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90355738-e514-4ded-8926-a1392eb7d4f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:16.218918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90355738-e514-4ded-8926-a1392eb7d4f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:16.281799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90355738-e514-4ded-8926-a1392eb7d4f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:16.290115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90355738-e514-4ded-8926-a1392eb7d4f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086409 Apr 11 20:07:16.290675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1238/2252] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:16.814318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:16.815274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:16.826333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:16.827147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:16.828462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:16.829268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:16.970061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:16.979710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:16.981211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:16.982372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e3198ce-0883-4447-94b5-dc39eea7244d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.174668 Apr 11 20:07:16.982923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1015/2253] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:17.311255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf503a15-9175-4dc5-b588-10f2f4851ba4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:17.312274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cf503a15-9175-4dc5-b588-10f2f4851ba4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:17.321181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf503a15-9175-4dc5-b588-10f2f4851ba4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:17.321629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf503a15-9175-4dc5-b588-10f2f4851ba4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:17.322387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf503a15-9175-4dc5-b588-10f2f4851ba4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:17.322822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf503a15-9175-4dc5-b588-10f2f4851ba4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:17.389439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf503a15-9175-4dc5-b588-10f2f4851ba4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:17.398335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf503a15-9175-4dc5-b588-10f2f4851ba4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093249 Apr 11 20:07:17.399016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1239/2254] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:18.016479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:18.017506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:18.028353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:18.029166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:18.030469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:18.031184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:18.169227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:18.179306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:18.180797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:18.182144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8883cb8a-f955-43c7-a82b-41d7509ad61d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.174495 Apr 11 20:07:18.182711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1016/2255] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:18.420085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a183503-2361-492a-97b8-b2e05b985685 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:18.421197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4a183503-2361-492a-97b8-b2e05b985685 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:18.430219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a183503-2361-492a-97b8-b2e05b985685 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:18.430665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a183503-2361-492a-97b8-b2e05b985685 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:18.431416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a183503-2361-492a-97b8-b2e05b985685 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:18.431849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a183503-2361-492a-97b8-b2e05b985685 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:18.501972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4a183503-2361-492a-97b8-b2e05b985685 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:18.510383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4a183503-2361-492a-97b8-b2e05b985685 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097010 Apr 11 20:07:18.510947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1240/2256] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:19.204430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:19.205475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:19.213837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:19.214284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:19.215032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:19.215457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:19.348962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:19.357366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:19.358829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:19.359982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e1ffc3bb-b303-4c2b-bf6c-ac2bfcdec68d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.161983 Apr 11 20:07:19.360539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1017/2257] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:19.531911 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dbb2896a-4ff2-4e99-bc8c-ca64f0044848 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:19.532770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dbb2896a-4ff2-4e99-bc8c-ca64f0044848 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:19.541172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbb2896a-4ff2-4e99-bc8c-ca64f0044848 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:19.541623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbb2896a-4ff2-4e99-bc8c-ca64f0044848 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:19.542376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbb2896a-4ff2-4e99-bc8c-ca64f0044848 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:19.542808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbb2896a-4ff2-4e99-bc8c-ca64f0044848 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:19.603018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dbb2896a-4ff2-4e99-bc8c-ca64f0044848 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:19.611028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dbb2896a-4ff2-4e99-bc8c-ca64f0044848 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085809 Apr 11 20:07:19.611647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1241/2258] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:20.383167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:20.384115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:20.394656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:20.395396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:20.396667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:20.397133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:20.539820 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:20.553031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:20.554518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:20.555677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56cb85a7-0eed-42ef-b10d-9750a8887ed8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179087 Apr 11 20:07:20.556211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1018/2259] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:20.632781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d943107d-ef65-42ab-a30c-1007b43e8d20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:20.633838 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d943107d-ef65-42ab-a30c-1007b43e8d20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:20.644339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d943107d-ef65-42ab-a30c-1007b43e8d20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:20.645157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d943107d-ef65-42ab-a30c-1007b43e8d20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:20.646494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d943107d-ef65-42ab-a30c-1007b43e8d20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:20.646929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d943107d-ef65-42ab-a30c-1007b43e8d20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:20.716730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d943107d-ef65-42ab-a30c-1007b43e8d20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:20.725840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d943107d-ef65-42ab-a30c-1007b43e8d20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099339 Apr 11 20:07:20.726828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1242/2260] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:21.578665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:21.579535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:21.590374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:21.591123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:21.592394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:21.593170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:21.737175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:21.745555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:21.747051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:21.747413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-76ab826b-3d46-4798-89d5-3e65ab294cfe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:21.748040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-76ab826b-3d46-4798-89d5-3e65ab294cfe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:21.748200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a3390423-d81c-4d4a-a523-96fe47a267d3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.176343 Apr 11 20:07:21.749101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1019/2261] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:21.754762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76ab826b-3d46-4798-89d5-3e65ab294cfe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:21.755207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76ab826b-3d46-4798-89d5-3e65ab294cfe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:21.756018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76ab826b-3d46-4798-89d5-3e65ab294cfe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:21.756447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76ab826b-3d46-4798-89d5-3e65ab294cfe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:21.819227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-76ab826b-3d46-4798-89d5-3e65ab294cfe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:21.828876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-76ab826b-3d46-4798-89d5-3e65ab294cfe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085104 Apr 11 20:07:21.829414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1243/2262] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:07:22.771564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:22.772346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:22.783059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:22.783725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:22.784943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:22.785649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:22.845279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-363a69c0-dbc1-4066-922d-b1e4f521af65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:22.845891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-363a69c0-dbc1-4066-922d-b1e4f521af65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:22.852707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-363a69c0-dbc1-4066-922d-b1e4f521af65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:22.853187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-363a69c0-dbc1-4066-922d-b1e4f521af65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:22.854083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-363a69c0-dbc1-4066-922d-b1e4f521af65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:22.854515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-363a69c0-dbc1-4066-922d-b1e4f521af65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:22.929161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-363a69c0-dbc1-4066-922d-b1e4f521af65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:22.937402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-363a69c0-dbc1-4066-922d-b1e4f521af65 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095982 Apr 11 20:07:22.938234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1244/2263] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:22.950879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:22.959621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:22.961141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:22.962308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1354ceb4-67f7-49de-bae9-03b3f4bfd93b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.197457 Apr 11 20:07:22.962904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1020/2264] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:23.959015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b691d9e4-d683-4b2e-9b3f-8bbf62593446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:23.960057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b691d9e4-d683-4b2e-9b3f-8bbf62593446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:23.970090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b691d9e4-d683-4b2e-9b3f-8bbf62593446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:23.970822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b691d9e4-d683-4b2e-9b3f-8bbf62593446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:23.972062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b691d9e4-d683-4b2e-9b3f-8bbf62593446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:23.972769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b691d9e4-d683-4b2e-9b3f-8bbf62593446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:23.980946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:23.981553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:23.988116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:23.988582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:23.989376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:23.989806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:24.042270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b691d9e4-d683-4b2e-9b3f-8bbf62593446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:24.050202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b691d9e4-d683-4b2e-9b3f-8bbf62593446 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097506 Apr 11 20:07:24.050763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1245/2265] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:24.132399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:24.141157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:24.142642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:24.143805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-439dd6d6-540d-49fa-916c-bd51b9af9097 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166700 Apr 11 20:07:24.144357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1021/2266] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:25.071450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d84c5d9c-f25c-48c3-aedb-589db5b59b20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:25.072411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d84c5d9c-f25c-48c3-aedb-589db5b59b20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:25.083200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d84c5d9c-f25c-48c3-aedb-589db5b59b20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:25.083937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d84c5d9c-f25c-48c3-aedb-589db5b59b20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:25.084933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d84c5d9c-f25c-48c3-aedb-589db5b59b20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:25.085400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d84c5d9c-f25c-48c3-aedb-589db5b59b20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:25.156160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d84c5d9c-f25c-48c3-aedb-589db5b59b20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:25.162177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:25.162787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:25.164724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d84c5d9c-f25c-48c3-aedb-589db5b59b20 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099829 Apr 11 20:07:25.165329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1246/2267] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:25 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:25.169563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:25.170009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:25.170770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:25.171177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:25.313665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:25.322513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:25.323997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:25.325195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37570e5d-fc64-4512-b9a4-6a7df6992fcb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166844 Apr 11 20:07:25.325721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1022/2268] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:07:26.185702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c1413c1-a2a7-4307-9c8c-9a9f5b514d7e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:26.186658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c1413c1-a2a7-4307-9c8c-9a9f5b514d7e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:26.196121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c1413c1-a2a7-4307-9c8c-9a9f5b514d7e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:26.196554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c1413c1-a2a7-4307-9c8c-9a9f5b514d7e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:26.197340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c1413c1-a2a7-4307-9c8c-9a9f5b514d7e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:26.197767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c1413c1-a2a7-4307-9c8c-9a9f5b514d7e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:26.273736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8c1413c1-a2a7-4307-9c8c-9a9f5b514d7e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:26.285465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c1413c1-a2a7-4307-9c8c-9a9f5b514d7e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.106861 Apr 11 20:07:26.286161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1247/2269] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:26.347425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:26.348480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:26.359093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:26.359838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:26.361149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:26.361872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:26.502170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:26.515032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:26.517351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:26.519089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b990f66a-eca7-470b-aef1-bb5f2677b9cf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.177989 Apr 11 20:07:26.519830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1023/2270] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:27.307009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-76e51278-c175-47ce-b2b8-9e619c87dcc8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:27.308020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-76e51278-c175-47ce-b2b8-9e619c87dcc8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:27.318490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76e51278-c175-47ce-b2b8-9e619c87dcc8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:27.319215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76e51278-c175-47ce-b2b8-9e619c87dcc8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:27.320445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76e51278-c175-47ce-b2b8-9e619c87dcc8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:27.321214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76e51278-c175-47ce-b2b8-9e619c87dcc8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:27.389292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-76e51278-c175-47ce-b2b8-9e619c87dcc8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:27.397346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-76e51278-c175-47ce-b2b8-9e619c87dcc8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097012 Apr 11 20:07:27.397938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1248/2271] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:27.540645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:27.541333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:27.549443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:27.550003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:27.550933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:27.551468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:27.688183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:27.697311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:27.698728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:27.699902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a556fb9d-9d79-45d1-836e-5753338a08eb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165002 Apr 11 20:07:27.700439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1024/2272] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:28.418421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8024a5f2-8c11-423a-99fb-95d6be417e67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:28.419421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8024a5f2-8c11-423a-99fb-95d6be417e67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:28.430038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8024a5f2-8c11-423a-99fb-95d6be417e67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:28.430773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8024a5f2-8c11-423a-99fb-95d6be417e67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:28.432013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8024a5f2-8c11-423a-99fb-95d6be417e67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:28.432709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8024a5f2-8c11-423a-99fb-95d6be417e67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:28.497474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8024a5f2-8c11-423a-99fb-95d6be417e67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:28.505761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8024a5f2-8c11-423a-99fb-95d6be417e67 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093884 Apr 11 20:07:28.506385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1249/2273] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:28.727804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:28.728806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:28.740353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:28.740989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:28.741755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:28.742185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:28.879693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:28.888949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:28.890459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:28.891634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42e10882-775f-4b10-bf52-4a499af3ef4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170407 Apr 11 20:07:28.892198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1025/2274] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:29.526958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a235bbef-3e7d-4047-8f7e-291c691ff2fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:29.527852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a235bbef-3e7d-4047-8f7e-291c691ff2fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:29.538508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a235bbef-3e7d-4047-8f7e-291c691ff2fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:29.539247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a235bbef-3e7d-4047-8f7e-291c691ff2fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:29.540471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a235bbef-3e7d-4047-8f7e-291c691ff2fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:29.541247 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a235bbef-3e7d-4047-8f7e-291c691ff2fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:29.616014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a235bbef-3e7d-4047-8f7e-291c691ff2fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:29.625068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a235bbef-3e7d-4047-8f7e-291c691ff2fe tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.104791 Apr 11 20:07:29.625640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1250/2275] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:29.910504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:29.911076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:29.918203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:29.918645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:29.919393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:29.919813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:30.054515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:30.068768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:30.070274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:30.071424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f8fbcfef-25c4-42a6-a5d4-a71f9601a4b6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165011 Apr 11 20:07:30.072005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1026/2276] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:30.643687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-81ce9534-8c9c-4899-bce0-6f3a2a69dbf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:30.644517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-81ce9534-8c9c-4899-bce0-6f3a2a69dbf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:30.653536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81ce9534-8c9c-4899-bce0-6f3a2a69dbf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:30.654130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81ce9534-8c9c-4899-bce0-6f3a2a69dbf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:30.655242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81ce9534-8c9c-4899-bce0-6f3a2a69dbf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:30.655799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81ce9534-8c9c-4899-bce0-6f3a2a69dbf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:30.716949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-81ce9534-8c9c-4899-bce0-6f3a2a69dbf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:30.724986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-81ce9534-8c9c-4899-bce0-6f3a2a69dbf2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086128 Apr 11 20:07:30.725545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1251/2277] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:31.093795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:31.094757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:31.105382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:31.106112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:31.107592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:31.108415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:31.242583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:31.256380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:31.257900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:31.259071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-554db4d8-17c5-4737-b82d-da70b97d8278 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171736 Apr 11 20:07:31.259674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1027/2278] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:31.743147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a5ef93e-1849-4335-b1be-e10537ec9eef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:31.743775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6a5ef93e-1849-4335-b1be-e10537ec9eef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:31.750579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a5ef93e-1849-4335-b1be-e10537ec9eef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:31.751034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a5ef93e-1849-4335-b1be-e10537ec9eef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:31.751786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a5ef93e-1849-4335-b1be-e10537ec9eef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:31.752198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a5ef93e-1849-4335-b1be-e10537ec9eef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:31.813128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a5ef93e-1849-4335-b1be-e10537ec9eef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:31.822784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6a5ef93e-1849-4335-b1be-e10537ec9eef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084114 Apr 11 20:07:31.823357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1252/2279] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:32.288041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:32.289068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:32.296733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:32.297284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:32.298163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:32.298663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:32.442726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:32.456207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:32.458617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:32.459997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-817a76f5-9178-4b3b-947a-209938197f1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.178687 Apr 11 20:07:32.460600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1028/2280] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:32.843922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e498611b-16e1-49d8-911b-6356e827e8ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:32.844786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e498611b-16e1-49d8-911b-6356e827e8ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:32.853361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e498611b-16e1-49d8-911b-6356e827e8ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:32.853802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e498611b-16e1-49d8-911b-6356e827e8ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:32.854546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e498611b-16e1-49d8-911b-6356e827e8ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:32.854971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e498611b-16e1-49d8-911b-6356e827e8ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:32.917245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e498611b-16e1-49d8-911b-6356e827e8ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:32.925237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e498611b-16e1-49d8-911b-6356e827e8ed tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087852 Apr 11 20:07:32.925794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1253/2281] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:33.482714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:33.483647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:33.494286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:33.495032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:33.496294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:33.497022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:33.643199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:33.655170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:33.657248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:33.658990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-62cc8888-fd20-4569-9d0b-f0a9dba74be5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.182652 Apr 11 20:07:33.659754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1029/2282] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:33.946175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e725c404-5b17-44ee-84af-726404e6f39b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:33.947164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e725c404-5b17-44ee-84af-726404e6f39b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:33.957819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e725c404-5b17-44ee-84af-726404e6f39b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:33.958552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e725c404-5b17-44ee-84af-726404e6f39b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:33.959686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e725c404-5b17-44ee-84af-726404e6f39b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:33.960108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e725c404-5b17-44ee-84af-726404e6f39b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:34.031993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e725c404-5b17-44ee-84af-726404e6f39b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:34.040115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e725c404-5b17-44ee-84af-726404e6f39b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.100456 Apr 11 20:07:34.040684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1254/2283] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:34.681637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:34.682399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:34.690998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:34.691581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:34.692577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:34.693192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:34.824940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:34.833882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:34.835434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:34.836584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-718b2408-3018-4220-bb5b-92cde8eeaf55 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.160807 Apr 11 20:07:34.837168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1030/2284] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:35.063435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-732eae6a-b171-46c5-9f4a-bad9ce87d9f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:35.064155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-732eae6a-b171-46c5-9f4a-bad9ce87d9f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:35.071841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-732eae6a-b171-46c5-9f4a-bad9ce87d9f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:35.072291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-732eae6a-b171-46c5-9f4a-bad9ce87d9f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:35.073105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-732eae6a-b171-46c5-9f4a-bad9ce87d9f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:35.073600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-732eae6a-b171-46c5-9f4a-bad9ce87d9f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:35.136363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-732eae6a-b171-46c5-9f4a-bad9ce87d9f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:35.145149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-732eae6a-b171-46c5-9f4a-bad9ce87d9f7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086563 Apr 11 20:07:35.145720 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1255/2285] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:35 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:35.859765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:35.860621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:35.871340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:35.872085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:35.873397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:35.874473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:36.011989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:36.020746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:36.022297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:36.023445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c8685653-172c-4ff8-86e4-4a96dde7fbb7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170441 Apr 11 20:07:36.024000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1031/2286] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:36.166351 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e8775cf-a800-4c5c-883d-51b508b25def tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:36.167254 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e8775cf-a800-4c5c-883d-51b508b25def tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:36.177630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e8775cf-a800-4c5c-883d-51b508b25def tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:36.178212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e8775cf-a800-4c5c-883d-51b508b25def tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:36.179007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e8775cf-a800-4c5c-883d-51b508b25def tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:36.179436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e8775cf-a800-4c5c-883d-51b508b25def tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:36.255197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e8775cf-a800-4c5c-883d-51b508b25def tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:36.268061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e8775cf-a800-4c5c-883d-51b508b25def tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.107892 Apr 11 20:07:36.268979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1256/2287] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:37.042282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:37.042893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:37.050004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:37.050458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:37.051213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:37.051648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:37.195821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:37.204225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:37.205737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:37.206894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1be8e186-bc4a-4f0c-8c55-3fd1f2666e1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168560 Apr 11 20:07:37.207452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1032/2288] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:37.289667 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f358cdfb-99b1-4e54-bea8-1766bc0fc5d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:37.290391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f358cdfb-99b1-4e54-bea8-1766bc0fc5d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:37.297881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f358cdfb-99b1-4e54-bea8-1766bc0fc5d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:37.298377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f358cdfb-99b1-4e54-bea8-1766bc0fc5d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:37.299261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f358cdfb-99b1-4e54-bea8-1766bc0fc5d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:37.299744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f358cdfb-99b1-4e54-bea8-1766bc0fc5d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:37.375106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f358cdfb-99b1-4e54-bea8-1766bc0fc5d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:37.383916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f358cdfb-99b1-4e54-bea8-1766bc0fc5d4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099682 Apr 11 20:07:37.385104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1257/2289] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:38.225650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:38.226293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:38.233012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:38.233450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:38.234210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:38.234635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:38.375412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:38.384365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:38.385914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:38.387075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d24b9e4-4fd6-44a3-8ed5-d49690fbbe24 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165442 Apr 11 20:07:38.387636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1033/2290] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:38.401741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee54b271-1774-41aa-b220-83fd07e98114 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:38.402371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee54b271-1774-41aa-b220-83fd07e98114 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:38.408963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee54b271-1774-41aa-b220-83fd07e98114 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:38.409432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee54b271-1774-41aa-b220-83fd07e98114 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:38.410184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee54b271-1774-41aa-b220-83fd07e98114 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:38.410608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee54b271-1774-41aa-b220-83fd07e98114 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:38.477145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee54b271-1774-41aa-b220-83fd07e98114 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:38.490330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee54b271-1774-41aa-b220-83fd07e98114 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092139 Apr 11 20:07:38.490914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1258/2291] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:39.410079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:39.411034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:39.421648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:39.422380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:39.423620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:39.424325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:39.507869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-566e664a-bd96-4773-b17a-ec228947686a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:39.508451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-566e664a-bd96-4773-b17a-ec228947686a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:39.514766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-566e664a-bd96-4773-b17a-ec228947686a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:39.515244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-566e664a-bd96-4773-b17a-ec228947686a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:39.516004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-566e664a-bd96-4773-b17a-ec228947686a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:39.516433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-566e664a-bd96-4773-b17a-ec228947686a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:39.570292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:39.578815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:39.580290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:39.581467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a7ce58a3-94aa-4879-a29b-870abe8191e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.177984 Apr 11 20:07:39.581995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1034/2292] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:39.585411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-566e664a-bd96-4773-b17a-ec228947686a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:39.593272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-566e664a-bd96-4773-b17a-ec228947686a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089423 Apr 11 20:07:39.593825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1259/2293] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:40.604035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:40.604879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:40.614555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ca94b5e8-2fee-4e23-8f67-de4d199df132 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:40.615556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ca94b5e8-2fee-4e23-8f67-de4d199df132 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:40.615689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:40.616035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:40.616807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:40.617267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:40.621928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca94b5e8-2fee-4e23-8f67-de4d199df132 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:40.622526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca94b5e8-2fee-4e23-8f67-de4d199df132 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:40.623355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca94b5e8-2fee-4e23-8f67-de4d199df132 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:40.624121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca94b5e8-2fee-4e23-8f67-de4d199df132 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:40.713831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ca94b5e8-2fee-4e23-8f67-de4d199df132 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:40.721551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ca94b5e8-2fee-4e23-8f67-de4d199df132 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.113384 Apr 11 20:07:40.722127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1260/2294] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:40.778708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:40.787494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:40.788991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:40.790145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-11dff9de-6a92-40e9-bb8f-cc6a68efbac0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.192871 Apr 11 20:07:40.790697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1035/2295] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:41.744225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-744727b0-b8e7-4a5b-99f0-d29a15dc8499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:41.744840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-744727b0-b8e7-4a5b-99f0-d29a15dc8499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:41.754579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-744727b0-b8e7-4a5b-99f0-d29a15dc8499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:41.755040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-744727b0-b8e7-4a5b-99f0-d29a15dc8499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:41.756323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-744727b0-b8e7-4a5b-99f0-d29a15dc8499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:41.756751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-744727b0-b8e7-4a5b-99f0-d29a15dc8499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:41.808330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:41.808963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:41.817589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:41.818741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:41.819531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:41.819964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:41.822849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-744727b0-b8e7-4a5b-99f0-d29a15dc8499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:41.831050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-744727b0-b8e7-4a5b-99f0-d29a15dc8499 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093107 Apr 11 20:07:41.831626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1261/2296] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:41.955789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:41.964291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:41.965812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:41.966978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb303afc-9489-44b8-b728-871d82dbb7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162892 Apr 11 20:07:41.967577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1036/2297] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:42.852634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5819695c-c0dc-4086-8088-1b49f8e014db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:42.853600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5819695c-c0dc-4086-8088-1b49f8e014db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:42.864127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5819695c-c0dc-4086-8088-1b49f8e014db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:42.864856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5819695c-c0dc-4086-8088-1b49f8e014db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:42.866038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5819695c-c0dc-4086-8088-1b49f8e014db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:42.866459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5819695c-c0dc-4086-8088-1b49f8e014db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:42.925863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5819695c-c0dc-4086-8088-1b49f8e014db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:42.933834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5819695c-c0dc-4086-8088-1b49f8e014db tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087568 Apr 11 20:07:42.934392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1262/2298] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:42.985481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:42.986093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:42.992793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:42.993279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:42.994039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:42.994470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:43.121400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:43.134650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:43.136963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:43.138808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cc343f38-ae75-41ed-9729-96128babb177 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.156981 Apr 11 20:07:43.139647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1037/2299] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:43.954547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4576f3c2-2356-4199-a482-f425955a5286 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:43.955488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4576f3c2-2356-4199-a482-f425955a5286 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:43.966085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4576f3c2-2356-4199-a482-f425955a5286 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:43.966813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4576f3c2-2356-4199-a482-f425955a5286 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:43.968050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4576f3c2-2356-4199-a482-f425955a5286 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:43.968746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4576f3c2-2356-4199-a482-f425955a5286 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:44.038260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4576f3c2-2356-4199-a482-f425955a5286 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:44.050578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4576f3c2-2356-4199-a482-f425955a5286 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.102081 Apr 11 20:07:44.051334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1263/2300] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:44.163646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:44.164449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:44.173192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:44.173757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:44.174800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:44.175379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:44.310564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:44.319361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:44.320828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:44.322016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1b96fbb-b5d0-4b86-acc0-c58adee48b7d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164810 Apr 11 20:07:44.322589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1038/2301] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:45.072085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-45d7d9e6-ff03-4815-a667-69de36f4be9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:45.073114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-45d7d9e6-ff03-4815-a667-69de36f4be9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:45.083778 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45d7d9e6-ff03-4815-a667-69de36f4be9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:45.084554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45d7d9e6-ff03-4815-a667-69de36f4be9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:45.085348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45d7d9e6-ff03-4815-a667-69de36f4be9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:45.085781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45d7d9e6-ff03-4815-a667-69de36f4be9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:45.156243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-45d7d9e6-ff03-4815-a667-69de36f4be9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:45.164892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-45d7d9e6-ff03-4815-a667-69de36f4be9a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099203 Apr 11 20:07:45.165504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1264/2302] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:45.345053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:45.346153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:45.356729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:45.357520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:45.358768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:45.359482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:45.497006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:45.509576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:45.511060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:45.512199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-38b0679b-2408-4c0e-88fe-51e268b90704 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.174674 Apr 11 20:07:45.512754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1039/2303] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:46.183155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-306b86b5-439a-4674-b529-664af609b7ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:46.183868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-306b86b5-439a-4674-b529-664af609b7ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:46.190761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306b86b5-439a-4674-b529-664af609b7ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:46.191226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306b86b5-439a-4674-b529-664af609b7ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:46.192014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306b86b5-439a-4674-b529-664af609b7ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:46.192466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306b86b5-439a-4674-b529-664af609b7ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:46.253894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-306b86b5-439a-4674-b529-664af609b7ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:46.262227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-306b86b5-439a-4674-b529-664af609b7ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083158 Apr 11 20:07:46.262793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1265/2304] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:46.538823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:46.539486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:46.547531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:46.548080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:46.549048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:46.549581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:46.680223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:46.689292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:46.690762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:46.691908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a913cce3-2969-49c3-b654-01f7e7b1b7ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159662 Apr 11 20:07:46.692462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1040/2305] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:47.282958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83e2364a-7a6a-4809-b388-8a7a58744f2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:47.283549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83e2364a-7a6a-4809-b388-8a7a58744f2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:47.291877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e2364a-7a6a-4809-b388-8a7a58744f2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:47.292325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e2364a-7a6a-4809-b388-8a7a58744f2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:47.293127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e2364a-7a6a-4809-b388-8a7a58744f2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:47.293560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e2364a-7a6a-4809-b388-8a7a58744f2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:47.361896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83e2364a-7a6a-4809-b388-8a7a58744f2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:47.370316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83e2364a-7a6a-4809-b388-8a7a58744f2d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093398 Apr 11 20:07:47.370881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1266/2306] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:47.596631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:07:47.596894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:07:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:07:47.719976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:47.720940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:47.729625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:47.730087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:47.730824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:47.731252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:47.858527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:47.866735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:47.868200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:47.869513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-17859e73-1f15-4652-8190-0b2c1bd05ae2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.156210 Apr 11 20:07:47.870073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1041/2307] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:48.391611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3e42d48c-737b-4c42-8a60-b4b07de12a85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:48.392615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3e42d48c-737b-4c42-8a60-b4b07de12a85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:48.400864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e42d48c-737b-4c42-8a60-b4b07de12a85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:48.401329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e42d48c-737b-4c42-8a60-b4b07de12a85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:48.402016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e42d48c-737b-4c42-8a60-b4b07de12a85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:48.402441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e42d48c-737b-4c42-8a60-b4b07de12a85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:48.462948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3e42d48c-737b-4c42-8a60-b4b07de12a85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:48.470883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3e42d48c-737b-4c42-8a60-b4b07de12a85 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085786 Apr 11 20:07:48.471459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1267/2308] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:48.892565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:48.893480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:48.901490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:48.901943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:48.902694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:48.903126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:49.055327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:49.064387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:49.065900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:49.067067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae15aca9-d039-46b1-aafd-bafde7e31adb tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.181271 Apr 11 20:07:49.067628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1042/2309] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:49.492086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c718b8b3-7ec6-4ae5-9d0f-f26365a200ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:49.493026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c718b8b3-7ec6-4ae5-9d0f-f26365a200ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:49.503953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c718b8b3-7ec6-4ae5-9d0f-f26365a200ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:49.504686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c718b8b3-7ec6-4ae5-9d0f-f26365a200ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:49.506108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c718b8b3-7ec6-4ae5-9d0f-f26365a200ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:49.506542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c718b8b3-7ec6-4ae5-9d0f-f26365a200ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:49.575245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c718b8b3-7ec6-4ae5-9d0f-f26365a200ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:49.586540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c718b8b3-7ec6-4ae5-9d0f-f26365a200ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.101005 Apr 11 20:07:49.587161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1268/2310] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:50.089794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:50.090783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:50.101045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:50.101495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:50.102251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:50.102685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:50.238085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:50.246922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:50.248398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:50.249926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3613f160-7131-4998-a7a8-588d0310d475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166828 Apr 11 20:07:50.250486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1043/2311] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:50.607842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27eecdcb-1df1-475a-a3f5-e4e45cc34747 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:50.608869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27eecdcb-1df1-475a-a3f5-e4e45cc34747 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:50.618052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27eecdcb-1df1-475a-a3f5-e4e45cc34747 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:50.618496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27eecdcb-1df1-475a-a3f5-e4e45cc34747 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:50.619241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27eecdcb-1df1-475a-a3f5-e4e45cc34747 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:50.619693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27eecdcb-1df1-475a-a3f5-e4e45cc34747 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:50.681951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27eecdcb-1df1-475a-a3f5-e4e45cc34747 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:50.690630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27eecdcb-1df1-475a-a3f5-e4e45cc34747 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089419 Apr 11 20:07:50.691198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1269/2312] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:51.272463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:51.273085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:51.280621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:51.281158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:51.282023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:51.282493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:51.421689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:51.431656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:51.433195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:51.434352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-35953b01-2f6a-47dd-9544-8b11d7013f6a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168386 Apr 11 20:07:51.434911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1044/2313] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:51.711401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4fdfb93c-05c5-43f8-b2af-1fc8cdceb689 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:51.712816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4fdfb93c-05c5-43f8-b2af-1fc8cdceb689 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:51.722939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fdfb93c-05c5-43f8-b2af-1fc8cdceb689 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:51.723675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fdfb93c-05c5-43f8-b2af-1fc8cdceb689 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:51.724960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fdfb93c-05c5-43f8-b2af-1fc8cdceb689 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:51.725391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fdfb93c-05c5-43f8-b2af-1fc8cdceb689 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:51.794631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4fdfb93c-05c5-43f8-b2af-1fc8cdceb689 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:51.803192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4fdfb93c-05c5-43f8-b2af-1fc8cdceb689 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.098050 Apr 11 20:07:51.803730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1270/2314] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:52.457299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:52.458136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:52.468726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:52.469517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:52.470772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:52.471492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:52.609258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:52.618495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:52.619975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:52.621167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-292107d6-fb0b-442d-8b8b-2e9e4775e0fe tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170626 Apr 11 20:07:52.621696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1045/2315] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:52.829038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3bb1b62b-0824-40bf-be3d-32343a9e5742 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:52.829896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3bb1b62b-0824-40bf-be3d-32343a9e5742 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:52.838129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bb1b62b-0824-40bf-be3d-32343a9e5742 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:52.838574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bb1b62b-0824-40bf-be3d-32343a9e5742 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:52.839320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bb1b62b-0824-40bf-be3d-32343a9e5742 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:52.839741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bb1b62b-0824-40bf-be3d-32343a9e5742 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:52.909298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3bb1b62b-0824-40bf-be3d-32343a9e5742 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:52.917542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3bb1b62b-0824-40bf-be3d-32343a9e5742 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095031 Apr 11 20:07:52.918103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1271/2316] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:53.644117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:53.645111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:53.652328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:53.652776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:53.653566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:53.653995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:53.796853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:53.807338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:53.809581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:53.811331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e21a06ab-f911-4365-85f9-b1e0cd86cc30 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.173782 Apr 11 20:07:53.812080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1046/2317] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:53.941677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73649683-2187-42cf-8e2d-090447da69c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:53.942684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73649683-2187-42cf-8e2d-090447da69c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:53.950829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73649683-2187-42cf-8e2d-090447da69c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:53.951382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73649683-2187-42cf-8e2d-090447da69c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:53.952498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73649683-2187-42cf-8e2d-090447da69c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:53.953184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73649683-2187-42cf-8e2d-090447da69c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:54.024210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73649683-2187-42cf-8e2d-090447da69c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:54.032395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73649683-2187-42cf-8e2d-090447da69c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097142 Apr 11 20:07:54.032989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1272/2318] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:54.833591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:54.834671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:54.842734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:54.843271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:54.844176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:54.844691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:55.049859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-018a0a5c-d9e5-49ac-8f25-171c328f039e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:55.050496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-018a0a5c-d9e5-49ac-8f25-171c328f039e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:55.057411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-018a0a5c-d9e5-49ac-8f25-171c328f039e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:55.057862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-018a0a5c-d9e5-49ac-8f25-171c328f039e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:55.058632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-018a0a5c-d9e5-49ac-8f25-171c328f039e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:55.059063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-018a0a5c-d9e5-49ac-8f25-171c328f039e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:55.144146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-018a0a5c-d9e5-49ac-8f25-171c328f039e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:55.152662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-018a0a5c-d9e5-49ac-8f25-171c328f039e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.106669 Apr 11 20:07:55.153256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1273/2319] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:55.202580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:55.215850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:55.217996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:55.219756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dded664c-73e7-46f8-b4f8-f32807d05e3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.392623 Apr 11 20:07:55.220595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1047/2320] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:56.169369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07110d23-03da-4aa7-b2d6-ff9aba518690 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:56.169971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07110d23-03da-4aa7-b2d6-ff9aba518690 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:56.177134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07110d23-03da-4aa7-b2d6-ff9aba518690 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:56.177579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07110d23-03da-4aa7-b2d6-ff9aba518690 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:56.178428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07110d23-03da-4aa7-b2d6-ff9aba518690 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:56.178868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07110d23-03da-4aa7-b2d6-ff9aba518690 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:56.240081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:56.240667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:56.243208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07110d23-03da-4aa7-b2d6-ff9aba518690 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:56.247058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:56.247575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:56.248415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:56.249274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:56.251328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07110d23-03da-4aa7-b2d6-ff9aba518690 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086091 Apr 11 20:07:56.260958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1274/2321] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:56 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:56.388335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:56.397074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:56.398550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:56.399705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-adcc0a59-69db-4dac-88cc-09dd9f5202ef tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.163838 Apr 11 20:07:56.400237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1048/2322] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:07:57.272229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91d6348d-f6ed-4460-b413-c159cce6343e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:57.272755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91d6348d-f6ed-4460-b413-c159cce6343e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:57.279840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d6348d-f6ed-4460-b413-c159cce6343e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:57.280347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d6348d-f6ed-4460-b413-c159cce6343e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:57.281186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d6348d-f6ed-4460-b413-c159cce6343e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:57.281640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d6348d-f6ed-4460-b413-c159cce6343e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:57.342541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91d6348d-f6ed-4460-b413-c159cce6343e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:57.350603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91d6348d-f6ed-4460-b413-c159cce6343e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084907 Apr 11 20:07:57.351167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1275/2323] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:57.422007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:57.422963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:57.431463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:57.431906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:57.432652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:57.433111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:57.568364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:57.577378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:57.578847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:57.580209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1c4c1830-7222-471f-8fc9-437cdb6f30d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164647 Apr 11 20:07:57.580764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1049/2324] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:58.370965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b708396-ad51-4ab0-8ef4-7a6ba5f96c39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:58.372012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b708396-ad51-4ab0-8ef4-7a6ba5f96c39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:58.382176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b708396-ad51-4ab0-8ef4-7a6ba5f96c39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:58.382613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b708396-ad51-4ab0-8ef4-7a6ba5f96c39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:58.383354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b708396-ad51-4ab0-8ef4-7a6ba5f96c39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:58.383781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b708396-ad51-4ab0-8ef4-7a6ba5f96c39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:58.455938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b708396-ad51-4ab0-8ef4-7a6ba5f96c39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:58.468439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b708396-ad51-4ab0-8ef4-7a6ba5f96c39 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.103797 Apr 11 20:07:58.469528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1276/2325] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:58.602919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:58.603897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:58.614546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:58.615294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:58.616544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:58.617330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:58.742315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:58.751603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:58.753105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:58.754260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c87a9733-c6e7-42d7-8e62-84c831a7c841 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.157957 Apr 11 20:07:58.754819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1050/2326] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:07:59.491819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e1bdab89-f2d5-45a8-98b2-664f699f3067 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:59.492751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e1bdab89-f2d5-45a8-98b2-664f699f3067 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:59.503331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1bdab89-f2d5-45a8-98b2-664f699f3067 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:59.503895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1bdab89-f2d5-45a8-98b2-664f699f3067 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:59.504843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1bdab89-f2d5-45a8-98b2-664f699f3067 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:59.505419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1bdab89-f2d5-45a8-98b2-664f699f3067 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:59.574406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e1bdab89-f2d5-45a8-98b2-664f699f3067 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:59.582391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e1bdab89-f2d5-45a8-98b2-664f699f3067 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097149 Apr 11 20:07:59.582957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1277/2327] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:07:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:07:59.774745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:07:59.775473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:07:59.784124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:59.784722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:59.785770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:07:59.786345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:07:59.914335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:59.923333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:59.924812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:07:59.925970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-191fcda4-4a08-428b-8198-5404c036da91 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.157343 Apr 11 20:07:59.926565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1051/2328] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:07:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:00.603464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2d522825-c72f-4534-a87d-8b746d5edf53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:00.604334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2d522825-c72f-4534-a87d-8b746d5edf53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:00.614968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d522825-c72f-4534-a87d-8b746d5edf53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:00.615707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d522825-c72f-4534-a87d-8b746d5edf53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:00.617005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d522825-c72f-4534-a87d-8b746d5edf53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:00.617673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d522825-c72f-4534-a87d-8b746d5edf53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:00.685022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2d522825-c72f-4534-a87d-8b746d5edf53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:00.692980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2d522825-c72f-4534-a87d-8b746d5edf53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096502 Apr 11 20:08:00.693522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1278/2329] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:00.947618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:00.948547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:00.958652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:00.959451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:00.960860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:00.961337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:01.099139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:01.107820 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:01.109347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:01.110504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-983bf80e-7593-4b92-a982-b672fec50efd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169397 Apr 11 20:08:01.111066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1052/2330] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:01.713069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53517b09-6790-4db7-8715-39f1e06b24e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:01.713894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53517b09-6790-4db7-8715-39f1e06b24e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:01.721434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53517b09-6790-4db7-8715-39f1e06b24e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:01.721939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53517b09-6790-4db7-8715-39f1e06b24e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:01.722870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53517b09-6790-4db7-8715-39f1e06b24e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:01.723533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53517b09-6790-4db7-8715-39f1e06b24e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:01.787265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-53517b09-6790-4db7-8715-39f1e06b24e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:01.795756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53517b09-6790-4db7-8715-39f1e06b24e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088484 Apr 11 20:08:01.796324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1279/2331] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:02.133499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:02.134071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:02.141186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:02.141637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:02.142396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:02.142830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:02.271697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:02.280953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:02.282467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:02.283660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c50a6a9-b769-4199-b423-e3ce3775aa09 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.156805 Apr 11 20:08:02.284220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1053/2332] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:02.819575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7d272968-9edf-419c-a8d3-bbbca88a607b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:02.820477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7d272968-9edf-419c-a8d3-bbbca88a607b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:02.827184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d272968-9edf-419c-a8d3-bbbca88a607b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:02.827626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d272968-9edf-419c-a8d3-bbbca88a607b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:02.828378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d272968-9edf-419c-a8d3-bbbca88a607b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:02.828803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d272968-9edf-419c-a8d3-bbbca88a607b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:02.896055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7d272968-9edf-419c-a8d3-bbbca88a607b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:02.904823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7d272968-9edf-419c-a8d3-bbbca88a607b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091619 Apr 11 20:08:02.905430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1280/2333] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:03.305394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:03.306010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:03.312633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:03.313120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:03.313878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:03.314313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:03.441442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:03.449881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:03.451398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:03.452551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-045cc4eb-6cac-4e80-a838-d92eea3d8239 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.153037 Apr 11 20:08:03.453107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1054/2334] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:03.929495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cef7a911-29db-4270-bab3-20f585d50c7d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:03.930511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cef7a911-29db-4270-bab3-20f585d50c7d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:03.941155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cef7a911-29db-4270-bab3-20f585d50c7d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:03.941913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cef7a911-29db-4270-bab3-20f585d50c7d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:03.943157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cef7a911-29db-4270-bab3-20f585d50c7d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:03.943877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cef7a911-29db-4270-bab3-20f585d50c7d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:04.012888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cef7a911-29db-4270-bab3-20f585d50c7d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:04.021132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cef7a911-29db-4270-bab3-20f585d50c7d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.098210 Apr 11 20:08:04.021689 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1281/2335] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:04.475327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:04.476325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:04.483633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:04.484130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:04.485063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:04.485539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:04.631123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:04.643972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:04.646392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:04.648152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19896141-875f-42ea-9389-6d4505bd99a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179317 Apr 11 20:08:04.648782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1055/2336] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:05.041807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3b7af333-1f7f-482c-82fd-4940e812239b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:05.042606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3b7af333-1f7f-482c-82fd-4940e812239b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:05.051268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b7af333-1f7f-482c-82fd-4940e812239b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:05.051905 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b7af333-1f7f-482c-82fd-4940e812239b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:05.052952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b7af333-1f7f-482c-82fd-4940e812239b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:05.053519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b7af333-1f7f-482c-82fd-4940e812239b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:05.121893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3b7af333-1f7f-482c-82fd-4940e812239b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:05.130284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3b7af333-1f7f-482c-82fd-4940e812239b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094555 Apr 11 20:08:05.130847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1282/2337] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:05.670651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:05.672326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:05.682965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:05.683707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:05.684988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:05.685720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:05.819754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:05.828573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:05.830032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:05.831199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1a9b755-4310-42a3-a148-3cff21611da8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.167243 Apr 11 20:08:05.831762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1056/2338] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:06.150520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b39368f-b5fe-4763-9162-a8d60629a682 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:06.151255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b39368f-b5fe-4763-9162-a8d60629a682 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:06.159756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b39368f-b5fe-4763-9162-a8d60629a682 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:06.160324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b39368f-b5fe-4763-9162-a8d60629a682 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:06.161417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b39368f-b5fe-4763-9162-a8d60629a682 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:06.161989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b39368f-b5fe-4763-9162-a8d60629a682 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:06.231684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0b39368f-b5fe-4763-9162-a8d60629a682 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:06.241499 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b39368f-b5fe-4763-9162-a8d60629a682 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096935 Apr 11 20:08:06.242195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1283/2339] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:06 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:06.849405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:06.850043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:06.856683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:06.857172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:06.857969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:06.858409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:06.997572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:07.006235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:07.007763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:07.008940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-84feea76-a28b-4719-9361-317b4f20b7c3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.163479 Apr 11 20:08:07.009580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1057/2340] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:07.263015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f3cec85-722d-4c45-8937-097844bd3b63 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:07.264020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f3cec85-722d-4c45-8937-097844bd3b63 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:07.274624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3cec85-722d-4c45-8937-097844bd3b63 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:07.275360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3cec85-722d-4c45-8937-097844bd3b63 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:07.276594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3cec85-722d-4c45-8937-097844bd3b63 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:07.277358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3cec85-722d-4c45-8937-097844bd3b63 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:07.347982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f3cec85-722d-4c45-8937-097844bd3b63 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:07.356416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f3cec85-722d-4c45-8937-097844bd3b63 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099876 Apr 11 20:08:07.357011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1284/2341] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:08.027431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:08.028070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:08.034962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:08.035413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:08.036170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:08.036606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:08.169123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:08.180534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:08.182182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:08.183467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a82ad999-3771-44c2-b45c-5e31e1da85a6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.160001 Apr 11 20:08:08.184396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1058/2342] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:08.377831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-79cb733f-6395-4f3c-8c68-1fc9ee1f10ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:08.378719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-79cb733f-6395-4f3c-8c68-1fc9ee1f10ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:08.389443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79cb733f-6395-4f3c-8c68-1fc9ee1f10ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:08.390173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79cb733f-6395-4f3c-8c68-1fc9ee1f10ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:08.391408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79cb733f-6395-4f3c-8c68-1fc9ee1f10ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:08.392150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79cb733f-6395-4f3c-8c68-1fc9ee1f10ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:08.456257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-79cb733f-6395-4f3c-8c68-1fc9ee1f10ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:08.464294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-79cb733f-6395-4f3c-8c68-1fc9ee1f10ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093444 Apr 11 20:08:08.464862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1285/2343] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:09.203300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:09.204048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:09.211413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:09.211857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:09.212646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:09.213112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:09.350781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:09.359155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:09.360647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:09.361840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5b4ccff4-007a-46fe-bb61-43209381a416 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162947 Apr 11 20:08:09.362396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1059/2344] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:09.485431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-10b70ad6-68f8-4322-9ea7-096cf1c6b858 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:09.486303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-10b70ad6-68f8-4322-9ea7-096cf1c6b858 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:09.497204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10b70ad6-68f8-4322-9ea7-096cf1c6b858 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:09.497961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10b70ad6-68f8-4322-9ea7-096cf1c6b858 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:09.499559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10b70ad6-68f8-4322-9ea7-096cf1c6b858 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:09.500273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10b70ad6-68f8-4322-9ea7-096cf1c6b858 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:09.566659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-10b70ad6-68f8-4322-9ea7-096cf1c6b858 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:09.574954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-10b70ad6-68f8-4322-9ea7-096cf1c6b858 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096100 Apr 11 20:08:09.575513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1286/2345] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:10.384677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:10.385754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:10.396318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:10.397153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:10.398506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:10.399225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:10.542699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:10.555122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:10.556598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:10.557833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-106b86b8-1aaa-4966-8d38-a82f4fdbe8ca tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179791 Apr 11 20:08:10.558389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1060/2346] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:10.591898 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-df8a80f7-76c8-415f-97d9-ed566bd91df6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:10.592504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-df8a80f7-76c8-415f-97d9-ed566bd91df6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:10.599234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df8a80f7-76c8-415f-97d9-ed566bd91df6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:10.599677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df8a80f7-76c8-415f-97d9-ed566bd91df6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:10.600427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df8a80f7-76c8-415f-97d9-ed566bd91df6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:10.600852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df8a80f7-76c8-415f-97d9-ed566bd91df6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:10.667261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-df8a80f7-76c8-415f-97d9-ed566bd91df6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:10.675833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-df8a80f7-76c8-415f-97d9-ed566bd91df6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087675 Apr 11 20:08:10.676407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1287/2347] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:11.581223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:11.582236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:11.590139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:11.590581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:11.591334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:11.591759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:11.693363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d259109c-44b5-493e-91ee-f194b2608232 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:11.694051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d259109c-44b5-493e-91ee-f194b2608232 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:11.700782 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d259109c-44b5-493e-91ee-f194b2608232 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:11.701326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d259109c-44b5-493e-91ee-f194b2608232 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:11.702172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d259109c-44b5-493e-91ee-f194b2608232 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:11.702665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d259109c-44b5-493e-91ee-f194b2608232 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:11.730398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:11.739267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:11.740734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:11.742009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56c3a501-c04b-474c-b288-71aeefa3b333 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.167415 Apr 11 20:08:11.745111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1061/2348] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:11.766405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d259109c-44b5-493e-91ee-f194b2608232 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:11.774203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d259109c-44b5-493e-91ee-f194b2608232 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084692 Apr 11 20:08:11.774741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1288/2349] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:12.764970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:12.766044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:12.775382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:12.775824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:12.776580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:12.777036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:12.791399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-06b3445c-5847-44c6-9615-78c2bd960bc2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:12.792103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-06b3445c-5847-44c6-9615-78c2bd960bc2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:12.798975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06b3445c-5847-44c6-9615-78c2bd960bc2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:12.799431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06b3445c-5847-44c6-9615-78c2bd960bc2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:12.800223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06b3445c-5847-44c6-9615-78c2bd960bc2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:12.800668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06b3445c-5847-44c6-9615-78c2bd960bc2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:12.872556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-06b3445c-5847-44c6-9615-78c2bd960bc2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:12.881377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-06b3445c-5847-44c6-9615-78c2bd960bc2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093955 Apr 11 20:08:12.881939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1289/2350] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:12.931088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:12.939684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:12.941199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:12.942358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8e2621b6-e9ab-4832-81cf-a9acfb8c4ff5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.183789 Apr 11 20:08:12.942913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1062/2351] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:13.902544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7798bf88-ef25-48da-9735-c43523afbaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:13.903517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7798bf88-ef25-48da-9735-c43523afbaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:13.914079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7798bf88-ef25-48da-9735-c43523afbaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:13.914548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7798bf88-ef25-48da-9735-c43523afbaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:13.915306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7798bf88-ef25-48da-9735-c43523afbaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:13.915734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7798bf88-ef25-48da-9735-c43523afbaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:13.965287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:13.965887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:13.972372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:13.972829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:13.973656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:13.974023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:13.975805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7798bf88-ef25-48da-9735-c43523afbaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:13.983968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7798bf88-ef25-48da-9735-c43523afbaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087950 Apr 11 20:08:13.984518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1290/2352] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:14.109569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:14.122802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:14.125531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:14.127302 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5b7e697-5a1f-4117-ab1c-5dd6a0bd807e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165727 Apr 11 20:08:14.128030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1063/2353] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:08:15.005664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac5f5023-191a-4b2a-871d-e981f41befb5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:15.006670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac5f5023-191a-4b2a-871d-e981f41befb5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:15.017269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac5f5023-191a-4b2a-871d-e981f41befb5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:15.018008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac5f5023-191a-4b2a-871d-e981f41befb5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:15.019264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac5f5023-191a-4b2a-871d-e981f41befb5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:15.019979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac5f5023-191a-4b2a-871d-e981f41befb5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:15.086927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ac5f5023-191a-4b2a-871d-e981f41befb5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:15.095013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac5f5023-191a-4b2a-871d-e981f41befb5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096175 Apr 11 20:08:15.095608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1291/2354] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:15.147343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:15.147950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:15.154485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:15.154935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:15.155686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:15.156116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:15.286915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:15.295947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:15.297457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:15.298602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f5ace3f0-cbde-439e-a0ce-e57fb7624371 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.155147 Apr 11 20:08:15.299159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1064/2355] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:16.116256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a8361f19-db6e-4ed6-9bfd-4c6d866784e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:16.117407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a8361f19-db6e-4ed6-9bfd-4c6d866784e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:16.124523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8361f19-db6e-4ed6-9bfd-4c6d866784e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:16.125007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8361f19-db6e-4ed6-9bfd-4c6d866784e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:16.125758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8361f19-db6e-4ed6-9bfd-4c6d866784e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:16.126197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8361f19-db6e-4ed6-9bfd-4c6d866784e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:16.190966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a8361f19-db6e-4ed6-9bfd-4c6d866784e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:16.201166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a8361f19-db6e-4ed6-9bfd-4c6d866784e3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091369 Apr 11 20:08:16.201739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1292/2356] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:16.322166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:16.322758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:16.330034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:16.330523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:16.331355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:16.331823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:16.469110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:16.477940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:16.479434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:16.480610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a617791c-8907-4b3a-8d3a-1545dfdd09cc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164613 Apr 11 20:08:16.481193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1065/2357] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:17.218466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-103b5164-46cf-4ae6-a406-4404002736ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:17.218987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-103b5164-46cf-4ae6-a406-4404002736ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:17.225707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-103b5164-46cf-4ae6-a406-4404002736ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:17.226150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-103b5164-46cf-4ae6-a406-4404002736ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:17.227021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-103b5164-46cf-4ae6-a406-4404002736ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:17.227443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-103b5164-46cf-4ae6-a406-4404002736ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:17.289357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-103b5164-46cf-4ae6-a406-4404002736ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:17.297549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-103b5164-46cf-4ae6-a406-4404002736ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083132 Apr 11 20:08:17.298109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1293/2358] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:17.506939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:17.507801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:17.518486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:17.519231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:17.520472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:17.521251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:17.653683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:17.662660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:17.664141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:17.665374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ae6affa-70c1-4a2c-b800-1eb60d5d4583 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165200 Apr 11 20:08:17.665937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1066/2359] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:18.318631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6fc8b568-549e-45b2-8ba2-71dc511d3cbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:18.319610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6fc8b568-549e-45b2-8ba2-71dc511d3cbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:18.330557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fc8b568-549e-45b2-8ba2-71dc511d3cbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:18.331289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fc8b568-549e-45b2-8ba2-71dc511d3cbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:18.332543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fc8b568-549e-45b2-8ba2-71dc511d3cbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:18.333308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fc8b568-549e-45b2-8ba2-71dc511d3cbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:18.399611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6fc8b568-549e-45b2-8ba2-71dc511d3cbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:18.407534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6fc8b568-549e-45b2-8ba2-71dc511d3cbc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095384 Apr 11 20:08:18.408090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1294/2360] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:18.692562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:18.693571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:18.701236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:18.701680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:18.702441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:18.702864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:18.837878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:18.846663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:18.848177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:18.849364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e87fe460-6237-4372-bd13-abb204206fbf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.163202 Apr 11 20:08:18.849896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1067/2361] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:19.430423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2322baab-9674-4c50-9a0a-dd2f7a057ec3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:19.431432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2322baab-9674-4c50-9a0a-dd2f7a057ec3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:19.444211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2322baab-9674-4c50-9a0a-dd2f7a057ec3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:19.444960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2322baab-9674-4c50-9a0a-dd2f7a057ec3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:19.446107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2322baab-9674-4c50-9a0a-dd2f7a057ec3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:19.446527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2322baab-9674-4c50-9a0a-dd2f7a057ec3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:19.516790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2322baab-9674-4c50-9a0a-dd2f7a057ec3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:19.527282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2322baab-9674-4c50-9a0a-dd2f7a057ec3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.103722 Apr 11 20:08:19.527851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1295/2362] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:19.871952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:19.872866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:19.883683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:19.884125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:19.884876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:19.885330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:20.029172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:20.037945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:20.039417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:20.040678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0dc0132-4884-4544-9cc3-ad2756bb2c62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.175442 Apr 11 20:08:20.041245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1068/2363] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:20.549244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c46cef29-bafb-4e50-a493-7daccbaa2331 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:20.550172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c46cef29-bafb-4e50-a493-7daccbaa2331 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:20.558775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c46cef29-bafb-4e50-a493-7daccbaa2331 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:20.559222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c46cef29-bafb-4e50-a493-7daccbaa2331 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:20.560019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c46cef29-bafb-4e50-a493-7daccbaa2331 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:20.560442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c46cef29-bafb-4e50-a493-7daccbaa2331 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:20.620376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c46cef29-bafb-4e50-a493-7daccbaa2331 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:20.629091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c46cef29-bafb-4e50-a493-7daccbaa2331 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086351 Apr 11 20:08:20.629663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1296/2364] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:21.063228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:21.064257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:21.074892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:21.075643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:21.076960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:21.077672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:21.368596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:21.377249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:21.378731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:21.379889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7fe126c8-7eda-4497-b6d4-f56b17269c26 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.323297 Apr 11 20:08:21.380449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1069/2365] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:21.650113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da981bf0-d145-43ef-8025-b38df619ea34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:21.650988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da981bf0-d145-43ef-8025-b38df619ea34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:21.661858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da981bf0-d145-43ef-8025-b38df619ea34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:21.662607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da981bf0-d145-43ef-8025-b38df619ea34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:21.664051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da981bf0-d145-43ef-8025-b38df619ea34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:21.664804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da981bf0-d145-43ef-8025-b38df619ea34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:21.731254 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da981bf0-d145-43ef-8025-b38df619ea34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:21.743353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da981bf0-d145-43ef-8025-b38df619ea34 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099719 Apr 11 20:08:21.743918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1297/2366] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:22.403581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:22.404569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:22.414992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:22.415437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:22.416196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:22.416628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:22.550658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:22.558980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:22.560448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:22.561618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc07ac48-e616-43a1-992d-ee95da3bee16 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164782 Apr 11 20:08:22.562159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1070/2367] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:22.766150 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5eefad5-7385-4cdf-bc51-206b001fbaee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:22.767000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5eefad5-7385-4cdf-bc51-206b001fbaee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:22.776536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eefad5-7385-4cdf-bc51-206b001fbaee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:22.777184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eefad5-7385-4cdf-bc51-206b001fbaee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:22.778030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eefad5-7385-4cdf-bc51-206b001fbaee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:22.778459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5eefad5-7385-4cdf-bc51-206b001fbaee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:22.838947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5eefad5-7385-4cdf-bc51-206b001fbaee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:22.846916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5eefad5-7385-4cdf-bc51-206b001fbaee tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087324 Apr 11 20:08:22.847478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1298/2368] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:23.580357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:23.580999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:23.588298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:23.588745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:23.589538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:23.589971 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:23.724097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:23.733243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:23.734729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:23.735892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e4d26d57-b86d-4b2f-8527-6d28480d4221 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159602 Apr 11 20:08:23.736440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1071/2369] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:23.865219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-57f03f4a-483e-4541-a79d-b6618ad13534 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:23.865855 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-57f03f4a-483e-4541-a79d-b6618ad13534 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:23.872274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57f03f4a-483e-4541-a79d-b6618ad13534 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:23.872730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57f03f4a-483e-4541-a79d-b6618ad13534 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:23.873846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57f03f4a-483e-4541-a79d-b6618ad13534 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:23.874283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57f03f4a-483e-4541-a79d-b6618ad13534 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:23.938404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-57f03f4a-483e-4541-a79d-b6618ad13534 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:23.947049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-57f03f4a-483e-4541-a79d-b6618ad13534 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085981 Apr 11 20:08:23.947619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1299/2370] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:24.759009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:24.759909 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:24.770675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:24.771412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:24.772665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:24.773439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:24.905788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:24.914646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:24.916156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:24.917360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a9f87fd3-ee8c-4f03-9404-e0ee87068de1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165040 Apr 11 20:08:24.917916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1072/2371] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:24.965424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-258e0fee-db20-4a77-af42-7318b70ff5e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:24.966363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-258e0fee-db20-4a77-af42-7318b70ff5e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:24.975809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-258e0fee-db20-4a77-af42-7318b70ff5e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:24.976447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-258e0fee-db20-4a77-af42-7318b70ff5e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:24.977647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-258e0fee-db20-4a77-af42-7318b70ff5e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:24.978240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-258e0fee-db20-4a77-af42-7318b70ff5e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:25.046234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-258e0fee-db20-4a77-af42-7318b70ff5e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:25.054325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-258e0fee-db20-4a77-af42-7318b70ff5e4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094102 Apr 11 20:08:25.054885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1300/2372] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:25.939712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:25.940776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:25.949344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:25.949792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:25.950548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:25.950978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:26.071726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e9b7d2b1-fe68-4428-a6f3-12aec24cddb8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:26.072324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e9b7d2b1-fe68-4428-a6f3-12aec24cddb8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:26.078778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:26.079288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9b7d2b1-fe68-4428-a6f3-12aec24cddb8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:26.079735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9b7d2b1-fe68-4428-a6f3-12aec24cddb8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:26.080603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9b7d2b1-fe68-4428-a6f3-12aec24cddb8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:26.081067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9b7d2b1-fe68-4428-a6f3-12aec24cddb8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:26.087670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:26.089182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:26.090347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4065f221-48e0-456b-a1fb-828325faabe7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.157215 Apr 11 20:08:26.090899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1073/2373] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:26.142424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e9b7d2b1-fe68-4428-a6f3-12aec24cddb8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:26.151456 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e9b7d2b1-fe68-4428-a6f3-12aec24cddb8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083409 Apr 11 20:08:26.151663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1301/2374] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:27.108452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:27.109072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:27.116074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:27.116522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:27.117317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:27.117798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:27.168112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a8a8c97e-a623-4507-a2d7-baa355c63bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:27.168846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a8a8c97e-a623-4507-a2d7-baa355c63bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:27.175166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8a8c97e-a623-4507-a2d7-baa355c63bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:27.175604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8a8c97e-a623-4507-a2d7-baa355c63bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:27.176363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8a8c97e-a623-4507-a2d7-baa355c63bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:27.176787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8a8c97e-a623-4507-a2d7-baa355c63bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:27.248274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a8a8c97e-a623-4507-a2d7-baa355c63bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:27.256685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a8a8c97e-a623-4507-a2d7-baa355c63bf6 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092785 Apr 11 20:08:27.257267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1302/2375] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:27.272981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:27.282185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:27.283670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:27.284840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5d121ce1-48b4-4954-a895-ccb226e9de4d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.180430 Apr 11 20:08:27.285433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1074/2376] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:28.277505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-212750a0-97c2-48df-983e-88ff633f6d78 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:28.278437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-212750a0-97c2-48df-983e-88ff633f6d78 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:28.288325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-212750a0-97c2-48df-983e-88ff633f6d78 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:28.289028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-212750a0-97c2-48df-983e-88ff633f6d78 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:28.290041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-212750a0-97c2-48df-983e-88ff633f6d78 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:28.290470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-212750a0-97c2-48df-983e-88ff633f6d78 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:28.302349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:28.302958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:28.309730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:28.310180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:28.310946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:28.311392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:28.359625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-212750a0-97c2-48df-983e-88ff633f6d78 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:28.367937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-212750a0-97c2-48df-983e-88ff633f6d78 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096333 Apr 11 20:08:28.368495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1303/2377] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:28.447113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:28.455534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:28.457039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:28.458194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f85d797a-1c31-4bf4-a604-3fec88d96cc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159777 Apr 11 20:08:28.458739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1075/2378] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:29.386554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51cb090f-7911-4656-ad2f-3a6af1403b0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:29.387100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51cb090f-7911-4656-ad2f-3a6af1403b0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:29.394039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51cb090f-7911-4656-ad2f-3a6af1403b0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:29.394484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51cb090f-7911-4656-ad2f-3a6af1403b0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:29.395234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51cb090f-7911-4656-ad2f-3a6af1403b0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:29.395665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51cb090f-7911-4656-ad2f-3a6af1403b0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:29.458217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51cb090f-7911-4656-ad2f-3a6af1403b0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:29.466981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51cb090f-7911-4656-ad2f-3a6af1403b0a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084423 Apr 11 20:08:29.467559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1304/2379] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:29.477030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:29.477715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:29.484604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:29.485077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:29.485835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:29.486260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:29.617003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:29.628447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:29.629936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:29.631101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-384d0900-6246-46b0-9e69-b56399ac8db6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158018 Apr 11 20:08:29.631681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1076/2380] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:30.487797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-558d61a5-ee9e-4554-a4d8-0e9c37ff54c4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:30.488660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-558d61a5-ee9e-4554-a4d8-0e9c37ff54c4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:30.496753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-558d61a5-ee9e-4554-a4d8-0e9c37ff54c4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:30.497230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-558d61a5-ee9e-4554-a4d8-0e9c37ff54c4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:30.497987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-558d61a5-ee9e-4554-a4d8-0e9c37ff54c4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:30.498723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-558d61a5-ee9e-4554-a4d8-0e9c37ff54c4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:30.567702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-558d61a5-ee9e-4554-a4d8-0e9c37ff54c4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:30.576198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-558d61a5-ee9e-4554-a4d8-0e9c37ff54c4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094961 Apr 11 20:08:30.576765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1305/2381] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:30.653595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:30.654196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:30.661630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:30.662078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:30.662841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:30.663280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:30.796107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:30.809619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:30.811900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:30.813739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1dea0b99-09dc-4892-8fe2-eb0ebff69335 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166140 Apr 11 20:08:30.814523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1077/2382] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:31.597401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6277681b-328a-414f-b347-11cf685c5ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:31.598277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6277681b-328a-414f-b347-11cf685c5ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:31.606261 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6277681b-328a-414f-b347-11cf685c5ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:31.606710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6277681b-328a-414f-b347-11cf685c5ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:31.607509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6277681b-328a-414f-b347-11cf685c5ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:31.607938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6277681b-328a-414f-b347-11cf685c5ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:31.674434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6277681b-328a-414f-b347-11cf685c5ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:31.683154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6277681b-328a-414f-b347-11cf685c5ff4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092387 Apr 11 20:08:31.683727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1306/2383] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:31.836943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:31.837775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:31.846396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:31.846987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:31.848062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:31.848572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:31.979689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:31.987964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:31.989449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:31.990601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-de1ef412-b82c-4628-ba66-1ea406afa54f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158905 Apr 11 20:08:31.991155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1078/2384] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:32.700876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0313f99e-8f9c-4a00-82a0-01612a666c9f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:32.701462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0313f99e-8f9c-4a00-82a0-01612a666c9f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:32.708307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0313f99e-8f9c-4a00-82a0-01612a666c9f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:32.708753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0313f99e-8f9c-4a00-82a0-01612a666c9f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:32.709546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0313f99e-8f9c-4a00-82a0-01612a666c9f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:32.709974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0313f99e-8f9c-4a00-82a0-01612a666c9f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:32.776609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0313f99e-8f9c-4a00-82a0-01612a666c9f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:32.785044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0313f99e-8f9c-4a00-82a0-01612a666c9f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088085 Apr 11 20:08:32.785593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1307/2385] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:33.010084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:33.010715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:33.017463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:33.017911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:33.018666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:33.019096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:33.163806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:33.172603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:33.174112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:33.175277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-68b0fd57-c053-4c8d-b480-1c4d5ae3c9c9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169614 Apr 11 20:08:33.175824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1079/2386] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:33.805378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c09f2ead-b214-4f09-a048-35a73c484a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:33.806303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c09f2ead-b214-4f09-a048-35a73c484a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:33.817119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c09f2ead-b214-4f09-a048-35a73c484a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:33.817870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c09f2ead-b214-4f09-a048-35a73c484a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:33.819124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c09f2ead-b214-4f09-a048-35a73c484a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:33.819843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c09f2ead-b214-4f09-a048-35a73c484a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:33.881228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c09f2ead-b214-4f09-a048-35a73c484a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:33.890003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c09f2ead-b214-4f09-a048-35a73c484a6e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091192 Apr 11 20:08:33.890567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1308/2387] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:34.195586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:34.196414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:34.205120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:34.205712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:34.206745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:34.207362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:34.354048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:34.363075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:34.364563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:34.365758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b278433d-95f2-46a3-a90e-52d60b3048a1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.175334 Apr 11 20:08:34.366319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1080/2388] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:34.915997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8a3656da-1fd0-4943-a20f-64159debee56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:34.916974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8a3656da-1fd0-4943-a20f-64159debee56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:34.927505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a3656da-1fd0-4943-a20f-64159debee56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:34.928268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a3656da-1fd0-4943-a20f-64159debee56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:34.929571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a3656da-1fd0-4943-a20f-64159debee56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:34.930266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a3656da-1fd0-4943-a20f-64159debee56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:34.996369 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a3656da-1fd0-4943-a20f-64159debee56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:35.005001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8a3656da-1fd0-4943-a20f-64159debee56 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095761 Apr 11 20:08:35.005562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1309/2389] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:35.391792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:35.392788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:35.403724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:35.404474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:35.405787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:35.406513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:35.550835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:35.563375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:35.565555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:35.567197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e4a33bd-de73-449f-93b8-b9edecc1949b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.182739 Apr 11 20:08:35.567777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1081/2390] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:36.025979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ced462b9-63e9-4352-9ddd-ca53bc8b731b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:36.026575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ced462b9-63e9-4352-9ddd-ca53bc8b731b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:36.033054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ced462b9-63e9-4352-9ddd-ca53bc8b731b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:36.033497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ced462b9-63e9-4352-9ddd-ca53bc8b731b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:36.034241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ced462b9-63e9-4352-9ddd-ca53bc8b731b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:36.034663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ced462b9-63e9-4352-9ddd-ca53bc8b731b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:36.097490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ced462b9-63e9-4352-9ddd-ca53bc8b731b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:36.105950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ced462b9-63e9-4352-9ddd-ca53bc8b731b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085163 Apr 11 20:08:36.106524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1310/2391] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:36.590405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:36.591370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:36.602088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:36.602833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:36.604079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:36.604798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:36.736558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:36.744951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:36.746810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:36.747986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-44c96c9f-0b60-4e97-b171-1be19d03b094 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164330 Apr 11 20:08:36.748880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1082/2392] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:37.127224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eded5507-175b-4e0d-8bea-ab454a1e23f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:37.128237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eded5507-175b-4e0d-8bea-ab454a1e23f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:37.136677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eded5507-175b-4e0d-8bea-ab454a1e23f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:37.137158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eded5507-175b-4e0d-8bea-ab454a1e23f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:37.137916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eded5507-175b-4e0d-8bea-ab454a1e23f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:37.138347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eded5507-175b-4e0d-8bea-ab454a1e23f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:37.200497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eded5507-175b-4e0d-8bea-ab454a1e23f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:37.208817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eded5507-175b-4e0d-8bea-ab454a1e23f9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088389 Apr 11 20:08:37.209423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1311/2393] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:37.767081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:37.767986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:37.776093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:37.776653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:37.777435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:37.777861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:37.913153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:37.921442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:37.922930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:37.924079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2ed2082e-2ed0-45bc-80d9-a9e03328ba22 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.161358 Apr 11 20:08:37.924635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1083/2394] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:38.226977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a9cd3a1-af84-40d9-949e-0e0da010c080 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:38.227784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4a9cd3a1-af84-40d9-949e-0e0da010c080 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:38.236191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a9cd3a1-af84-40d9-949e-0e0da010c080 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:38.236748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a9cd3a1-af84-40d9-949e-0e0da010c080 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:38.237755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a9cd3a1-af84-40d9-949e-0e0da010c080 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:38.238324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a9cd3a1-af84-40d9-949e-0e0da010c080 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:38.312381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4a9cd3a1-af84-40d9-949e-0e0da010c080 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:38.320757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4a9cd3a1-af84-40d9-949e-0e0da010c080 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.098595 Apr 11 20:08:38.321362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1312/2395] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:38.946465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:38.947416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:38.958041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:38.958780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:38.960021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:38.960735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:39.089376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:39.102246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:39.103734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:39.104926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-25e91dbc-c5bd-43d0-9c80-8749d96dffcc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164925 Apr 11 20:08:39.105447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1084/2396] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:39.343058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-72e9a6d6-cd62-4200-8f10-a9094951b8c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:39.345061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-72e9a6d6-cd62-4200-8f10-a9094951b8c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:39.354512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72e9a6d6-cd62-4200-8f10-a9094951b8c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:39.354971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72e9a6d6-cd62-4200-8f10-a9094951b8c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:39.355729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72e9a6d6-cd62-4200-8f10-a9094951b8c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:39.356164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72e9a6d6-cd62-4200-8f10-a9094951b8c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:39.419828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-72e9a6d6-cd62-4200-8f10-a9094951b8c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:39.427962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-72e9a6d6-cd62-4200-8f10-a9094951b8c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092156 Apr 11 20:08:39.428535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1313/2397] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:40.132357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:40.133738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:40.144381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:40.145328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:40.146854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:40.147732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:40.280948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:40.289633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:40.291094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:40.292251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ff297bd-2c44-48ba-bfdd-77f85b6f3637 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170650 Apr 11 20:08:40.292816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1085/2398] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:40.448396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c902ff42-c867-4767-b834-0640a4200cdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:40.449427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c902ff42-c867-4767-b834-0640a4200cdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:40.459439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c902ff42-c867-4767-b834-0640a4200cdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:40.460171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c902ff42-c867-4767-b834-0640a4200cdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:40.461424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c902ff42-c867-4767-b834-0640a4200cdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:40.461849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c902ff42-c867-4767-b834-0640a4200cdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:40.535288 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c902ff42-c867-4767-b834-0640a4200cdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:40.544770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c902ff42-c867-4767-b834-0640a4200cdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.102866 Apr 11 20:08:40.545426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1314/2399] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:41.318097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:41.318650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:41.325941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:41.326383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:41.327096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:41.327549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:41.471437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:41.480469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:41.481974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:41.483150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1fb6d34c-eb65-4683-b588-1ce20313d65c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171211 Apr 11 20:08:41.483673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1086/2400] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:41.563987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2e2802e6-a839-45d2-a43b-b70adcef7f3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:41.564692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2e2802e6-a839-45d2-a43b-b70adcef7f3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:41.573134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e2802e6-a839-45d2-a43b-b70adcef7f3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:41.573516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e2802e6-a839-45d2-a43b-b70adcef7f3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:41.574274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e2802e6-a839-45d2-a43b-b70adcef7f3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:41.574704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e2802e6-a839-45d2-a43b-b70adcef7f3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:41.646859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2e2802e6-a839-45d2-a43b-b70adcef7f3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:41.655473 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2e2802e6-a839-45d2-a43b-b70adcef7f3e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096462 Apr 11 20:08:41.656053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1315/2401] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:42.511095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:42.511813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:42.520489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:42.521117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:42.522114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:42.522687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:42.650493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:42.659522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:42.661100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:42.662297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6baa52dc-2abd-4b9a-8075-4073a036000a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.156993 Apr 11 20:08:42.662852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1087/2402] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:42.672631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc400428-6389-4def-9b6c-c136ad514466 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:42.673279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc400428-6389-4def-9b6c-c136ad514466 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:42.679760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc400428-6389-4def-9b6c-c136ad514466 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:42.680206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc400428-6389-4def-9b6c-c136ad514466 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:42.680999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc400428-6389-4def-9b6c-c136ad514466 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:42.681429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc400428-6389-4def-9b6c-c136ad514466 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:42.744716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dc400428-6389-4def-9b6c-c136ad514466 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:42.756291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc400428-6389-4def-9b6c-c136ad514466 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087275 Apr 11 20:08:42.757035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1316/2403] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:43.684664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:43.685744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:43.696096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:43.696510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:43.697334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:43.697765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:43.778942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-78b16eef-b389-47e8-bf43-d331fd18d6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:43.779626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-78b16eef-b389-47e8-bf43-d331fd18d6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:43.786225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78b16eef-b389-47e8-bf43-d331fd18d6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:43.786674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78b16eef-b389-47e8-bf43-d331fd18d6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:43.787421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78b16eef-b389-47e8-bf43-d331fd18d6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:43.787866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78b16eef-b389-47e8-bf43-d331fd18d6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:43.843490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:43.852230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:43.853731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:43.854896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ffb90ded-1ae8-4dd9-afb9-c0d8eaa8862f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.176814 Apr 11 20:08:43.855422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1088/2404] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:43.858950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78b16eef-b389-47e8-bf43-d331fd18d6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:43.868527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-78b16eef-b389-47e8-bf43-d331fd18d6e8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093371 Apr 11 20:08:43.869365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1317/2405] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:44.876884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:44.877881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:44.886695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:44.887153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:44.887932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:44.888379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:44.890887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f330a5b8-6be1-47c4-9367-6bb2a3c4460a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:44.891516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f330a5b8-6be1-47c4-9367-6bb2a3c4460a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:44.898126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f330a5b8-6be1-47c4-9367-6bb2a3c4460a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:44.898575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f330a5b8-6be1-47c4-9367-6bb2a3c4460a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:44.899335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f330a5b8-6be1-47c4-9367-6bb2a3c4460a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:44.899760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f330a5b8-6be1-47c4-9367-6bb2a3c4460a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:44.978082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f330a5b8-6be1-47c4-9367-6bb2a3c4460a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:44.985869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f330a5b8-6be1-47c4-9367-6bb2a3c4460a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.098866 Apr 11 20:08:44.986465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1318/2406] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:45.041633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:45.055179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:45.056649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:45.057848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c52cf6b6-15ca-41b5-955e-e1bc5a71a983 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.187905 Apr 11 20:08:45.058412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1089/2407] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:45.723293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:08:45.723684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:08:46.003140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e518f3fc-5749-43c6-9ad5-8d96872c50b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:46.003686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e518f3fc-5749-43c6-9ad5-8d96872c50b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:46.010469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e518f3fc-5749-43c6-9ad5-8d96872c50b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:46.010919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e518f3fc-5749-43c6-9ad5-8d96872c50b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:46.011668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e518f3fc-5749-43c6-9ad5-8d96872c50b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:46.012095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e518f3fc-5749-43c6-9ad5-8d96872c50b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:46.074665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e518f3fc-5749-43c6-9ad5-8d96872c50b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:46.081753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:46.082361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:46.082884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e518f3fc-5749-43c6-9ad5-8d96872c50b9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084146 Apr 11 20:08:46.083444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1319/2408] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:45 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:46.088428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:46.088869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:46.089650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:46.090098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:46.230799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:46.243217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:46.245370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:46.247094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9b471e4-1d5c-4ef7-96a8-d0f0b7aaa54e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168955 Apr 11 20:08:46.247818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1090/2409] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:47.104414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c327aa0d-fb93-4619-94db-585ca6c96fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:47.105466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c327aa0d-fb93-4619-94db-585ca6c96fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:47.116120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c327aa0d-fb93-4619-94db-585ca6c96fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:47.116860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c327aa0d-fb93-4619-94db-585ca6c96fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:47.118159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c327aa0d-fb93-4619-94db-585ca6c96fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:47.118916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c327aa0d-fb93-4619-94db-585ca6c96fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:47.186230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c327aa0d-fb93-4619-94db-585ca6c96fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:47.194381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c327aa0d-fb93-4619-94db-585ca6c96fdd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096707 Apr 11 20:08:47.194949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1320/2410] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:47.273754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:47.274683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:47.285247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:47.285992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:47.287239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:47.287953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:47.422606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:47.431951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:47.433470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:47.434631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a033fd3a-b911-4bcf-806c-0e3a2e0b81c0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.167763 Apr 11 20:08:47.435185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1091/2411] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:48.211655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50949a48-7d06-4084-8650-9e33cfaa3807 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:48.212250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50949a48-7d06-4084-8650-9e33cfaa3807 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:48.219195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50949a48-7d06-4084-8650-9e33cfaa3807 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:48.219646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50949a48-7d06-4084-8650-9e33cfaa3807 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:48.220401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50949a48-7d06-4084-8650-9e33cfaa3807 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:48.220829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50949a48-7d06-4084-8650-9e33cfaa3807 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:48.287273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50949a48-7d06-4084-8650-9e33cfaa3807 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:48.295452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50949a48-7d06-4084-8650-9e33cfaa3807 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087713 Apr 11 20:08:48.296022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1321/2412] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:48.457449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:48.458372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:48.466253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:48.466701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:48.467461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:48.467892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:48.596599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:48.605847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:48.607332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:48.608514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6f26dfa-b6d3-4624-b1cd-d4c7862dfe4f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.157728 Apr 11 20:08:48.609105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1092/2413] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:49.315876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3f06a1b6-a665-45ed-a57f-2ebe96af913a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:49.316752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3f06a1b6-a665-45ed-a57f-2ebe96af913a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:49.327591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f06a1b6-a665-45ed-a57f-2ebe96af913a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:49.328339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f06a1b6-a665-45ed-a57f-2ebe96af913a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:49.329647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f06a1b6-a665-45ed-a57f-2ebe96af913a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:49.330405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f06a1b6-a665-45ed-a57f-2ebe96af913a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:49.394557 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f06a1b6-a665-45ed-a57f-2ebe96af913a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:49.402680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3f06a1b6-a665-45ed-a57f-2ebe96af913a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093471 Apr 11 20:08:49.403243 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1322/2414] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:49.631794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:49.632826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:49.639650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:49.640098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:49.640858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:49.641326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:49.772268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:49.780566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:49.782044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:49.783205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c9e8e192-607e-45fa-9a07-65639da00f88 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158141 Apr 11 20:08:49.783761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1093/2415] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:50.427930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-60aa62c9-1d85-4e5b-982d-2f9ab9bd5282 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:50.429228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-60aa62c9-1d85-4e5b-982d-2f9ab9bd5282 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:50.441056 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60aa62c9-1d85-4e5b-982d-2f9ab9bd5282 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:50.441716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60aa62c9-1d85-4e5b-982d-2f9ab9bd5282 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:50.442973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60aa62c9-1d85-4e5b-982d-2f9ab9bd5282 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:50.443687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60aa62c9-1d85-4e5b-982d-2f9ab9bd5282 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:50.520518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-60aa62c9-1d85-4e5b-982d-2f9ab9bd5282 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:50.532640 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-60aa62c9-1d85-4e5b-982d-2f9ab9bd5282 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.110974 Apr 11 20:08:50.533461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1323/2416] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:50.805633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:50.806225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:50.813083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:50.813533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:50.814323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:50.814773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:50.953888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:50.962999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:50.964474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:50.965684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b8918fad-5710-4c36-b361-abcc35ba437a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166360 Apr 11 20:08:50.966470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1094/2417] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:51.554586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-044fbc2f-3b16-4d75-9d57-cf1fec7a1588 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:51.555648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-044fbc2f-3b16-4d75-9d57-cf1fec7a1588 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:51.566484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-044fbc2f-3b16-4d75-9d57-cf1fec7a1588 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:51.567222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-044fbc2f-3b16-4d75-9d57-cf1fec7a1588 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:51.568459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-044fbc2f-3b16-4d75-9d57-cf1fec7a1588 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:51.569222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-044fbc2f-3b16-4d75-9d57-cf1fec7a1588 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:51.637532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-044fbc2f-3b16-4d75-9d57-cf1fec7a1588 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:51.649070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-044fbc2f-3b16-4d75-9d57-cf1fec7a1588 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.101336 Apr 11 20:08:51.649622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1324/2418] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:51.988336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:51.989353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:52.000209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:52.000971 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:52.002227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:52.002940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:52.156570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:52.165887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:52.167393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:52.168578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2d0c0aaa-a497-4c49-a377-86edd8d11de4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.186794 Apr 11 20:08:52.169346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1095/2419] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:52.670502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f3249bbb-aada-4bb0-a49c-dcb3b84e7ab1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:52.671481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f3249bbb-aada-4bb0-a49c-dcb3b84e7ab1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:52.682270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3249bbb-aada-4bb0-a49c-dcb3b84e7ab1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:52.683014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3249bbb-aada-4bb0-a49c-dcb3b84e7ab1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:52.684263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3249bbb-aada-4bb0-a49c-dcb3b84e7ab1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:52.684970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3249bbb-aada-4bb0-a49c-dcb3b84e7ab1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:52.749513 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f3249bbb-aada-4bb0-a49c-dcb3b84e7ab1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:52.757554 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f3249bbb-aada-4bb0-a49c-dcb3b84e7ab1 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093660 Apr 11 20:08:52.758092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1325/2420] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:53.187738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:53.188340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:53.195352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:53.195826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:53.196591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:53.197044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:53.337199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:53.349242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:53.351619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:53.353395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f33062f-85cd-4612-a2ee-fcb67b039cfd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169495 Apr 11 20:08:53.354258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1096/2421] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:53.775844 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8dbede2d-5cd9-4ccc-8c6c-26431605312d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:53.776460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8dbede2d-5cd9-4ccc-8c6c-26431605312d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:53.783233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8dbede2d-5cd9-4ccc-8c6c-26431605312d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:53.783687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8dbede2d-5cd9-4ccc-8c6c-26431605312d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:53.784455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8dbede2d-5cd9-4ccc-8c6c-26431605312d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:53.785202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8dbede2d-5cd9-4ccc-8c6c-26431605312d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:53.852784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8dbede2d-5cd9-4ccc-8c6c-26431605312d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:53.860962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8dbede2d-5cd9-4ccc-8c6c-26431605312d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089690 Apr 11 20:08:53.861550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1326/2422] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:54.376288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:54.377318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:54.386015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:54.386462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:54.387219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:54.387630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:54.533727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:54.542448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:54.544053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:54.545334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-83a68a95-e2f1-43c0-b823-3966790004ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.175971 Apr 11 20:08:54.545886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1097/2423] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:54.882784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af2ca1c6-1d92-4a9f-8be9-52aed6fb945b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:54.883567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-af2ca1c6-1d92-4a9f-8be9-52aed6fb945b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:54.891583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af2ca1c6-1d92-4a9f-8be9-52aed6fb945b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:54.892133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af2ca1c6-1d92-4a9f-8be9-52aed6fb945b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:54.893103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af2ca1c6-1d92-4a9f-8be9-52aed6fb945b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:54.893635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af2ca1c6-1d92-4a9f-8be9-52aed6fb945b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:54.963460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-af2ca1c6-1d92-4a9f-8be9-52aed6fb945b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:54.971458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-af2ca1c6-1d92-4a9f-8be9-52aed6fb945b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095354 Apr 11 20:08:54.971993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1327/2424] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:55.564593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:55.565242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:55.571920 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:55.572395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:55.573188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:55.573614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:55.718951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:55.727732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:55.729253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:55.730417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c3e6fcbf-84f3-4a7f-8465-056f1146fe36 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169829 Apr 11 20:08:55.730975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1098/2425] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:55.994854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1bdf1b1e-c813-41e4-942a-743697e92f4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:55.995548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1bdf1b1e-c813-41e4-942a-743697e92f4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:56.002519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bdf1b1e-c813-41e4-942a-743697e92f4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:56.002990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bdf1b1e-c813-41e4-942a-743697e92f4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:56.003758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bdf1b1e-c813-41e4-942a-743697e92f4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:56.004192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bdf1b1e-c813-41e4-942a-743697e92f4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:56.065947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1bdf1b1e-c813-41e4-942a-743697e92f4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:56.074036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1bdf1b1e-c813-41e4-942a-743697e92f4f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086945 Apr 11 20:08:56.074591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1328/2426] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:56.752624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:56.753604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:56.761962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:56.762413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:56.763175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:56.763609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:56.900787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:56.913955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:56.915460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:56.916639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bcad74b9-bfc3-498d-991f-25bb553c8ae4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171034 Apr 11 20:08:56.917232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1099/2427] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:57.091802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e08df3a-67be-43ff-b1f3-6142f91576be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:57.092360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e08df3a-67be-43ff-b1f3-6142f91576be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:57.099251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e08df3a-67be-43ff-b1f3-6142f91576be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:57.099696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e08df3a-67be-43ff-b1f3-6142f91576be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:57.100449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e08df3a-67be-43ff-b1f3-6142f91576be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:57.100882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e08df3a-67be-43ff-b1f3-6142f91576be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:57.162828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e08df3a-67be-43ff-b1f3-6142f91576be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:57.170900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e08df3a-67be-43ff-b1f3-6142f91576be tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082998 Apr 11 20:08:57.177007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1329/2428] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:57.939388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:57.940506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:57.950916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:57.951657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:57.952928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:57.953674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:58.083471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:58.092267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:58.093785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:58.094962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-903fa0bb-88fb-408a-8026-86faec441fc1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162161 Apr 11 20:08:58.095521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1100/2429] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:58.189946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cf02c8d-b09b-472b-8a2f-0209cd88380f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:58.190625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cf02c8d-b09b-472b-8a2f-0209cd88380f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:58.198374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf02c8d-b09b-472b-8a2f-0209cd88380f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:58.198822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf02c8d-b09b-472b-8a2f-0209cd88380f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:58.199578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf02c8d-b09b-472b-8a2f-0209cd88380f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:58.200003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cf02c8d-b09b-472b-8a2f-0209cd88380f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:58.271497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cf02c8d-b09b-472b-8a2f-0209cd88380f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:58.279545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cf02c8d-b09b-472b-8a2f-0209cd88380f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094966 Apr 11 20:08:58.280109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1330/2430] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:08:59.115501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:59.116280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:59.125384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:59.125976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:59.126982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:59.127554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:59.258035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:59.266270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:59.267761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:59.269006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-376b1746-6b8c-448a-962a-7c670bf8a055 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158710 Apr 11 20:08:59.269562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1101/2431] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:08:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:08:59.296692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9c979f3b-048e-4615-a9f6-ca5e3fdc2525 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:08:59.297368 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9c979f3b-048e-4615-a9f6-ca5e3fdc2525 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:08:59.303904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c979f3b-048e-4615-a9f6-ca5e3fdc2525 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:59.304379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c979f3b-048e-4615-a9f6-ca5e3fdc2525 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:59.305228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c979f3b-048e-4615-a9f6-ca5e3fdc2525 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:08:59.305657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c979f3b-048e-4615-a9f6-ca5e3fdc2525 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:08:59.372296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9c979f3b-048e-4615-a9f6-ca5e3fdc2525 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:08:59.380939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9c979f3b-048e-4615-a9f6-ca5e3fdc2525 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088133 Apr 11 20:08:59.381522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1331/2432] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:08:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:00.287914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:00.288530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:00.295152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:00.295601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:00.296356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:00.296785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:00.398088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7cf3112e-5e12-4193-9a5e-95bc088f0038 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:00.398663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7cf3112e-5e12-4193-9a5e-95bc088f0038 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:00.405332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf3112e-5e12-4193-9a5e-95bc088f0038 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:00.405779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf3112e-5e12-4193-9a5e-95bc088f0038 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:00.406514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf3112e-5e12-4193-9a5e-95bc088f0038 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:00.406973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf3112e-5e12-4193-9a5e-95bc088f0038 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:00.433362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:00.442107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:00.443640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:00.445047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5c7af41-91ba-4665-9ec4-95de831e2b5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.161205 Apr 11 20:09:00.445990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1102/2433] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:00.466909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7cf3112e-5e12-4193-9a5e-95bc088f0038 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:00.475475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7cf3112e-5e12-4193-9a5e-95bc088f0038 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081672 Apr 11 20:09:00.476088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1332/2434] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:01.468363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:01.469255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:01.478600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:01.479048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:01.479796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:01.480222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:01.491642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-432dc8e4-a691-4551-8a46-e3e4ccd1aa14 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:01.492233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-432dc8e4-a691-4551-8a46-e3e4ccd1aa14 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:01.499334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-432dc8e4-a691-4551-8a46-e3e4ccd1aa14 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:01.499781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-432dc8e4-a691-4551-8a46-e3e4ccd1aa14 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:01.500540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-432dc8e4-a691-4551-8a46-e3e4ccd1aa14 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:01.501001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-432dc8e4-a691-4551-8a46-e3e4ccd1aa14 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:01.574856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-432dc8e4-a691-4551-8a46-e3e4ccd1aa14 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:01.583092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-432dc8e4-a691-4551-8a46-e3e4ccd1aa14 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095245 Apr 11 20:09:01.583672 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1333/2435] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:01.632545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:01.641609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:01.643078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:01.644233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c00953a3-360b-44ff-b6ed-0542a1fb2d17 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.182816 Apr 11 20:09:01.644822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1103/2436] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:02.604560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-907604ac-3bc4-48d6-9c45-0f29e31dbd09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:02.605532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-907604ac-3bc4-48d6-9c45-0f29e31dbd09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:02.617514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-907604ac-3bc4-48d6-9c45-0f29e31dbd09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:02.618175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-907604ac-3bc4-48d6-9c45-0f29e31dbd09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:02.619314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-907604ac-3bc4-48d6-9c45-0f29e31dbd09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:02.619961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-907604ac-3bc4-48d6-9c45-0f29e31dbd09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:02.662615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:02.663217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:02.672277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:02.672721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:02.673512 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:02.673940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:02.700306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-907604ac-3bc4-48d6-9c45-0f29e31dbd09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:02.709082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-907604ac-3bc4-48d6-9c45-0f29e31dbd09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.111109 Apr 11 20:09:02.709836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1334/2437] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:02.806227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:02.815166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:02.816658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:02.817866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d197b749-aa3d-4b51-a137-f6f3878f1ca6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159192 Apr 11 20:09:02.818401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1104/2438] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:03.731687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff545eef-0ae9-48d3-b6bf-4d5b23914743 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:03.732660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff545eef-0ae9-48d3-b6bf-4d5b23914743 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:03.742852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff545eef-0ae9-48d3-b6bf-4d5b23914743 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:03.743292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff545eef-0ae9-48d3-b6bf-4d5b23914743 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:03.744035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff545eef-0ae9-48d3-b6bf-4d5b23914743 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:03.744457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff545eef-0ae9-48d3-b6bf-4d5b23914743 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:03.815574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff545eef-0ae9-48d3-b6bf-4d5b23914743 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:03.824633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff545eef-0ae9-48d3-b6bf-4d5b23914743 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099502 Apr 11 20:09:03.825245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1335/2439] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:03.835711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:03.836315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:03.842935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:03.843354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:03.844100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:03.844527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:04.181713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:04.190200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:04.191693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:04.192870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-49577aa5-58ae-4df9-aa54-676984ae0f5b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.361129 Apr 11 20:09:04.193492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1105/2440] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:04.845744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c4fa43e7-ee57-4b46-9f4a-fbff5164a4f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:04.846784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c4fa43e7-ee57-4b46-9f4a-fbff5164a4f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:04.855626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4fa43e7-ee57-4b46-9f4a-fbff5164a4f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:04.856067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4fa43e7-ee57-4b46-9f4a-fbff5164a4f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:04.856817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4fa43e7-ee57-4b46-9f4a-fbff5164a4f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:04.857273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4fa43e7-ee57-4b46-9f4a-fbff5164a4f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:04.918135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c4fa43e7-ee57-4b46-9f4a-fbff5164a4f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:04.926282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c4fa43e7-ee57-4b46-9f4a-fbff5164a4f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087054 Apr 11 20:09:04.926842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1336/2441] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:05.214314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:05.214950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:05.221610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:05.222054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:05.222801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:05.223228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:05.359279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:05.372205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:05.374859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:05.376650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f21f9a53-dc5a-410f-b230-d53fd492a568 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.167358 Apr 11 20:09:05.377501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1106/2442] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:06.027255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6cce9142-4c1d-453f-88e3-ceffdda71b44 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:06.027864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6cce9142-4c1d-453f-88e3-ceffdda71b44 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:06.034166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cce9142-4c1d-453f-88e3-ceffdda71b44 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:06.034602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cce9142-4c1d-453f-88e3-ceffdda71b44 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:06.035344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cce9142-4c1d-453f-88e3-ceffdda71b44 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:06.035766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cce9142-4c1d-453f-88e3-ceffdda71b44 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:06.155152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6cce9142-4c1d-453f-88e3-ceffdda71b44 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:06.163505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6cce9142-4c1d-453f-88e3-ceffdda71b44 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.222388 Apr 11 20:09:06.164066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1337/2443] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:06.460924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:06.461553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:06.468097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:06.468548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:06.469354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:06.469789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:06.656595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:06.665475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:06.666972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:06.668147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5b0f7d0e-13bb-4f39-97e1-ddbbc796d810 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.275196 Apr 11 20:09:06.668681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1107/2444] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:07.182346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-67cb9f58-e1c0-4453-9fc7-073b1eb80049 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:07.182955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-67cb9f58-e1c0-4453-9fc7-073b1eb80049 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:07.189711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67cb9f58-e1c0-4453-9fc7-073b1eb80049 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:07.190119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67cb9f58-e1c0-4453-9fc7-073b1eb80049 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:07.190879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67cb9f58-e1c0-4453-9fc7-073b1eb80049 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:07.191309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67cb9f58-e1c0-4453-9fc7-073b1eb80049 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:07.251123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-67cb9f58-e1c0-4453-9fc7-073b1eb80049 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:07.259240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-67cb9f58-e1c0-4453-9fc7-073b1eb80049 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.080864 Apr 11 20:09:07.259802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1338/2445] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:07.690055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:07.691248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:07.699525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:07.699993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:07.700742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:07.701206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:07.831009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:07.839664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:07.841172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:07.842333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cae65c89-f648-4e70-9396-eabb75767da0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.158945 Apr 11 20:09:07.842892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1108/2446] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:08.280082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6fa3b8a0-d0ec-4139-9619-cf00b51d73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:08.281155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6fa3b8a0-d0ec-4139-9619-cf00b51d73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:08.291161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fa3b8a0-d0ec-4139-9619-cf00b51d73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:08.291952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fa3b8a0-d0ec-4139-9619-cf00b51d73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:08.293355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fa3b8a0-d0ec-4139-9619-cf00b51d73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:08.294039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fa3b8a0-d0ec-4139-9619-cf00b51d73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:08.366731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6fa3b8a0-d0ec-4139-9619-cf00b51d73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:08.375537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6fa3b8a0-d0ec-4139-9619-cf00b51d73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.102062 Apr 11 20:09:08.376103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1339/2447] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:08.863962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:08.864559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:08.872675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:08.873197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:08.874378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:08.874833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:09.009275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:09.020162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:09.022587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:09.024474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6957fe9e-515f-4a0e-862a-94a859ebfedd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166351 Apr 11 20:09:09.025068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1109/2448] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:09.391799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-377a8112-0df3-4918-98d5-5a3496fd8476 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:09.392399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-377a8112-0df3-4918-98d5-5a3496fd8476 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:09.399189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-377a8112-0df3-4918-98d5-5a3496fd8476 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:09.399634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-377a8112-0df3-4918-98d5-5a3496fd8476 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:09.400378 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-377a8112-0df3-4918-98d5-5a3496fd8476 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:09.400800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-377a8112-0df3-4918-98d5-5a3496fd8476 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:09.468193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-377a8112-0df3-4918-98d5-5a3496fd8476 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:09.476438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-377a8112-0df3-4918-98d5-5a3496fd8476 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088539 Apr 11 20:09:09.477028 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1340/2449] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:10.047317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:10.048244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:10.058814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:10.059589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:10.060782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:10.061560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:10.199949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:10.213343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:10.215020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:10.216189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-985635f5-a592-4d81-8afd-3ef550c08b35 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.175433 Apr 11 20:09:10.216748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1110/2450] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:10.499644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cc55d94e-3742-48f2-85ed-b998f5278d2e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:10.501242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cc55d94e-3742-48f2-85ed-b998f5278d2e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:10.515746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc55d94e-3742-48f2-85ed-b998f5278d2e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:10.516833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc55d94e-3742-48f2-85ed-b998f5278d2e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:10.518728 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc55d94e-3742-48f2-85ed-b998f5278d2e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:10.519789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc55d94e-3742-48f2-85ed-b998f5278d2e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:10.593987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cc55d94e-3742-48f2-85ed-b998f5278d2e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:10.604545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cc55d94e-3742-48f2-85ed-b998f5278d2e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.113434 Apr 11 20:09:10.605174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1341/2451] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:11.239413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:11.240189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:11.247929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:11.248311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:11.249416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:11.249842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:11.382892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:11.391313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:11.392809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:11.394018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6994ae0d-6c9c-467e-923e-392557b51440 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.161259 Apr 11 20:09:11.394561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1111/2452] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:11.626568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-222ffa53-00a1-4a58-83a5-71ca3b0480c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:11.627431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-222ffa53-00a1-4a58-83a5-71ca3b0480c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:11.636725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-222ffa53-00a1-4a58-83a5-71ca3b0480c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:11.637207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-222ffa53-00a1-4a58-83a5-71ca3b0480c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:11.637954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-222ffa53-00a1-4a58-83a5-71ca3b0480c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:11.638377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-222ffa53-00a1-4a58-83a5-71ca3b0480c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:11.702508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-222ffa53-00a1-4a58-83a5-71ca3b0480c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:11.712938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-222ffa53-00a1-4a58-83a5-71ca3b0480c0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093234 Apr 11 20:09:11.713515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1342/2453] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:12.422414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:12.423539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:12.432895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:12.433383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:12.434215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:12.434646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:12.568228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:12.581721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:12.584025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:12.585927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d806c7fb-8ca1-4b12-b44d-353746d88488 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169838 Apr 11 20:09:12.586777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1112/2454] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:12.734139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b5ee155-b74f-4339-979f-5b6433b3910d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:12.735123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b5ee155-b74f-4339-979f-5b6433b3910d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:12.744769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b5ee155-b74f-4339-979f-5b6433b3910d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:12.745257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b5ee155-b74f-4339-979f-5b6433b3910d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:12.746010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b5ee155-b74f-4339-979f-5b6433b3910d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:12.746437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b5ee155-b74f-4339-979f-5b6433b3910d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:12.819998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b5ee155-b74f-4339-979f-5b6433b3910d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:12.828273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b5ee155-b74f-4339-979f-5b6433b3910d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.100600 Apr 11 20:09:12.828872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1343/2455] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:13.607058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:13.607739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:13.614592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:13.615065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:13.615874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:13.616322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:13.759569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:13.768360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:13.769899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:13.771076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc091acc-9678-4184-8a6c-df775c1c37ad tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168986 Apr 11 20:09:13.771635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1113/2456] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:13.849284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b18821a7-b1d2-441b-9f86-40282fa65c09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:13.850232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b18821a7-b1d2-441b-9f86-40282fa65c09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:13.857999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b18821a7-b1d2-441b-9f86-40282fa65c09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:13.858376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b18821a7-b1d2-441b-9f86-40282fa65c09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:13.859131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b18821a7-b1d2-441b-9f86-40282fa65c09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:13.859731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b18821a7-b1d2-441b-9f86-40282fa65c09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:13.930185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b18821a7-b1d2-441b-9f86-40282fa65c09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:13.938588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b18821a7-b1d2-441b-9f86-40282fa65c09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095833 Apr 11 20:09:13.939178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1344/2457] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:14.793790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:14.794717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:14.805285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:14.806039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:14.806931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:14.807355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:14.947836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:14.955343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a47b9df0-d4fb-47d3-b4c8-dc01ed8ba46d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:14.955958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a47b9df0-d4fb-47d3-b4c8-dc01ed8ba46d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:14.956696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:14.958230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:14.959396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-294ea8d0-65c6-4c67-9c07-e5fcde5ec887 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.172132 Apr 11 20:09:14.959942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1114/2458] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:14.962594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a47b9df0-d4fb-47d3-b4c8-dc01ed8ba46d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:14.963106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a47b9df0-d4fb-47d3-b4c8-dc01ed8ba46d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:14.963931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a47b9df0-d4fb-47d3-b4c8-dc01ed8ba46d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:14.964422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a47b9df0-d4fb-47d3-b4c8-dc01ed8ba46d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:15.033037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a47b9df0-d4fb-47d3-b4c8-dc01ed8ba46d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:15.041066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a47b9df0-d4fb-47d3-b4c8-dc01ed8ba46d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089503 Apr 11 20:09:15.041626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1345/2459] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:09:15.981370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:15.981970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:15.988499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:15.989068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:15.989865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:15.990297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:16.058245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7515135e-5d77-4dd8-a19f-e5f6f788733d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:16.058846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7515135e-5d77-4dd8-a19f-e5f6f788733d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:16.065352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7515135e-5d77-4dd8-a19f-e5f6f788733d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:16.065808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7515135e-5d77-4dd8-a19f-e5f6f788733d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:16.066588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7515135e-5d77-4dd8-a19f-e5f6f788733d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:16.067014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7515135e-5d77-4dd8-a19f-e5f6f788733d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:16.142436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7515135e-5d77-4dd8-a19f-e5f6f788733d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:16.145945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:16.150508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7515135e-5d77-4dd8-a19f-e5f6f788733d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096173 Apr 11 20:09:16.151367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1346/2460] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:16.154316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:16.155790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:16.156963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cf9d35fd-dd61-4cac-8e3e-fb7fa059389d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.181368 Apr 11 20:09:16.157531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1115/2461] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:17.172645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-596e05a4-dd3c-48ff-a546-b5cf2ba9be8b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:17.173658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-596e05a4-dd3c-48ff-a546-b5cf2ba9be8b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:17.183777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:17.184587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-596e05a4-dd3c-48ff-a546-b5cf2ba9be8b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:17.184810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-596e05a4-dd3c-48ff-a546-b5cf2ba9be8b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:17.185940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-596e05a4-dd3c-48ff-a546-b5cf2ba9be8b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:17.186177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:17.186422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-596e05a4-dd3c-48ff-a546-b5cf2ba9be8b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:17.192851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:17.193354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:17.194126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:17.194557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:17.276555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-596e05a4-dd3c-48ff-a546-b5cf2ba9be8b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:17.288085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-596e05a4-dd3c-48ff-a546-b5cf2ba9be8b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.121660 Apr 11 20:09:17.289082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1347/2462] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:17.347616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:17.356394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:17.357901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:17.359055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9caec7f2-c574-4594-8fa5-db92f8de7599 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.182453 Apr 11 20:09:17.359581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1116/2463] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:18.307563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dec2af12-70af-474f-94fd-2f58332b8e27 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:18.308183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dec2af12-70af-474f-94fd-2f58332b8e27 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:18.314832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dec2af12-70af-474f-94fd-2f58332b8e27 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:18.315273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dec2af12-70af-474f-94fd-2f58332b8e27 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:18.316017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dec2af12-70af-474f-94fd-2f58332b8e27 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:18.316445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dec2af12-70af-474f-94fd-2f58332b8e27 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:18.383235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:18.383846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:18.385091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dec2af12-70af-474f-94fd-2f58332b8e27 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:18.390182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:18.390893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:18.391648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:18.392066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:18.393490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dec2af12-70af-474f-94fd-2f58332b8e27 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089825 Apr 11 20:09:18.394401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1348/2464] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:18.522976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:18.531266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:18.532741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:18.533935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-871bbda6-aadc-4141-ba7a-51b1039238d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.154631 Apr 11 20:09:18.534485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1117/2465] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:19.410781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-16f0e98b-0939-40d6-9a81-7b3bc70092d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:19.411354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-16f0e98b-0939-40d6-9a81-7b3bc70092d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:19.418143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16f0e98b-0939-40d6-9a81-7b3bc70092d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:19.418600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16f0e98b-0939-40d6-9a81-7b3bc70092d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:19.419362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16f0e98b-0939-40d6-9a81-7b3bc70092d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:19.419800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16f0e98b-0939-40d6-9a81-7b3bc70092d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:19.480880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-16f0e98b-0939-40d6-9a81-7b3bc70092d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:19.489072 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-16f0e98b-0939-40d6-9a81-7b3bc70092d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.082257 Apr 11 20:09:19.489643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1349/2466] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:19.555306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:19.556302 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:19.566882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:19.567620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:19.568858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:19.569618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:19.697856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:19.706224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:19.707732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:19.708930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8459d138-3365-44f6-b37a-851843844491 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.160125 Apr 11 20:09:19.709546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1118/2467] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:20.510321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-776aa837-5194-437f-9ece-bcbfc72fb404 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:20.511156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-776aa837-5194-437f-9ece-bcbfc72fb404 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:20.518786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-776aa837-5194-437f-9ece-bcbfc72fb404 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:20.519280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-776aa837-5194-437f-9ece-bcbfc72fb404 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:20.520108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-776aa837-5194-437f-9ece-bcbfc72fb404 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:20.520581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-776aa837-5194-437f-9ece-bcbfc72fb404 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:20.595531 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-776aa837-5194-437f-9ece-bcbfc72fb404 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:20.603953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-776aa837-5194-437f-9ece-bcbfc72fb404 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.100485 Apr 11 20:09:20.604597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1350/2468] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:20.731838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:20.732840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:20.743535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:20.744287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:20.745472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:20.745934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:20.883171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:20.892159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:20.893693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:20.894864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5d14ac23-4eac-4a06-96fc-a8a115d74ed5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169740 Apr 11 20:09:20.895433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1119/2469] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:21.625586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0e4f5db4-f737-4d6c-8b23-a04efce7fa4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:21.626453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0e4f5db4-f737-4d6c-8b23-a04efce7fa4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:21.637038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e4f5db4-f737-4d6c-8b23-a04efce7fa4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:21.637787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e4f5db4-f737-4d6c-8b23-a04efce7fa4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:21.639015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e4f5db4-f737-4d6c-8b23-a04efce7fa4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:21.639728 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e4f5db4-f737-4d6c-8b23-a04efce7fa4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:21.721835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0e4f5db4-f737-4d6c-8b23-a04efce7fa4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:21.729940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0e4f5db4-f737-4d6c-8b23-a04efce7fa4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.111317 Apr 11 20:09:21.730488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1351/2470] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:21.917549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:21.918101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:21.924615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:21.925095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:21.925841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:21.926269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:22.064519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:22.076332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:22.077851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:22.079015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ff18cb7-00a2-44f7-a6f9-055cebc06054 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168088 Apr 11 20:09:22.079575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1120/2471] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:22.751570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92d2d8df-449f-44a5-848b-f829b5ab0c30 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:22.752574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92d2d8df-449f-44a5-848b-f829b5ab0c30 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:22.762834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92d2d8df-449f-44a5-848b-f829b5ab0c30 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:22.763387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92d2d8df-449f-44a5-848b-f829b5ab0c30 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:22.764327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92d2d8df-449f-44a5-848b-f829b5ab0c30 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:22.764863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92d2d8df-449f-44a5-848b-f829b5ab0c30 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:22.837626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-92d2d8df-449f-44a5-848b-f829b5ab0c30 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:22.846052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92d2d8df-449f-44a5-848b-f829b5ab0c30 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.101281 Apr 11 20:09:22.846614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1352/2472] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:23.101986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:23.102968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:23.113755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:23.114507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:23.115824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:23.116547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:23.252111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:23.260879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:23.262408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:23.263572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-617af750-bc66-4dab-96c9-885a20fe4a4c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168187 Apr 11 20:09:23.264126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1121/2473] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:23.867438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-12e29110-f73b-4936-9c00-190e260a0b8a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:23.868344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-12e29110-f73b-4936-9c00-190e260a0b8a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:23.876293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12e29110-f73b-4936-9c00-190e260a0b8a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:23.876740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12e29110-f73b-4936-9c00-190e260a0b8a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:23.877520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12e29110-f73b-4936-9c00-190e260a0b8a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:23.877947 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12e29110-f73b-4936-9c00-190e260a0b8a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:23.950996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-12e29110-f73b-4936-9c00-190e260a0b8a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:23.959200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-12e29110-f73b-4936-9c00-190e260a0b8a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.098576 Apr 11 20:09:23.959769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1353/2474] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:23 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:24.285504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:24.286296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:24.295039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:24.295505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:24.296250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:24.296680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:24.432544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:24.441202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:24.442751 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:24.443857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c84fb56b-3de2-4b2c-93df-eb4bf5f82472 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.164451 Apr 11 20:09:24.444425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1122/2475] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:24.662924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:09:24.663325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:09:24.980212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-748c1301-0837-43e5-adb4-08d6a5527a51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:24.980956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-748c1301-0837-43e5-adb4-08d6a5527a51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:24.988272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-748c1301-0837-43e5-adb4-08d6a5527a51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:24.988763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-748c1301-0837-43e5-adb4-08d6a5527a51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:24.989628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-748c1301-0837-43e5-adb4-08d6a5527a51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:24.990098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-748c1301-0837-43e5-adb4-08d6a5527a51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:25.056215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-748c1301-0837-43e5-adb4-08d6a5527a51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:25.068423 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-748c1301-0837-43e5-adb4-08d6a5527a51 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094442 Apr 11 20:09:25.069317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1354/2476] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:25.462236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:25.462897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:25.470628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:25.471081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:25.471846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:25.472282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:25.623893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:25.636823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:25.638440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:25.639607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fab8a4e5-94ef-4ff4-9887-318f9fcef613 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.181473 Apr 11 20:09:25.640130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1123/2477] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:26.090969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dfb9e695-f763-467e-8f8f-615daa0ab5cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:26.091622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dfb9e695-f763-467e-8f8f-615daa0ab5cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:26.099130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfb9e695-f763-467e-8f8f-615daa0ab5cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:26.099622 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfb9e695-f763-467e-8f8f-615daa0ab5cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:26.100466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfb9e695-f763-467e-8f8f-615daa0ab5cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:26.100944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfb9e695-f763-467e-8f8f-615daa0ab5cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:26.168758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dfb9e695-f763-467e-8f8f-615daa0ab5cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:26.178542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dfb9e695-f763-467e-8f8f-615daa0ab5cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093342 Apr 11 20:09:26.179234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1355/2478] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:26 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:26.662369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:26.663380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:26.674098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:26.674839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:26.676089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:26.676809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:26.810686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:26.819540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:26.821063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:26.822240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-469b6a53-a2da-41b5-b037-f5f654c41d62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166597 Apr 11 20:09:26.822796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1124/2479] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:27.200077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92a4b7ee-934b-4955-9cfa-0430dae808ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:27.200693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92a4b7ee-934b-4955-9cfa-0430dae808ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:27.207404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a4b7ee-934b-4955-9cfa-0430dae808ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:27.207890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a4b7ee-934b-4955-9cfa-0430dae808ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:27.208666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a4b7ee-934b-4955-9cfa-0430dae808ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:27.209142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a4b7ee-934b-4955-9cfa-0430dae808ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:27.274502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-92a4b7ee-934b-4955-9cfa-0430dae808ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:27.286715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92a4b7ee-934b-4955-9cfa-0430dae808ff tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091850 Apr 11 20:09:27.287493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1356/2480] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:27 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:27.843977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:27.845055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:27.855342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:27.855786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:27.856537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:27.856959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:27.995831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:28.004783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:28.006343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:28.007506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb27da15-5329-4d88-ab8b-bebb6cae2950 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170352 Apr 11 20:09:28.008063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1125/2481] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:28.308294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bf13a581-8988-403d-9791-ef3c1dde2d2c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:28.308946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bf13a581-8988-403d-9791-ef3c1dde2d2c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:28.315929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf13a581-8988-403d-9791-ef3c1dde2d2c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:28.316392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf13a581-8988-403d-9791-ef3c1dde2d2c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:28.317216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf13a581-8988-403d-9791-ef3c1dde2d2c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:28.317662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf13a581-8988-403d-9791-ef3c1dde2d2c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:28.380273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bf13a581-8988-403d-9791-ef3c1dde2d2c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:28.388204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bf13a581-8988-403d-9791-ef3c1dde2d2c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086429 Apr 11 20:09:28.388760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1357/2482] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:28 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:29.027646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:29.028308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:29.035049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:29.035496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:29.036245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:29.036668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:29.176502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:29.185416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:29.186942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:29.188118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1091c46f-b237-49a7-8c93-e956e620202f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166300 Apr 11 20:09:29.188664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1126/2483] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:29.409125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af9048dc-3f06-472a-89e0-284926eec24b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:29.410113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-af9048dc-3f06-472a-89e0-284926eec24b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:29.419409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af9048dc-3f06-472a-89e0-284926eec24b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:29.419848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af9048dc-3f06-472a-89e0-284926eec24b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:29.420595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af9048dc-3f06-472a-89e0-284926eec24b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:29.421062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af9048dc-3f06-472a-89e0-284926eec24b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:29.491843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-af9048dc-3f06-472a-89e0-284926eec24b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:29.500582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-af9048dc-3f06-472a-89e0-284926eec24b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.097956 Apr 11 20:09:29.501184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1358/2484] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:29 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:30.206154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:30.206764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:30.213467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:30.213892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:30.214672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:30.215104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:30.343265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:30.351603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:30.353144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:30.354305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-67d72f48-812f-437e-9863-e69d23117660 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.152278 Apr 11 20:09:30.354942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1127/2485] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:30.521647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd3e5553-588f-4e68-99eb-34a050c113ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:30.522548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd3e5553-588f-4e68-99eb-34a050c113ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:30.530819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd3e5553-588f-4e68-99eb-34a050c113ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:30.531268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd3e5553-588f-4e68-99eb-34a050c113ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:30.532027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd3e5553-588f-4e68-99eb-34a050c113ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:30.532462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd3e5553-588f-4e68-99eb-34a050c113ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:30.605556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd3e5553-588f-4e68-99eb-34a050c113ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:30.613920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd3e5553-588f-4e68-99eb-34a050c113ce tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.098864 Apr 11 20:09:30.614476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1359/2486] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:30 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:31.376718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:31.377619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:31.388140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:31.388864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:31.390146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:31.390866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:31.533675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:31.545067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:31.546541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:31.547701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3fd7b190-e6d5-4680-9bac-8ac84c3305c7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.178196 Apr 11 20:09:31.548227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1128/2487] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:31.635057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-87d5ecc0-5cdd-48ef-92aa-6baee0fa534a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:31.636001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-87d5ecc0-5cdd-48ef-92aa-6baee0fa534a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:31.643333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87d5ecc0-5cdd-48ef-92aa-6baee0fa534a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:31.643829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87d5ecc0-5cdd-48ef-92aa-6baee0fa534a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:31.644665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87d5ecc0-5cdd-48ef-92aa-6baee0fa534a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:31.645178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87d5ecc0-5cdd-48ef-92aa-6baee0fa534a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:31.707206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-87d5ecc0-5cdd-48ef-92aa-6baee0fa534a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:31.715224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-87d5ecc0-5cdd-48ef-92aa-6baee0fa534a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086746 Apr 11 20:09:31.715780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1360/2488] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:31 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:32.570280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:32.571496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:32.579453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:32.579909 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:32.580675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:32.581150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:32.716807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:32.725674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:32.727505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:32.728682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c26759ac-34bd-4ae2-81af-22d34d6ad64b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165092 Apr 11 20:09:32.729268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1129/2489] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:32.731675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a19cfa44-ec0a-4f8c-a4a5-64f23ffab16b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:32.732346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a19cfa44-ec0a-4f8c-a4a5-64f23ffab16b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:32.738801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a19cfa44-ec0a-4f8c-a4a5-64f23ffab16b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:32.739255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a19cfa44-ec0a-4f8c-a4a5-64f23ffab16b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:32.740003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a19cfa44-ec0a-4f8c-a4a5-64f23ffab16b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:32.740437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a19cfa44-ec0a-4f8c-a4a5-64f23ffab16b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:32.804400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a19cfa44-ec0a-4f8c-a4a5-64f23ffab16b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:32.812809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a19cfa44-ec0a-4f8c-a4a5-64f23ffab16b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085010 Apr 11 20:09:32.813457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1361/2490] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:32 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:33.751777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:33.752752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:33.763063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:33.763509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:33.764269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:33.764697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:33.830047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f51b41b9-1fd5-45f7-b374-7508119b1292 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:33.830643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f51b41b9-1fd5-45f7-b374-7508119b1292 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:33.837485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51b41b9-1fd5-45f7-b374-7508119b1292 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:33.837934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51b41b9-1fd5-45f7-b374-7508119b1292 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:33.838703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51b41b9-1fd5-45f7-b374-7508119b1292 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:33.839160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51b41b9-1fd5-45f7-b374-7508119b1292 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:33.916839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f51b41b9-1fd5-45f7-b374-7508119b1292 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:33.925255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f51b41b9-1fd5-45f7-b374-7508119b1292 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099099 Apr 11 20:09:33.925828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1362/2491] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:33 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:33.936647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:33.945758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:33.947258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:33.948437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c625f2fb-c36d-4f60-91f8-a105d7877925 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.203664 Apr 11 20:09:33.949013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1130/2492] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:34.945522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd5067c9-d148-4279-bf35-c682ed3ff658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:34.946520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd5067c9-d148-4279-bf35-c682ed3ff658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:34.957256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd5067c9-d148-4279-bf35-c682ed3ff658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:34.958117 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd5067c9-d148-4279-bf35-c682ed3ff658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:34.959246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd5067c9-d148-4279-bf35-c682ed3ff658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:34.959952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd5067c9-d148-4279-bf35-c682ed3ff658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:34.968961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:34.969602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:34.976695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:34.977176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:34.977956 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:34.978448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:35.036262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bd5067c9-d148-4279-bf35-c682ed3ff658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:35.044404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd5067c9-d148-4279-bf35-c682ed3ff658 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.105338 Apr 11 20:09:35.044974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1363/2493] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:34 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:35.122469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:35.131294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:35.132772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:35.133984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3938f0f2-83f0-417c-8745-0f94a81d454d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169439 Apr 11 20:09:35.134488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1131/2494] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:36.065401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56489c58-e761-4bfb-b100-7b5c4af4283f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:36.066292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56489c58-e761-4bfb-b100-7b5c4af4283f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:36.075799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56489c58-e761-4bfb-b100-7b5c4af4283f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:36.076250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56489c58-e761-4bfb-b100-7b5c4af4283f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:36.077037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56489c58-e761-4bfb-b100-7b5c4af4283f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:36.077471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56489c58-e761-4bfb-b100-7b5c4af4283f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:36.147540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56489c58-e761-4bfb-b100-7b5c4af4283f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:36.152281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:36.152894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:36.155804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56489c58-e761-4bfb-b100-7b5c4af4283f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096500 Apr 11 20:09:36.156403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1364/2495] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:36 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:36.159764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:36.160249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:36.161034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:36.161466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:36.294923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:36.303296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:36.304795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:36.305997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2d58b00-41d4-4cfb-82fb-b596f3d6cb2f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.157549 Apr 11 20:09:36.306563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1132/2496] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:37.176289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a792ca4c-26fc-4a32-b020-33bfb849f95c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:37.177333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a792ca4c-26fc-4a32-b020-33bfb849f95c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:37.186506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a792ca4c-26fc-4a32-b020-33bfb849f95c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:37.186948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a792ca4c-26fc-4a32-b020-33bfb849f95c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:37.187701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a792ca4c-26fc-4a32-b020-33bfb849f95c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:37.188126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a792ca4c-26fc-4a32-b020-33bfb849f95c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:37.247950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a792ca4c-26fc-4a32-b020-33bfb849f95c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:37.256260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a792ca4c-26fc-4a32-b020-33bfb849f95c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086281 Apr 11 20:09:37.256829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1365/2497] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:37 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:37.329190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:37.330535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:37.343459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:37.344110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:37.345279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:37.345915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:37.514963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:37.528085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:37.529602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:37.530780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf21070f-9443-4c73-9c13-9b8d43d75184 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.208646 Apr 11 20:09:37.531347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1133/2498] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:38.276994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc2032f8-d2f1-4a7c-8727-b544dd0052df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:38.278246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc2032f8-d2f1-4a7c-8727-b544dd0052df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:38.286424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc2032f8-d2f1-4a7c-8727-b544dd0052df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:38.286975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc2032f8-d2f1-4a7c-8727-b544dd0052df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:38.287914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc2032f8-d2f1-4a7c-8727-b544dd0052df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:38.288450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc2032f8-d2f1-4a7c-8727-b544dd0052df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:38.356295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc2032f8-d2f1-4a7c-8727-b544dd0052df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:38.364565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc2032f8-d2f1-4a7c-8727-b544dd0052df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094135 Apr 11 20:09:38.365166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1366/2499] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:38 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:38.552831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:38.553715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:38.562438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:38.562884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:38.563631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:38.564152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:38.703752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:38.712525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:38.714027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:38.715196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9aed8ca5-9ff1-4319-89e4-2f0c59c940ba tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168882 Apr 11 20:09:38.715723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1134/2500] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:38 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:39.386502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7bf4a75c-dfac-4e11-95aa-e0f1339da650 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:39.387470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7bf4a75c-dfac-4e11-95aa-e0f1339da650 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:39.396314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf4a75c-dfac-4e11-95aa-e0f1339da650 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:39.396934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf4a75c-dfac-4e11-95aa-e0f1339da650 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:39.397918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf4a75c-dfac-4e11-95aa-e0f1339da650 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:39.398492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf4a75c-dfac-4e11-95aa-e0f1339da650 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:39.464016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7bf4a75c-dfac-4e11-95aa-e0f1339da650 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:39.472000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7bf4a75c-dfac-4e11-95aa-e0f1339da650 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092208 Apr 11 20:09:39.472571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1367/2501] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:39 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:39.734487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:39.735055 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:39.742532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:39.742975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:39.743727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:39.744152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:39.885293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:39.894370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:39.895858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:39.897058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5de4548d-05e8-4d44-a852-0a2a984f06f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166751 Apr 11 20:09:39.897592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1135/2502] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:40.493744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6a84a8c-e17f-4409-8c5a-d9ef6df324da tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:40.494662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e6a84a8c-e17f-4409-8c5a-d9ef6df324da tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:40.502544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6a84a8c-e17f-4409-8c5a-d9ef6df324da tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:40.502988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6a84a8c-e17f-4409-8c5a-d9ef6df324da tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:40.503735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6a84a8c-e17f-4409-8c5a-d9ef6df324da tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:40.504157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6a84a8c-e17f-4409-8c5a-d9ef6df324da tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:40.567326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6a84a8c-e17f-4409-8c5a-d9ef6df324da tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:40.575416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6a84a8c-e17f-4409-8c5a-d9ef6df324da tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088684 Apr 11 20:09:40.576012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1368/2503] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:40 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:40.918631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:40.919226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:40.927731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:40.928623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:40.929435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:40.929865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:41.067037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:41.083016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:41.084494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:41.085888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-af7811eb-6d32-47cf-8480-9e8709c1ca1c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.173078 Apr 11 20:09:41.086451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1136/2504] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:41.593915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb01d01a-1892-4df8-bc13-d25b974cf458 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:41.594530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb01d01a-1892-4df8-bc13-d25b974cf458 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:41.601432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb01d01a-1892-4df8-bc13-d25b974cf458 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:41.601876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb01d01a-1892-4df8-bc13-d25b974cf458 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:41.602629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb01d01a-1892-4df8-bc13-d25b974cf458 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:41.603055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb01d01a-1892-4df8-bc13-d25b974cf458 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:41.669236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bb01d01a-1892-4df8-bc13-d25b974cf458 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:41.677474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb01d01a-1892-4df8-bc13-d25b974cf458 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.088121 Apr 11 20:09:41.678075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1369/2505] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:41 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:42.108377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:42.109445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:42.120089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:42.120838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:42.122007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:42.122438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:42.264017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:42.276897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:42.278890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:42.280065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5db21110-fe40-4450-831f-af235dc8b25e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.178207 Apr 11 20:09:42.280630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1137/2506] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:42.698084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-03c7271a-c796-4c35-a292-4ab6b903603a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:42.699045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-03c7271a-c796-4c35-a292-4ab6b903603a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:42.706319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03c7271a-c796-4c35-a292-4ab6b903603a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:42.706758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03c7271a-c796-4c35-a292-4ab6b903603a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:42.707504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03c7271a-c796-4c35-a292-4ab6b903603a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:42.707930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03c7271a-c796-4c35-a292-4ab6b903603a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:42.773757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-03c7271a-c796-4c35-a292-4ab6b903603a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:42.781845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-03c7271a-c796-4c35-a292-4ab6b903603a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090590 Apr 11 20:09:42.782411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1370/2507] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:42 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:43.304357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:43.305371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:43.316886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:43.317701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:43.319032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:43.319826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:43.478516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:43.487468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:43.488990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:43.490168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65b19bb1-d1ce-4543-a40e-65dd78a4a7d4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.194389 Apr 11 20:09:43.490728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1138/2508] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:43.506715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:09:43.506882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:09:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:09:43.802607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6ccdfc81-d279-429f-9d4d-17bd0b7c0da9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:43.803597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6ccdfc81-d279-429f-9d4d-17bd0b7c0da9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:43.812808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ccdfc81-d279-429f-9d4d-17bd0b7c0da9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:43.813287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ccdfc81-d279-429f-9d4d-17bd0b7c0da9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:43.814059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ccdfc81-d279-429f-9d4d-17bd0b7c0da9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:43.814489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ccdfc81-d279-429f-9d4d-17bd0b7c0da9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:43.881307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6ccdfc81-d279-429f-9d4d-17bd0b7c0da9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:43.891421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6ccdfc81-d279-429f-9d4d-17bd0b7c0da9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095142 Apr 11 20:09:43.891995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1371/2509] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:43 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:44.514613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:44.515769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:44.526979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:44.527855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:44.528610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:44.529075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:44.670406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:44.683354 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:44.685747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:44.687953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-55a30013-57e8-4408-b564-2da2f9cbc073 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.181162 Apr 11 20:09:44.688742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1139/2510] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:44.911893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-00fb0615-28b6-49a2-ac93-868a9d96e0f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:44.912795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-00fb0615-28b6-49a2-ac93-868a9d96e0f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:44.921558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00fb0615-28b6-49a2-ac93-868a9d96e0f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:44.922004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00fb0615-28b6-49a2-ac93-868a9d96e0f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:44.922791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00fb0615-28b6-49a2-ac93-868a9d96e0f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:44.923222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00fb0615-28b6-49a2-ac93-868a9d96e0f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:45.001114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-00fb0615-28b6-49a2-ac93-868a9d96e0f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:45.013789 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-00fb0615-28b6-49a2-ac93-868a9d96e0f2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.108243 Apr 11 20:09:45.014700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1372/2511] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:44 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:45.715019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:45.715869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:45.726206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:45.726952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:45.728198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:45.728954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:45.862612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:45.871674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:45.873199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:45.874688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c92240ad-1df0-4dc5-a7df-891394fbb0e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166751 Apr 11 20:09:45.875254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1140/2512] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:45 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:46.036842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b829e90c-9297-4df2-89ac-41583be5823c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:46.037457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b829e90c-9297-4df2-89ac-41583be5823c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:46.044088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b829e90c-9297-4df2-89ac-41583be5823c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:46.044536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b829e90c-9297-4df2-89ac-41583be5823c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:46.045317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b829e90c-9297-4df2-89ac-41583be5823c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:46.045742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b829e90c-9297-4df2-89ac-41583be5823c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:46.105828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b829e90c-9297-4df2-89ac-41583be5823c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:46.113812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b829e90c-9297-4df2-89ac-41583be5823c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081085 Apr 11 20:09:46.114375 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1373/2513] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:46 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:46.897224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:46.898230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:46.909150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:46.909947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:46.911204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:46.911927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:47.058742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:47.071713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:47.074180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:47.075413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-376c2969-e7a4-49ab-ac72-c37559624f0a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.184780 Apr 11 20:09:47.075991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1141/2514] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:47.131111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-22f7e027-ce73-4d33-abed-7e92513bef13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:47.131726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-22f7e027-ce73-4d33-abed-7e92513bef13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:47.138485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22f7e027-ce73-4d33-abed-7e92513bef13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:47.138935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22f7e027-ce73-4d33-abed-7e92513bef13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:47.139687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22f7e027-ce73-4d33-abed-7e92513bef13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:47.140119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22f7e027-ce73-4d33-abed-7e92513bef13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:47.209256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-22f7e027-ce73-4d33-abed-7e92513bef13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:47.217385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-22f7e027-ce73-4d33-abed-7e92513bef13 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090181 Apr 11 20:09:47.217939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1374/2515] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:47 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:48.098104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:48.099100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:48.109803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:48.110541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:48.111786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:48.112499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:48.234719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bcc4e918-9c2d-4e8d-91b0-2781f619359b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:48.235303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bcc4e918-9c2d-4e8d-91b0-2781f619359b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:48.241894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcc4e918-9c2d-4e8d-91b0-2781f619359b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:48.242346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcc4e918-9c2d-4e8d-91b0-2781f619359b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:48.243109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcc4e918-9c2d-4e8d-91b0-2781f619359b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:48.243543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcc4e918-9c2d-4e8d-91b0-2781f619359b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:48.247694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:48.256652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:48.258178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:48.259348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8210c61-ec8f-4a8e-a698-496ab0006360 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.167746 Apr 11 20:09:48.259902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1142/2516] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:48.306209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bcc4e918-9c2d-4e8d-91b0-2781f619359b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:48.314661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bcc4e918-9c2d-4e8d-91b0-2781f619359b tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083904 Apr 11 20:09:48.315242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1375/2517] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:48 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:49.281735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:49.282687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:49.293297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:49.293748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:49.294503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:49.294928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:49.335433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-24db6bdf-8e41-454b-b5b8-2e40bcea2f09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:49.336346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-24db6bdf-8e41-454b-b5b8-2e40bcea2f09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:49.345969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24db6bdf-8e41-454b-b5b8-2e40bcea2f09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:49.346623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24db6bdf-8e41-454b-b5b8-2e40bcea2f09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:49.347811 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24db6bdf-8e41-454b-b5b8-2e40bcea2f09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:49.348486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24db6bdf-8e41-454b-b5b8-2e40bcea2f09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:49.422438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-24db6bdf-8e41-454b-b5b8-2e40bcea2f09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:49.430782 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-24db6bdf-8e41-454b-b5b8-2e40bcea2f09 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.102005 Apr 11 20:09:49.431562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1376/2518] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:49 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:49.451404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:49.460427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:49.461940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:49.463098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c99342aa-4c15-473f-ae75-f59b59f99724 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.187963 Apr 11 20:09:49.463642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1143/2519] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:50.450207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b9988537-2368-4d7d-8343-f0b811466be8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:50.453671 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b9988537-2368-4d7d-8343-f0b811466be8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:50.460062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9988537-2368-4d7d-8343-f0b811466be8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:50.460649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9988537-2368-4d7d-8343-f0b811466be8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:50.461690 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9988537-2368-4d7d-8343-f0b811466be8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:50.462258 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9988537-2368-4d7d-8343-f0b811466be8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:50.482012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:50.482625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:50.489253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:50.489700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:50.490465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:50.490892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:50.523636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9988537-2368-4d7d-8343-f0b811466be8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:50.532064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b9988537-2368-4d7d-8343-f0b811466be8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087126 Apr 11 20:09:50.532669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1377/2520] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:50 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:50.623079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:50.636158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:50.637934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:50.639099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e69689f3-f371-4615-8af1-a0683fd30b12 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.161050 Apr 11 20:09:50.639666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1144/2521] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:51.553107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8527619d-cacd-4f8c-9c16-43f78a6da81a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:51.554162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8527619d-cacd-4f8c-9c16-43f78a6da81a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:51.564624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8527619d-cacd-4f8c-9c16-43f78a6da81a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:51.565417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8527619d-cacd-4f8c-9c16-43f78a6da81a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:51.566644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8527619d-cacd-4f8c-9c16-43f78a6da81a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:51.567354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8527619d-cacd-4f8c-9c16-43f78a6da81a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:51.629426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8527619d-cacd-4f8c-9c16-43f78a6da81a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:51.637462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8527619d-cacd-4f8c-9c16-43f78a6da81a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090759 Apr 11 20:09:51.638012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1378/2522] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:51 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:51.657599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:51.658180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:51.665212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:51.665664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:51.666417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:51.666850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:51.796190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:51.804626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:51.806090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:51.807260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e53414d6-83b5-4f1f-b856-a0fc83533532 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.153574 Apr 11 20:09:51.807817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1145/2523] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:51 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:52.657404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-caba6b96-73fa-4e73-8001-e146528318e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:52.658104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-caba6b96-73fa-4e73-8001-e146528318e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:52.666666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caba6b96-73fa-4e73-8001-e146528318e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:52.667251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caba6b96-73fa-4e73-8001-e146528318e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:52.668241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caba6b96-73fa-4e73-8001-e146528318e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:52.668807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caba6b96-73fa-4e73-8001-e146528318e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:52.737388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-caba6b96-73fa-4e73-8001-e146528318e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:52.745687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-caba6b96-73fa-4e73-8001-e146528318e5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093853 Apr 11 20:09:52.746357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1379/2524] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:52 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:52.828374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:52.829059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:52.838120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:52.838575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:52.840759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:52.840759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:52.973568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:52.982283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:52.983760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:52.984934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c1a0b4a-2aac-4714-a23e-ae10a037ba4a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162216 Apr 11 20:09:52.985500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1146/2525] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:53.767038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d2a2bada-767c-4b62-a0cd-4ee3f76e94e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:53.767832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d2a2bada-767c-4b62-a0cd-4ee3f76e94e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:53.777458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2a2bada-767c-4b62-a0cd-4ee3f76e94e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:53.778147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2a2bada-767c-4b62-a0cd-4ee3f76e94e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:53.779305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2a2bada-767c-4b62-a0cd-4ee3f76e94e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:53.779972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2a2bada-767c-4b62-a0cd-4ee3f76e94e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:53.844798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d2a2bada-767c-4b62-a0cd-4ee3f76e94e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:53.853070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d2a2bada-767c-4b62-a0cd-4ee3f76e94e9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.092312 Apr 11 20:09:53.853635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1380/2526] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:53 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:54.007567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:54.008763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:54.019807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:54.020607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:54.021971 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:54.022699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:54.155630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:54.163934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:54.165444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:54.166634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2cce825-2fa9-445d-8046-eac5c481c8a3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165693 Apr 11 20:09:54.167250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1147/2527] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:54.874951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-de3c6eb5-63b8-4476-9b1d-345ec495531c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:54.875748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-de3c6eb5-63b8-4476-9b1d-345ec495531c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:54.884348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de3c6eb5-63b8-4476-9b1d-345ec495531c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:54.884960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de3c6eb5-63b8-4476-9b1d-345ec495531c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:54.886059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de3c6eb5-63b8-4476-9b1d-345ec495531c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:54.886651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de3c6eb5-63b8-4476-9b1d-345ec495531c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:54.950171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-de3c6eb5-63b8-4476-9b1d-345ec495531c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:54.958209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-de3c6eb5-63b8-4476-9b1d-345ec495531c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089456 Apr 11 20:09:54.958773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1381/2528] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:54 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:55.185133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:55.185835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:55.192521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:55.193299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:55.194065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:55.194495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:55.318478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:55.327438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:55.328947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:55.330127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fffd8479-3a9d-4264-969a-ba871abb10b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.149112 Apr 11 20:09:55.330685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1148/2529] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:55.981586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c338c193-51aa-4a62-8d0c-afe241c9022c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:55.982218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c338c193-51aa-4a62-8d0c-afe241c9022c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:55.988648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c338c193-51aa-4a62-8d0c-afe241c9022c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:55.989149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c338c193-51aa-4a62-8d0c-afe241c9022c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:55.989916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c338c193-51aa-4a62-8d0c-afe241c9022c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:55.990591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c338c193-51aa-4a62-8d0c-afe241c9022c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:56.055629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c338c193-51aa-4a62-8d0c-afe241c9022c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:56.063720 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c338c193-51aa-4a62-8d0c-afe241c9022c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091129 Apr 11 20:09:56.064242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1382/2530] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:55 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:56.352721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:56.353679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:56.364312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:56.365128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:56.366403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:56.367139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:56.512335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:56.521601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:56.523175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:56.524361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b217185d-4a95-4cb2-869a-724e59230f6f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.178229 Apr 11 20:09:56.524943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1149/2531] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:57.083977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b87ef74c-3b00-4a55-91e4-575652eebd0d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:57.084956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b87ef74c-3b00-4a55-91e4-575652eebd0d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:57.093561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b87ef74c-3b00-4a55-91e4-575652eebd0d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:57.094004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b87ef74c-3b00-4a55-91e4-575652eebd0d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:57.094761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b87ef74c-3b00-4a55-91e4-575652eebd0d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:57.095181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b87ef74c-3b00-4a55-91e4-575652eebd0d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:57.170070 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b87ef74c-3b00-4a55-91e4-575652eebd0d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:57.178548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b87ef74c-3b00-4a55-91e4-575652eebd0d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.101190 Apr 11 20:09:57.179179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1383/2532] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:57 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:57.547664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:57.548644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:57.559353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:57.560100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:57.561448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:57.562190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:57.700246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:57.709224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:57.710708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:57.711876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f1275d23-ed5a-4085-8f74-52a0d97c891c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171044 Apr 11 20:09:57.712462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1150/2533] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:58.199693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-060b9855-adc4-4d02-99ac-f68ec351dd59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:58.200323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-060b9855-adc4-4d02-99ac-f68ec351dd59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:58.207192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-060b9855-adc4-4d02-99ac-f68ec351dd59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:58.207650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-060b9855-adc4-4d02-99ac-f68ec351dd59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:58.208401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-060b9855-adc4-4d02-99ac-f68ec351dd59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:58.208856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-060b9855-adc4-4d02-99ac-f68ec351dd59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:58.269362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-060b9855-adc4-4d02-99ac-f68ec351dd59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:58.277752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-060b9855-adc4-4d02-99ac-f68ec351dd59 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084404 Apr 11 20:09:58.278332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1384/2534] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:58 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:58.457281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:09:58.457590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:09:58.734887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:58.735880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:58.746454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:58.746906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:58.747665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:58.748093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:58.881818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:58.891209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:58.892727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:58.893927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce8b475c-6ca5-4a15-bc49-0bdef37ab9e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165912 Apr 11 20:09:58.894492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1151/2535] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:58 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:09:59.294787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ef9cecc-132e-43d7-b7cc-d3916a176574 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:59.295402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ef9cecc-132e-43d7-b7cc-d3916a176574 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:59.302335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ef9cecc-132e-43d7-b7cc-d3916a176574 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:59.302788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ef9cecc-132e-43d7-b7cc-d3916a176574 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:59.303543 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ef9cecc-132e-43d7-b7cc-d3916a176574 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:59.303976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ef9cecc-132e-43d7-b7cc-d3916a176574 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:59.369472 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0ef9cecc-132e-43d7-b7cc-d3916a176574 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:09:59.378406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ef9cecc-132e-43d7-b7cc-d3916a176574 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.087535 Apr 11 20:09:59.378980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1385/2536] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:09:59 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:09:59.911854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:09:59.912455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:09:59.919405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:59.919829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:09:59.920608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:09:59.921064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:00.048834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:00.057553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:00.059142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:00.060278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72643247-fe01-4de9-993e-1f6327a9c6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.152453 Apr 11 20:10:00.060834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1152/2537] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:09:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:00.401429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aee4f2b5-a18a-4b9a-b725-e8dc8e0e65e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:00.401994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aee4f2b5-a18a-4b9a-b725-e8dc8e0e65e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:00.408950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aee4f2b5-a18a-4b9a-b725-e8dc8e0e65e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:00.409512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aee4f2b5-a18a-4b9a-b725-e8dc8e0e65e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:00.410349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aee4f2b5-a18a-4b9a-b725-e8dc8e0e65e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:00.410804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aee4f2b5-a18a-4b9a-b725-e8dc8e0e65e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:00.475761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aee4f2b5-a18a-4b9a-b725-e8dc8e0e65e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:00.483634 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aee4f2b5-a18a-4b9a-b725-e8dc8e0e65e2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.086345 Apr 11 20:10:00.484169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1386/2538] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:00 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:01.079131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:01.079740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:01.086607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:01.087058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:01.087817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:01.088251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:01.235991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:01.245080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:01.246605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:01.247835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fb0cad49-f7b0-453d-b919-924ad6207712 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.172717 Apr 11 20:10:01.248694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1153/2539] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:01.504728 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-200b8eeb-d93c-42b4-a655-8149a88009cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:01.505706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-200b8eeb-d93c-42b4-a655-8149a88009cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:01.516240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-200b8eeb-d93c-42b4-a655-8149a88009cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:01.516980 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-200b8eeb-d93c-42b4-a655-8149a88009cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:01.518220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-200b8eeb-d93c-42b4-a655-8149a88009cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:01.518954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-200b8eeb-d93c-42b4-a655-8149a88009cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:01.583441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-200b8eeb-d93c-42b4-a655-8149a88009cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:01.592096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-200b8eeb-d93c-42b4-a655-8149a88009cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094199 Apr 11 20:10:01.592647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1387/2540] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:01 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:02.270637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:02.271686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:02.280506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:02.280953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:02.281737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:02.282159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:02.410126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:02.422755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:02.425087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:02.426874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f73fb7e5-22ac-4384-bf35-231a9544adf1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162640 Apr 11 20:10:02.427695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1154/2541] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:02.613089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1de1980-4b64-4ce6-aea2-55fcab0c32f8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:02.613958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1de1980-4b64-4ce6-aea2-55fcab0c32f8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:02.625177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1de1980-4b64-4ce6-aea2-55fcab0c32f8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:02.625962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1de1980-4b64-4ce6-aea2-55fcab0c32f8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:02.627252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1de1980-4b64-4ce6-aea2-55fcab0c32f8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:02.627961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1de1980-4b64-4ce6-aea2-55fcab0c32f8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:02.697105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a1de1980-4b64-4ce6-aea2-55fcab0c32f8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:02.706195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1de1980-4b64-4ce6-aea2-55fcab0c32f8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099579 Apr 11 20:10:02.706762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1388/2542] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:02 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:03.449909 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:03.450520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:03.457260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:03.457717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:03.458473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:03.459008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:03.587618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:03.601585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:03.604001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:03.605710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-772d72f4-6edc-42d6-87db-e813ea5ac9f4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162378 Apr 11 20:10:03.606235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1155/2543] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:03.727810 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-770691de-e4cc-4ab9-9a9b-f9303b9c7c5e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:03.728788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-770691de-e4cc-4ab9-9a9b-f9303b9c7c5e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:03.736359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-770691de-e4cc-4ab9-9a9b-f9303b9c7c5e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:03.736809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-770691de-e4cc-4ab9-9a9b-f9303b9c7c5e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:03.737599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-770691de-e4cc-4ab9-9a9b-f9303b9c7c5e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:03.738027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-770691de-e4cc-4ab9-9a9b-f9303b9c7c5e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:03.802137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-770691de-e4cc-4ab9-9a9b-f9303b9c7c5e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:03.810735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-770691de-e4cc-4ab9-9a9b-f9303b9c7c5e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089821 Apr 11 20:10:03.811295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1389/2544] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:03 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:04.628970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:04.629853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:04.640231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:04.641008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:04.642291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:04.643013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:04.776432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:04.785335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:04.786818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:04.787969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5985a81-ca63-4aa9-967b-6825f66077e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166052 Apr 11 20:10:04.788519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1156/2545] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:04 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:04.827679 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e310eed0-1ae9-45bb-af2c-2e51f12cf447 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:04.828259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e310eed0-1ae9-45bb-af2c-2e51f12cf447 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:04.835263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e310eed0-1ae9-45bb-af2c-2e51f12cf447 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:04.835821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e310eed0-1ae9-45bb-af2c-2e51f12cf447 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:04.836574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e310eed0-1ae9-45bb-af2c-2e51f12cf447 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:04.837037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e310eed0-1ae9-45bb-af2c-2e51f12cf447 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:04.899389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e310eed0-1ae9-45bb-af2c-2e51f12cf447 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:04.907426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e310eed0-1ae9-45bb-af2c-2e51f12cf447 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.083654 Apr 11 20:10:04.907982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1390/2546] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:04 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:05.808839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:05.809665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:05.818588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:05.819309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:05.820320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:05.820932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:05.923703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-be24de2a-2100-493f-91f1-801d67a4f76e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:05.924302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-be24de2a-2100-493f-91f1-801d67a4f76e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:05.931170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be24de2a-2100-493f-91f1-801d67a4f76e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:05.931620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be24de2a-2100-493f-91f1-801d67a4f76e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:05.932358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be24de2a-2100-493f-91f1-801d67a4f76e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:05.932819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be24de2a-2100-493f-91f1-801d67a4f76e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:05.952946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:05.961630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:05.963136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:05.964310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc3dc350-9ce8-4d0a-8021-1936924466a5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.160754 Apr 11 20:10:05.964941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1157/2547] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:05.996118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-be24de2a-2100-493f-91f1-801d67a4f76e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:06.004276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-be24de2a-2100-493f-91f1-801d67a4f76e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.084437 Apr 11 20:10:06.004994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1391/2548] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:05 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:06.987023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:06.987960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:06.997543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:06.997997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:06.999076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:06.999509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:07.021887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b33ea58-5b4c-4a84-93c6-cc0a28a71314 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:07.022472 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7b33ea58-5b4c-4a84-93c6-cc0a28a71314 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:07.029224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b33ea58-5b4c-4a84-93c6-cc0a28a71314 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:07.029674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b33ea58-5b4c-4a84-93c6-cc0a28a71314 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:07.030443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b33ea58-5b4c-4a84-93c6-cc0a28a71314 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:07.030875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b33ea58-5b4c-4a84-93c6-cc0a28a71314 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:07.110461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7b33ea58-5b4c-4a84-93c6-cc0a28a71314 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:07.119131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7b33ea58-5b4c-4a84-93c6-cc0a28a71314 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.101148 Apr 11 20:10:07.119714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1392/2549] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:07 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:07.147226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:07.157404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:07.158925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:07.160084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a978b4d-6fdb-43b8-89cf-1ab7b45359de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179709 Apr 11 20:10:07.160674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1158/2550] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:08.140005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4610f0bd-d3a8-46ed-9c9b-5480908abbd9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:08.141026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4610f0bd-d3a8-46ed-9c9b-5480908abbd9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:08.151486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4610f0bd-d3a8-46ed-9c9b-5480908abbd9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:08.152256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4610f0bd-d3a8-46ed-9c9b-5480908abbd9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:08.153537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4610f0bd-d3a8-46ed-9c9b-5480908abbd9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:08.154245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4610f0bd-d3a8-46ed-9c9b-5480908abbd9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:08.178533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:08.179098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:08.185691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:08.186133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:08.186888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:08.187316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:08.220870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4610f0bd-d3a8-46ed-9c9b-5480908abbd9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:08.229573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4610f0bd-d3a8-46ed-9c9b-5480908abbd9 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096034 Apr 11 20:10:08.230202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1393/2551] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:08 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:08.319782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:08.328413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:08.329915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:08.331121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1d12402-c142-42a6-a3dc-7a7fb56c5c65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.156448 Apr 11 20:10:08.331687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1159/2552] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:09.247357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c867bb24-4a7f-4b9f-a08a-501d947d0320 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:09.247948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c867bb24-4a7f-4b9f-a08a-501d947d0320 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:09.255674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c867bb24-4a7f-4b9f-a08a-501d947d0320 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:09.256141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c867bb24-4a7f-4b9f-a08a-501d947d0320 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:09.257012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c867bb24-4a7f-4b9f-a08a-501d947d0320 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:09.257468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c867bb24-4a7f-4b9f-a08a-501d947d0320 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:09.325320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c867bb24-4a7f-4b9f-a08a-501d947d0320 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:09.333420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c867bb24-4a7f-4b9f-a08a-501d947d0320 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.090692 Apr 11 20:10:09.333987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1394/2553] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:09 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:09.349686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:09.350313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:09.357088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:09.357530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:09.358280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:09.358737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:09.494760 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:09.504221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:09.505736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:09.506890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-60900057-3bb8-44c3-b09f-3467fc0c73a0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.161168 Apr 11 20:10:09.507496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1160/2554] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:10.351157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5f9db316-1514-4672-83a3-ec604e6ec8c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:10.351752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5f9db316-1514-4672-83a3-ec604e6ec8c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:10.358419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f9db316-1514-4672-83a3-ec604e6ec8c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:10.358856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f9db316-1514-4672-83a3-ec604e6ec8c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:10.359602 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f9db316-1514-4672-83a3-ec604e6ec8c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:10.360022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f9db316-1514-4672-83a3-ec604e6ec8c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:10.420204 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5f9db316-1514-4672-83a3-ec604e6ec8c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:10.428506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5f9db316-1514-4672-83a3-ec604e6ec8c3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.081304 Apr 11 20:10:10.429147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1395/2555] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:10 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:10.530099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:10.531152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:10.541743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:10.542543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:10.543904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:10.544612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:10.678360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:10.687076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:10.688550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:10.689746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-40a95c1e-c280-4a70-9282-e6bf569b5b72 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166602 Apr 11 20:10:10.690671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1161/2556] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:10 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:11.453924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d2a83e9c-7a38-41f6-81d9-699a7e6d4f79 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:11.454946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d2a83e9c-7a38-41f6-81d9-699a7e6d4f79 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:11.465399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2a83e9c-7a38-41f6-81d9-699a7e6d4f79 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:11.465806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2a83e9c-7a38-41f6-81d9-699a7e6d4f79 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:11.466605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2a83e9c-7a38-41f6-81d9-699a7e6d4f79 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:11.467039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2a83e9c-7a38-41f6-81d9-699a7e6d4f79 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:11.536654 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d2a83e9c-7a38-41f6-81d9-699a7e6d4f79 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:11.548803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d2a83e9c-7a38-41f6-81d9-699a7e6d4f79 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.101112 Apr 11 20:10:11.549631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1396/2557] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:11 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:11.718565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:11.719472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:11.729940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:11.730568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:11.731334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:11.731757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:11.887204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:11.896183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:11.897768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:11.898942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-29508631-62d9-45f5-a4a3-61f2724090a2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.187069 Apr 11 20:10:11.899533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1162/2558] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:12.569793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-17bf16ee-aadc-4410-a0f6-6abf9489520d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:12.570562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-17bf16ee-aadc-4410-a0f6-6abf9489520d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:12.577820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17bf16ee-aadc-4410-a0f6-6abf9489520d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:12.578272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17bf16ee-aadc-4410-a0f6-6abf9489520d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:12.579033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17bf16ee-aadc-4410-a0f6-6abf9489520d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:12.579462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17bf16ee-aadc-4410-a0f6-6abf9489520d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:12.651819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-17bf16ee-aadc-4410-a0f6-6abf9489520d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:12.660202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-17bf16ee-aadc-4410-a0f6-6abf9489520d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.094507 Apr 11 20:10:12.660758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1397/2559] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:12 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:12.921278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:12.922186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:12.932693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:12.933554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:12.934336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:12.934772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:13.077092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:13.090047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:13.091522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:13.092657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d4f70aa9-381b-434e-a11e-fa72e956eb31 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.178233 Apr 11 20:10:13.093271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1163/2560] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:13.682268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9b2fef45-79d9-4bcc-92c5-f1eac94a9f22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:13.683356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9b2fef45-79d9-4bcc-92c5-f1eac94a9f22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:13.690663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b2fef45-79d9-4bcc-92c5-f1eac94a9f22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:13.691137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b2fef45-79d9-4bcc-92c5-f1eac94a9f22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:13.691925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b2fef45-79d9-4bcc-92c5-f1eac94a9f22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:13.692373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b2fef45-79d9-4bcc-92c5-f1eac94a9f22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:13.958944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9b2fef45-79d9-4bcc-92c5-f1eac94a9f22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:13.971186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9b2fef45-79d9-4bcc-92c5-f1eac94a9f22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.295087 Apr 11 20:10:13.972146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1398/2561] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:13 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:14.115197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:14.116204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:14.127145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:14.127888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:14.129197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:14.129901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:14.269613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:14.278225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:14.279717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:14.280889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3dc72c17-8e8f-4313-960e-a48d3cd6b354 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.172280 Apr 11 20:10:14.281496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1164/2562] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:14.995684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5a3b9fd2-ca98-4b80-8c17-9a1c03673f08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:14.996292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5a3b9fd2-ca98-4b80-8c17-9a1c03673f08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:15.003493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a3b9fd2-ca98-4b80-8c17-9a1c03673f08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:15.003938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a3b9fd2-ca98-4b80-8c17-9a1c03673f08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:15.004697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a3b9fd2-ca98-4b80-8c17-9a1c03673f08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:15.005162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a3b9fd2-ca98-4b80-8c17-9a1c03673f08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:15.072343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5a3b9fd2-ca98-4b80-8c17-9a1c03673f08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:15.080422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5a3b9fd2-ca98-4b80-8c17-9a1c03673f08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.091361 Apr 11 20:10:15.081011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1399/2563] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:14 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:15.310320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:15.311215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:15.321600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:15.322775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:15.324117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:15.324843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:15.470045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:15.482507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:15.483983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:15.485168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-167913a3-bde8-43c4-b50a-cace65d67baa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.188765 Apr 11 20:10:15.485723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1165/2564] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:16.101373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c40cf7a8-2aa6-4065-8dc2-eaf41f026c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:16.102382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c40cf7a8-2aa6-4065-8dc2-eaf41f026c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:16.110062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c40cf7a8-2aa6-4065-8dc2-eaf41f026c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:16.110515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c40cf7a8-2aa6-4065-8dc2-eaf41f026c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:16.111271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c40cf7a8-2aa6-4065-8dc2-eaf41f026c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:16.111704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c40cf7a8-2aa6-4065-8dc2-eaf41f026c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:16.180175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c40cf7a8-2aa6-4065-8dc2-eaf41f026c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:16.188583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c40cf7a8-2aa6-4065-8dc2-eaf41f026c00 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.093739 Apr 11 20:10:16.189193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1400/2565] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:16 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:16.509291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:16.510221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:16.521574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:16.522316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:16.523566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:16.524292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:16.670396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:16.679761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:16.681282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:16.682456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-023e272b-8081-409f-b18b-fd5d26ce9737 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179883 Apr 11 20:10:16.683106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1166/2566] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:17.205858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c36baf70-3a96-4dea-80d3-58e398d17104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:17.206466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c36baf70-3a96-4dea-80d3-58e398d17104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:17.213355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c36baf70-3a96-4dea-80d3-58e398d17104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:17.213804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c36baf70-3a96-4dea-80d3-58e398d17104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:17.214595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c36baf70-3a96-4dea-80d3-58e398d17104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:17.215023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c36baf70-3a96-4dea-80d3-58e398d17104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:17.283376 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c36baf70-3a96-4dea-80d3-58e398d17104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:17.291740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c36baf70-3a96-4dea-80d3-58e398d17104 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.089733 Apr 11 20:10:17.292242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1401/2567] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:17 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:17.705562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:17.706606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:17.717277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:17.718033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:17.719284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:17.720060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:17.855171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:17.863515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:17.865112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:17.866205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e8368772-fa17-4190-8fe6-ef2710033319 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.167495 Apr 11 20:10:17.866738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1167/2568] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:17 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:18.311325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-116b787d-ede7-43a6-96aa-a718e26cad4d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:18.312161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-116b787d-ede7-43a6-96aa-a718e26cad4d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:18.320847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-116b787d-ede7-43a6-96aa-a718e26cad4d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:18.321486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-116b787d-ede7-43a6-96aa-a718e26cad4d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:18.322487 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-116b787d-ede7-43a6-96aa-a718e26cad4d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:18.323071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-116b787d-ede7-43a6-96aa-a718e26cad4d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:18.389165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-116b787d-ede7-43a6-96aa-a718e26cad4d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:18.400951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-116b787d-ede7-43a6-96aa-a718e26cad4d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095471 Apr 11 20:10:18.401877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1402/2569] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:18 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:18.895435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:18.896409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:18.905158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:18.905596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:18.906343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:18.906768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:19.037401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:19.045894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:19.048014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:19.048544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65a55ad3-2bf1-4e50-a909-caf2b3f4f50c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159645 Apr 11 20:10:19.049135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1168/2570] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:19.421912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-43f17e12-dce8-405e-b2f0-1e1dbc827b52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:19.422926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-43f17e12-dce8-405e-b2f0-1e1dbc827b52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:19.433593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43f17e12-dce8-405e-b2f0-1e1dbc827b52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:19.434339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43f17e12-dce8-405e-b2f0-1e1dbc827b52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:19.435592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43f17e12-dce8-405e-b2f0-1e1dbc827b52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:19.436310 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43f17e12-dce8-405e-b2f0-1e1dbc827b52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:19.503128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-43f17e12-dce8-405e-b2f0-1e1dbc827b52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:19.515540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-43f17e12-dce8-405e-b2f0-1e1dbc827b52 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.099944 Apr 11 20:10:19.516297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1403/2571] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:19 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:20.071039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:20.071970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:20.080010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:20.080483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:20.081313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:20.081768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:20.214044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:20.222721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:20.224218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:20.225418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f503371-bf8a-4f1a-a06a-ac2c50aeec05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.160945 Apr 11 20:10:20.225949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1169/2572] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:20.540892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a8132aa6-c522-435f-bfa0-66d64ba1074f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:20.541913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a8132aa6-c522-435f-bfa0-66d64ba1074f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:20.552488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8132aa6-c522-435f-bfa0-66d64ba1074f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:20.553297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8132aa6-c522-435f-bfa0-66d64ba1074f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:20.554528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8132aa6-c522-435f-bfa0-66d64ba1074f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:20.555228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8132aa6-c522-435f-bfa0-66d64ba1074f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:20.618162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a8132aa6-c522-435f-bfa0-66d64ba1074f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:20.631540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a8132aa6-c522-435f-bfa0-66d64ba1074f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.096748 Apr 11 20:10:20.632335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1404/2573] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:20 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:21.246455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:21.247132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:21.255434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:21.255926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:21.256817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:21.257385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:21.405991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:21.418696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:21.420178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:21.421376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4eda7cc1-114e-4cb5-832a-9902ea109d3c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.180898 Apr 11 20:10:21.421948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1170/2574] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:21.656360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0f119c2-656c-4ae7-8aac-99ee8b050529 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:21.657297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0f119c2-656c-4ae7-8aac-99ee8b050529 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:21.667904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0f119c2-656c-4ae7-8aac-99ee8b050529 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:21.668352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0f119c2-656c-4ae7-8aac-99ee8b050529 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:21.669149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0f119c2-656c-4ae7-8aac-99ee8b050529 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:21.669582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0f119c2-656c-4ae7-8aac-99ee8b050529 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:21.737240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d0f119c2-656c-4ae7-8aac-99ee8b050529 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:21.745692 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0f119c2-656c-4ae7-8aac-99ee8b050529 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.095901 Apr 11 20:10:21.746268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1405/2575] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:21 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:22.443887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:22.444715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:22.452917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:22.453377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:22.454129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:22.454553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:22.588635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:22.602197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:22.604567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:22.606370 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89829fad-9819-4e1e-a690-30b910860fb9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168879 Apr 11 20:10:22.607130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1171/2576] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:22.763542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2e73f318-2d28-40df-b343-55e0d6ec28bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:22.764098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2e73f318-2d28-40df-b343-55e0d6ec28bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:22.771111 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e73f318-2d28-40df-b343-55e0d6ec28bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:22.771561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e73f318-2d28-40df-b343-55e0d6ec28bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:22.772306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e73f318-2d28-40df-b343-55e0d6ec28bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:22.772733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e73f318-2d28-40df-b343-55e0d6ec28bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:22.836156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2e73f318-2d28-40df-b343-55e0d6ec28bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:22.844888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2e73f318-2d28-40df-b343-55e0d6ec28bc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 200 len: 1371 microversion: 2.1 time: 0.085324 Apr 11 20:10:22.845488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1406/2577] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:22 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:22.861859 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7b3a33d-00df-4a3d-a03a-250b03f0cb32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '.version_select at 0x7f40877481f0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:22.885825 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7b3a33d-00df-4a3d-a03a-250b03f0cb32 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-624933815" status: 202 len: 0 microversion: 2.1 time: 0.027843 Apr 11 20:10:22.886422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1172/2578] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Apr 11 20:10:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-624933815 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:10:23.625444 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:23.626053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:23.632207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:23.632660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:23.633703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:23.634131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:23.690631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95c94a7a-8154-4584-bef4-778dd7c9533a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: .version_select at 0x7f4087792550>, body: {"keypair": {"name": "tempest-keypair-281121509"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:23.705787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-95c94a7a-8154-4584-bef4-778dd7c9533a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:10:23.710536 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-95c94a7a-8154-4584-bef4-778dd7c9533a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:10:23.765864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:23.774281 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:23.775781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:23.777004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0bb20eba-2c37-49ee-990b-8217996b3324 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.156064 Apr 11 20:10:23.777573 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1407/2579] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:23 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:23.935934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-95c94a7a-8154-4584-bef4-778dd7c9533a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:10:23.940070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-95c94a7a-8154-4584-bef4-778dd7c9533a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:10:23.953705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95c94a7a-8154-4584-bef4-778dd7c9533a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.267671 Apr 11 20:10:23.954305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1173/2580] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 20:10:23 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:24.569706 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c1190f97-7f1c-4341-afe5-e394bb695190 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:24.570403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c1190f97-7f1c-4341-afe5-e394bb695190 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:24.577940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1190f97-7f1c-4341-afe5-e394bb695190 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.578386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1190f97-7f1c-4341-afe5-e394bb695190 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.579176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1190f97-7f1c-4341-afe5-e394bb695190 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.579593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1190f97-7f1c-4341-afe5-e394bb695190 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.609807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c1190f97-7f1c-4341-afe5-e394bb695190 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:10:24.614230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-af9ee222-c57c-4784-9191-dce3d648b899 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:24.615180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-af9ee222-c57c-4784-9191-dce3d648b899 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:24.621475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af9ee222-c57c-4784-9191-dce3d648b899 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.622547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af9ee222-c57c-4784-9191-dce3d648b899 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.623873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af9ee222-c57c-4784-9191-dce3d648b899 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.624522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af9ee222-c57c-4784-9191-dce3d648b899 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.661087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-af9ee222-c57c-4784-9191-dce3d648b899 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:10:24.729213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c1190f97-7f1c-4341-afe5-e394bb695190 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 204 len: 0 microversion: 2.1 time: 0.162300 Apr 11 20:10:24.736756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1408/2581] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:10:24 2022] DELETE /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:10:24.744951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c049a341-0c77-45d9-b330-50299e9c665f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:24.745447 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c049a341-0c77-45d9-b330-50299e9c665f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:24.755312 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c049a341-0c77-45d9-b330-50299e9c665f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.755677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c049a341-0c77-45d9-b330-50299e9c665f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.756453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c049a341-0c77-45d9-b330-50299e9c665f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.770270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c049a341-0c77-45d9-b330-50299e9c665f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.777951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-af9ee222-c57c-4784-9191-dce3d648b899 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 204 len: 0 microversion: 2.1 time: 0.167569 Apr 11 20:10:24.780708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1174/2582] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:10:24 2022] DELETE /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 20:10:24.787419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7b8ed071-189a-4063-aa41-84d6246aa4f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:24.788548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7b8ed071-189a-4063-aa41-84d6246aa4f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:24.796180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b8ed071-189a-4063-aa41-84d6246aa4f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.797438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b8ed071-189a-4063-aa41-84d6246aa4f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.798225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b8ed071-189a-4063-aa41-84d6246aa4f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.798692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b8ed071-189a-4063-aa41-84d6246aa4f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.806792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c049a341-0c77-45d9-b330-50299e9c665f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:10:24.901201 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c049a341-0c77-45d9-b330-50299e9c665f tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 204 len: 0 microversion: 2.1 time: 0.162441 Apr 11 20:10:24.901821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1409/2583] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:10:24 2022] DELETE /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:10:24.907942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9bfb1acf-1f74-40b3-a76f-bd16ab67f3c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:24.909141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9bfb1acf-1f74-40b3-a76f-bd16ab67f3c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:24.927327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bfb1acf-1f74-40b3-a76f-bd16ab67f3c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.927821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bfb1acf-1f74-40b3-a76f-bd16ab67f3c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.928754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bfb1acf-1f74-40b3-a76f-bd16ab67f3c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:24.929054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bfb1acf-1f74-40b3-a76f-bd16ab67f3c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:24.981400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7b8ed071-189a-4063-aa41-84d6246aa4f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:24.995745 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7b8ed071-189a-4063-aa41-84d6246aa4f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.213463 Apr 11 20:10:24.996344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1175/2584] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:24 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:25.001441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:25.002768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:25.013471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:25.013922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:25.014718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:25.015352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:25.115774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9bfb1acf-1f74-40b3-a76f-bd16ab67f3c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:25.124591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9bfb1acf-1f74-40b3-a76f-bd16ab67f3c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.221184 Apr 11 20:10:25.125386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1410/2585] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:25.130129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1bbd04e2-4eb8-4b59-96b1-86205ba35e77 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:25.131174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1bbd04e2-4eb8-4b59-96b1-86205ba35e77 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:25.137448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bbd04e2-4eb8-4b59-96b1-86205ba35e77 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:25.138160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bbd04e2-4eb8-4b59-96b1-86205ba35e77 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:25.138925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bbd04e2-4eb8-4b59-96b1-86205ba35e77 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:25.139353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bbd04e2-4eb8-4b59-96b1-86205ba35e77 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:25.194843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:25.204136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:25.205782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:25.207246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-38340b77-a454-4de6-af8e-b7500fbe9bf8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.209503 Apr 11 20:10:25.208183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1176/2586] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:25.213511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-812e33b0-ffc0-4e25-8bce-f9efe7e69cdb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] Calling method '.version_select at 0x7f4086d0b0d0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:25.245565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-812e33b0-ffc0-4e25-8bce-f9efe7e69cdb tempest-TestVolumeBootPattern-478934253 tempest-TestVolumeBootPattern-478934253-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1088380937" status: 202 len: 0 microversion: 2.1 time: 0.035486 Apr 11 20:10:25.247052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1177/2587] 10.222.0.62 () {58 vars in 1262 bytes} [Mon Apr 11 20:10:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1088380937 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:10:25.326038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1bbd04e2-4eb8-4b59-96b1-86205ba35e77 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:25.339942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1bbd04e2-4eb8-4b59-96b1-86205ba35e77 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 200 len: 1507 microversion: 2.1 time: 0.207870 Apr 11 20:10:25.340961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1411/2588] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:25 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:25.404473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-407154156", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31fd0e52-1286-4398-91da-eeb66b072c42"}], "security_groups": [{"name": "tempest-securitygroup--1410520640"}], "key_name": "tempest-keypair-281121509", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:25.555815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] validate_networks() for [('31fd0e52-1286-4398-91da-eeb66b072c42', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 20:10:26.013702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-2afa2651-73f2-43f3-a299-0049073b0d72 req-c16cd429-2360-4c81-ad0f-b0c92cb8a902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4395837c-0771-4542-9331-ae83b23b125f", "name": "network-vif-deleted", "tag": "504bc5b6-2930-407b-bbaf-dee62a4ab45a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:26.023923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-2afa2651-73f2-43f3-a299-0049073b0d72 req-c16cd429-2360-4c81-ad0f-b0c92cb8a902 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.024885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-2afa2651-73f2-43f3-a299-0049073b0d72 req-c16cd429-2360-4c81-ad0f-b0c92cb8a902 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.037552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-2afa2651-73f2-43f3-a299-0049073b0d72 req-c16cd429-2360-4c81-ad0f-b0c92cb8a902 service nova] Creating event network-vif-deleted:504bc5b6-2930-407b-bbaf-dee62a4ab45a for instance 4395837c-0771-4542-9331-ae83b23b125f on hv-cinder-83078 Apr 11 20:10:26.042685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-2afa2651-73f2-43f3-a299-0049073b0d72 req-c16cd429-2360-4c81-ad0f-b0c92cb8a902 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132600 Apr 11 20:10:26.043758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1412/2589] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:10:26.049592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-801045b2-9876-4b00-9f9a-f0b4afab2700 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:26.050294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-801045b2-9876-4b00-9f9a-f0b4afab2700 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:26.056399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801045b2-9876-4b00-9f9a-f0b4afab2700 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.056944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801045b2-9876-4b00-9f9a-f0b4afab2700 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.057744 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801045b2-9876-4b00-9f9a-f0b4afab2700 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.058176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801045b2-9876-4b00-9f9a-f0b4afab2700 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.409901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-801045b2-9876-4b00-9f9a-f0b4afab2700 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:26.418916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-801045b2-9876-4b00-9f9a-f0b4afab2700 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.373721 Apr 11 20:10:26.419497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1413/2590] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:26 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:26.432842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7ebabab9-b811-4eae-917c-363304259695 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:26.433982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7ebabab9-b811-4eae-917c-363304259695 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:26.441429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ebabab9-b811-4eae-917c-363304259695 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.441906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ebabab9-b811-4eae-917c-363304259695 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.442665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ebabab9-b811-4eae-917c-363304259695 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.443129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ebabab9-b811-4eae-917c-363304259695 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.597876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:10:26.598418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:10:26.598791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:10:26.599262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:10:26.599672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:10:26.609010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.609535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.610309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.610758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.627486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:10:26.631536 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:10:26.643126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 20:10:26.645440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 20:10:26.684290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7ebabab9-b811-4eae-917c-363304259695 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:26.692585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7ebabab9-b811-4eae-917c-363304259695 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.263701 Apr 11 20:10:26.693965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-22e7082f-35d7-4d92-ae4d-2e6dec035d22 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.293712 Apr 11 20:10:26.697266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1178/2591] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 20:10:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 20:10:26.702575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1414/2592] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:26.707277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:26.707726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:26.707939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 4395837c-0771-4542-9331-ae83b23b125f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:26.709445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:26.722263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.724132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.725031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.725463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.730865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.732231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.733370 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:26.733821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:26.754225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] HTTP exception thrown: Instance 4395837c-0771-4542-9331-ae83b23b125f could not be found. Apr 11 20:10:26.754819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Returning 404 to user: Instance 4395837c-0771-4542-9331-ae83b23b125f could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:10:26.755812 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7b68930e-7d61-4ad7-a678-00743217f358 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f" status: 404 len: 111 microversion: 2.1 time: 0.052199 Apr 11 20:10:26.756549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1415/2593] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:26 2022] GET /compute/v2.1/servers/4395837c-0771-4542-9331-ae83b23b125f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:10:26.761797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9118296a-87e5-4299-ab7b-59244f199026 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:26.762418 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9118296a-87e5-4299-ab7b-59244f199026 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:27.044282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9118296a-87e5-4299-ab7b-59244f199026 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:27.053962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9118296a-87e5-4299-ab7b-59244f199026 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1240 microversion: 2.1 time: 0.295597 Apr 11 20:10:27.054958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1416/2594] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:26 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1240 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:27.060534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d57e4b5-fb6e-4b17-b657-f5cfa6be24e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:27.061058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d57e4b5-fb6e-4b17-b657-f5cfa6be24e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:27.068079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d57e4b5-fb6e-4b17-b657-f5cfa6be24e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:27.068781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d57e4b5-fb6e-4b17-b657-f5cfa6be24e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:27.069582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d57e4b5-fb6e-4b17-b657-f5cfa6be24e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:27.070252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d57e4b5-fb6e-4b17-b657-f5cfa6be24e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:27.095982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d57e4b5-fb6e-4b17-b657-f5cfa6be24e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:10:27.151116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:27.160657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:27.162554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:27.163955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8508eed7-2af1-4f40-a13b-1195fa87e720 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.465489 Apr 11 20:10:27.192861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1179/2595] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:27.195496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d57e4b5-fb6e-4b17-b657-f5cfa6be24e8 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 204 len: 0 microversion: 2.1 time: 0.138861 Apr 11 20:10:27.196357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1417/2596] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:10:27 2022] DELETE /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:10:27.204780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c0efbe2-c740-4510-bb1a-b55d78863956 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:27.205414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c0efbe2-c740-4510-bb1a-b55d78863956 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:27.211219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c0efbe2-c740-4510-bb1a-b55d78863956 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:27.211654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c0efbe2-c740-4510-bb1a-b55d78863956 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:27.212404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c0efbe2-c740-4510-bb1a-b55d78863956 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:27.212830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c0efbe2-c740-4510-bb1a-b55d78863956 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:27.389198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c0efbe2-c740-4510-bb1a-b55d78863956 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:27.397484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c0efbe2-c740-4510-bb1a-b55d78863956 tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.196531 Apr 11 20:10:27.398065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1180/2597] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:27 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:27.437021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8ad0751-3f40-48cd-a6aa-bdf3e227ec1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:27.437817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8ad0751-3f40-48cd-a6aa-bdf3e227ec1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:27.446852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8ad0751-3f40-48cd-a6aa-bdf3e227ec1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:27.447655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8ad0751-3f40-48cd-a6aa-bdf3e227ec1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:27.449481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8ad0751-3f40-48cd-a6aa-bdf3e227ec1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:27.450280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8ad0751-3f40-48cd-a6aa-bdf3e227ec1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:27.669887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8ad0751-3f40-48cd-a6aa-bdf3e227ec1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:27.677901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8ad0751-3f40-48cd-a6aa-bdf3e227ec1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.245213 Apr 11 20:10:27.678477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1418/2598] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:27 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:27.709681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6b6bbbc-332c-4e52-9d76-efd0d69db381 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:27.710324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6b6bbbc-332c-4e52-9d76-efd0d69db381 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:27.717603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6b6bbbc-332c-4e52-9d76-efd0d69db381 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:27.718056 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6b6bbbc-332c-4e52-9d76-efd0d69db381 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:27.718841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6b6bbbc-332c-4e52-9d76-efd0d69db381 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:27.719277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6b6bbbc-332c-4e52-9d76-efd0d69db381 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:27.972711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6b6bbbc-332c-4e52-9d76-efd0d69db381 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:27.982826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6b6bbbc-332c-4e52-9d76-efd0d69db381 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.276854 Apr 11 20:10:27.984112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1181/2599] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:28.072479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7d0fe89-1d1c-47cb-bf53-0a13f1278bb0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:28.073356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7d0fe89-1d1c-47cb-bf53-0a13f1278bb0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:28.082863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7d0fe89-1d1c-47cb-bf53-0a13f1278bb0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.083313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7d0fe89-1d1c-47cb-bf53-0a13f1278bb0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.084302 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7d0fe89-1d1c-47cb-bf53-0a13f1278bb0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.085151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7d0fe89-1d1c-47cb-bf53-0a13f1278bb0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.155510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7d0fe89-1d1c-47cb-bf53-0a13f1278bb0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:28.166272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7d0fe89-1d1c-47cb-bf53-0a13f1278bb0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1298 microversion: 2.1 time: 0.098159 Apr 11 20:10:28.174143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1419/2600] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:28 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:28.188782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:28.189532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:28.196664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.197183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.197965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.198470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.329054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:28.340346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:28.341893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:28.343080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-41a3985a-a4ea-464a-a0fe-3b467d0bec9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159672 Apr 11 20:10:28.343646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1182/2601] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:28.414453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f52c54a0-5431-4d0a-bf1f-5bf104a5fe0c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:28.414963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f52c54a0-5431-4d0a-bf1f-5bf104a5fe0c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:28.421145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52c54a0-5431-4d0a-bf1f-5bf104a5fe0c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.421588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52c54a0-5431-4d0a-bf1f-5bf104a5fe0c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.422329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52c54a0-5431-4d0a-bf1f-5bf104a5fe0c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.422884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52c54a0-5431-4d0a-bf1f-5bf104a5fe0c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.568333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f52c54a0-5431-4d0a-bf1f-5bf104a5fe0c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc87368fa6c24e50b4214a57d6783530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f4cd9fe29043878982a24319784c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:28.578644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f52c54a0-5431-4d0a-bf1f-5bf104a5fe0c tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 200 len: 1521 microversion: 2.1 time: 0.168094 Apr 11 20:10:28.579558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1420/2602] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:28 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:28.696029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19fd674d-3b5b-4a58-b865-4e3498e8df51 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:28.696959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19fd674d-3b5b-4a58-b865-4e3498e8df51 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:28.704747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19fd674d-3b5b-4a58-b865-4e3498e8df51 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.705842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19fd674d-3b5b-4a58-b865-4e3498e8df51 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.706924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19fd674d-3b5b-4a58-b865-4e3498e8df51 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.707506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19fd674d-3b5b-4a58-b865-4e3498e8df51 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.855727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-dd5035d6-85d7-4997-bf45-c5a8090f7771 req-2c6a8c20-1348-47ee-b1fb-f98f7f90dbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e337b2e-3267-4f57-952b-3d398b9ef338", "name": "network-vif-deleted", "tag": "7ac0655e-7efe-4268-ad4b-20c2b11fb3fb"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:28.859966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19fd674d-3b5b-4a58-b865-4e3498e8df51 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:28.869793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19fd674d-3b5b-4a58-b865-4e3498e8df51 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.178552 Apr 11 20:10:28.871326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1183/2603] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:28 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:28.881398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-dd5035d6-85d7-4997-bf45-c5a8090f7771 req-2c6a8c20-1348-47ee-b1fb-f98f7f90dbb6 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:28.881977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-dd5035d6-85d7-4997-bf45-c5a8090f7771 req-2c6a8c20-1348-47ee-b1fb-f98f7f90dbb6 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:28.895249 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-dd5035d6-85d7-4997-bf45-c5a8090f7771 req-2c6a8c20-1348-47ee-b1fb-f98f7f90dbb6 service nova] Creating event network-vif-deleted:7ac0655e-7efe-4268-ad4b-20c2b11fb3fb for instance 5e337b2e-3267-4f57-952b-3d398b9ef338 on hv-cinder-83078 Apr 11 20:10:28.905555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-dd5035d6-85d7-4997-bf45-c5a8090f7771 req-2c6a8c20-1348-47ee-b1fb-f98f7f90dbb6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053523 Apr 11 20:10:28.907097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1421/2604] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:10:29.001062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-97683ece-d068-4646-89a2-724b6a0bf9bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:29.001834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-97683ece-d068-4646-89a2-724b6a0bf9bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:29.008842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97683ece-d068-4646-89a2-724b6a0bf9bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.009422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97683ece-d068-4646-89a2-724b6a0bf9bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.010322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97683ece-d068-4646-89a2-724b6a0bf9bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.010884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97683ece-d068-4646-89a2-724b6a0bf9bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.154161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97683ece-d068-4646-89a2-724b6a0bf9bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:29.162662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-97683ece-d068-4646-89a2-724b6a0bf9bb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.165871 Apr 11 20:10:29.164067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1184/2605] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:29.184564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26e729c5-ea70-48f1-b27c-2e492b48b6a7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:29.186157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-26e729c5-ea70-48f1-b27c-2e492b48b6a7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:29.193751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26e729c5-ea70-48f1-b27c-2e492b48b6a7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.194552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26e729c5-ea70-48f1-b27c-2e492b48b6a7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.196009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26e729c5-ea70-48f1-b27c-2e492b48b6a7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.196663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26e729c5-ea70-48f1-b27c-2e492b48b6a7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.288391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-26e729c5-ea70-48f1-b27c-2e492b48b6a7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:29.298108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26e729c5-ea70-48f1-b27c-2e492b48b6a7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1298 microversion: 2.1 time: 0.117391 Apr 11 20:10:29.317282 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1422/2606] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:29 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:29.362838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:29.363299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:29.370720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.371658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.372709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.373882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.546213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:29.555168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:29.558194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:29.559752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00dfa7f7-d1fa-4289-abe9-1b26e215b3d1 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.201749 Apr 11 20:10:29.560855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1185/2607] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:29 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:10:29.596717 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:29.597367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] [instance: 5e337b2e-3267-4f57-952b-3d398b9ef338] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:29.603959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.604407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.605402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.605842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.621186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] HTTP exception thrown: Instance 5e337b2e-3267-4f57-952b-3d398b9ef338 could not be found. Apr 11 20:10:29.621846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] Returning 404 to user: Instance 5e337b2e-3267-4f57-952b-3d398b9ef338 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:10:29.622757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-824abd48-d2cc-4d1e-9f73-6a1769fd489a tempest-ServerRescueNegativeTestJSON-1926926686 tempest-ServerRescueNegativeTestJSON-1926926686-project] 10.222.0.62 "GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338" status: 404 len: 111 microversion: 2.1 time: 0.031121 Apr 11 20:10:29.624050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1423/2608] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:29 2022] GET /compute/v2.1/servers/5e337b2e-3267-4f57-952b-3d398b9ef338 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:10:29.887695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1a6f8aab-e897-4c6f-884b-e46b0aa874c4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:29.888415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1a6f8aab-e897-4c6f-884b-e46b0aa874c4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:29.895140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a6f8aab-e897-4c6f-884b-e46b0aa874c4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.895678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a6f8aab-e897-4c6f-884b-e46b0aa874c4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:29.896516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a6f8aab-e897-4c6f-884b-e46b0aa874c4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:29.897257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a6f8aab-e897-4c6f-884b-e46b0aa874c4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:30.104833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1a6f8aab-e897-4c6f-884b-e46b0aa874c4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:30.115045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1a6f8aab-e897-4c6f-884b-e46b0aa874c4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.231223 Apr 11 20:10:30.126012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1186/2609] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:29 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:30.180013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51acdfc0-5276-4c84-a7a0-239ce9b74ff0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:30.180832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51acdfc0-5276-4c84-a7a0-239ce9b74ff0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:30.187279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51acdfc0-5276-4c84-a7a0-239ce9b74ff0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:30.188587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51acdfc0-5276-4c84-a7a0-239ce9b74ff0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:30.189712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51acdfc0-5276-4c84-a7a0-239ce9b74ff0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:30.190873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51acdfc0-5276-4c84-a7a0-239ce9b74ff0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:30.315412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-11238caa-e8d6-4565-ba25-7dd5008c5319 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:30.315998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-11238caa-e8d6-4565-ba25-7dd5008c5319 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:30.322338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11238caa-e8d6-4565-ba25-7dd5008c5319 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:30.323381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11238caa-e8d6-4565-ba25-7dd5008c5319 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:30.323560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11238caa-e8d6-4565-ba25-7dd5008c5319 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:30.324180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11238caa-e8d6-4565-ba25-7dd5008c5319 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:30.462583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51acdfc0-5276-4c84-a7a0-239ce9b74ff0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:30.471229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51acdfc0-5276-4c84-a7a0-239ce9b74ff0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.295133 Apr 11 20:10:30.473374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1424/2610] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:30.576883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11238caa-e8d6-4565-ba25-7dd5008c5319 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:30.578578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:30.579916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:30.586429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:30.587402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-11238caa-e8d6-4565-ba25-7dd5008c5319 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1366 microversion: 2.1 time: 0.276159 Apr 11 20:10:30.587551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:30.587656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1187/2611] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:30 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:30.587749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:30.588151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:31.114083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:31.125220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:31.126946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:31.127620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2af0f656-1222-46cf-ba70-ef56ff2c7090 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.552958 Apr 11 20:10:31.134280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1425/2612] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:31.143427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-47501ebf-9076-4b9e-b9f2-1443d301ccd3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:31.144045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-47501ebf-9076-4b9e-b9f2-1443d301ccd3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:31.154474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-47501ebf-9076-4b9e-b9f2-1443d301ccd3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:31.154897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-47501ebf-9076-4b9e-b9f2-1443d301ccd3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:31.158190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-47501ebf-9076-4b9e-b9f2-1443d301ccd3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:31.159416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-47501ebf-9076-4b9e-b9f2-1443d301ccd3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:31.228635 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-9eb4e0a6-424e-4979-8d57-9d878cd0c34e req-5435f1e1-fcce-4beb-8331-b7775cd88ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382b367c-812d-487b-8506-d246e8eb9a42", "tag": "1a0dc4a3-e7aa-4e5e-b8e5-05d88837ea90"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:31.245339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-9eb4e0a6-424e-4979-8d57-9d878cd0c34e req-5435f1e1-fcce-4beb-8331-b7775cd88ac8 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:31.251024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-9eb4e0a6-424e-4979-8d57-9d878cd0c34e req-5435f1e1-fcce-4beb-8331-b7775cd88ac8 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:31.265684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-9eb4e0a6-424e-4979-8d57-9d878cd0c34e req-5435f1e1-fcce-4beb-8331-b7775cd88ac8 service nova] Creating event network-changed:1a0dc4a3-e7aa-4e5e-b8e5-05d88837ea90 for instance 382b367c-812d-487b-8506-d246e8eb9a42 on hv-cinder-83078 Apr 11 20:10:31.272485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-9eb4e0a6-424e-4979-8d57-9d878cd0c34e req-5435f1e1-fcce-4beb-8331-b7775cd88ac8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Apr 11 20:10:31.284739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1426/2613] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:10:31.489366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6607b3bd-815e-4241-a1f3-44c47e7fa201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:31.490631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6607b3bd-815e-4241-a1f3-44c47e7fa201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:31.498606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6607b3bd-815e-4241-a1f3-44c47e7fa201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:31.499303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6607b3bd-815e-4241-a1f3-44c47e7fa201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:31.501263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6607b3bd-815e-4241-a1f3-44c47e7fa201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:31.502537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6607b3bd-815e-4241-a1f3-44c47e7fa201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:31.511808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-47501ebf-9076-4b9e-b9f2-1443d301ccd3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:31.521949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-47501ebf-9076-4b9e-b9f2-1443d301ccd3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.393719 Apr 11 20:10:31.537255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1188/2614] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:31 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:31.603622 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b63ef0b4-fd55-42dc-9c3b-d0b1e07bd30e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:31.604549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b63ef0b4-fd55-42dc-9c3b-d0b1e07bd30e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:31.610663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b63ef0b4-fd55-42dc-9c3b-d0b1e07bd30e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:31.611299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b63ef0b4-fd55-42dc-9c3b-d0b1e07bd30e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:31.612257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b63ef0b4-fd55-42dc-9c3b-d0b1e07bd30e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:31.612843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b63ef0b4-fd55-42dc-9c3b-d0b1e07bd30e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:31.833670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6607b3bd-815e-4241-a1f3-44c47e7fa201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:31.843518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6607b3bd-815e-4241-a1f3-44c47e7fa201 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.359005 Apr 11 20:10:31.853765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1427/2615] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:31.905380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b63ef0b4-fd55-42dc-9c3b-d0b1e07bd30e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:31.912656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b63ef0b4-fd55-42dc-9c3b-d0b1e07bd30e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1366 microversion: 2.1 time: 0.312840 Apr 11 20:10:31.913488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1189/2616] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:31 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:32.148251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:32.148999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:32.155397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:32.155922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:32.156779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:32.157311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:32.427314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:32.439166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:32.441649 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:32.443926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c66461c9-b151-461f-8aee-e4708e2073af tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.299271 Apr 11 20:10:32.445454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1428/2617] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:32.541533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf64294b-3669-4082-8b75-6ab80f89d599 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:32.542915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf64294b-3669-4082-8b75-6ab80f89d599 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:32.551311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf64294b-3669-4082-8b75-6ab80f89d599 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:32.551983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf64294b-3669-4082-8b75-6ab80f89d599 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:32.553610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf64294b-3669-4082-8b75-6ab80f89d599 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:32.554967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf64294b-3669-4082-8b75-6ab80f89d599 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:32.749483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf64294b-3669-4082-8b75-6ab80f89d599 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:32.759772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf64294b-3669-4082-8b75-6ab80f89d599 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.224090 Apr 11 20:10:32.770717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1190/2618] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:32 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:32.863490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6563b6e4-7822-4d0f-a9fe-2325520cadc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:32.865224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6563b6e4-7822-4d0f-a9fe-2325520cadc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:32.871530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6563b6e4-7822-4d0f-a9fe-2325520cadc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:32.872214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6563b6e4-7822-4d0f-a9fe-2325520cadc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:32.873745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6563b6e4-7822-4d0f-a9fe-2325520cadc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:32.874366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6563b6e4-7822-4d0f-a9fe-2325520cadc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:32.933545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6997e97b-534f-4338-8f26-dbd201c41ad7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:32.934504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6997e97b-534f-4338-8f26-dbd201c41ad7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:32.942124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6997e97b-534f-4338-8f26-dbd201c41ad7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:32.942712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6997e97b-534f-4338-8f26-dbd201c41ad7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:32.943827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6997e97b-534f-4338-8f26-dbd201c41ad7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:32.944374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6997e97b-534f-4338-8f26-dbd201c41ad7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:33.124704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6563b6e4-7822-4d0f-a9fe-2325520cadc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:33.137019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6563b6e4-7822-4d0f-a9fe-2325520cadc0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.279789 Apr 11 20:10:33.138097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1429/2619] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:33.174238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6997e97b-534f-4338-8f26-dbd201c41ad7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:33.182833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6997e97b-534f-4338-8f26-dbd201c41ad7 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1366 microversion: 2.1 time: 0.254437 Apr 11 20:10:33.193546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1191/2620] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:32 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:33.466263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:33.467516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:33.478470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:33.479185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:33.480241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:33.481435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:33.777632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8f33e0ac-9ffa-48a0-9727-ec5aa7d8a3a6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:33.778271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8f33e0ac-9ffa-48a0-9727-ec5aa7d8a3a6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:33.785176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f33e0ac-9ffa-48a0-9727-ec5aa7d8a3a6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:33.785652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f33e0ac-9ffa-48a0-9727-ec5aa7d8a3a6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:33.787209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f33e0ac-9ffa-48a0-9727-ec5aa7d8a3a6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:33.787641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f33e0ac-9ffa-48a0-9727-ec5aa7d8a3a6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:34.041724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:34.050347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:34.051825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:34.053004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8231e883-2e4f-46e0-8c13-71419caae73c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.593216 Apr 11 20:10:34.053559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1430/2621] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:34.127189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f33e0ac-9ffa-48a0-9727-ec5aa7d8a3a6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:34.135389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8f33e0ac-9ffa-48a0-9727-ec5aa7d8a3a6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.362423 Apr 11 20:10:34.136009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1192/2622] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:33 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:34.154246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ac8c3d8-97c5-4a58-8a86-f4bd4972cdec tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:34.154927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ac8c3d8-97c5-4a58-8a86-f4bd4972cdec tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:34.161469 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac8c3d8-97c5-4a58-8a86-f4bd4972cdec tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:34.161990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac8c3d8-97c5-4a58-8a86-f4bd4972cdec tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:34.162816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac8c3d8-97c5-4a58-8a86-f4bd4972cdec tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:34.163337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac8c3d8-97c5-4a58-8a86-f4bd4972cdec tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:34.199678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-52546637-720f-405e-864a-841e0fc963e0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:34.200294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-52546637-720f-405e-864a-841e0fc963e0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:34.206696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52546637-720f-405e-864a-841e0fc963e0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:34.207144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52546637-720f-405e-864a-841e0fc963e0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:34.207908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52546637-720f-405e-864a-841e0fc963e0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:34.208360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52546637-720f-405e-864a-841e0fc963e0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:34.458558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5ac8c3d8-97c5-4a58-8a86-f4bd4972cdec tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:34.469426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ac8c3d8-97c5-4a58-8a86-f4bd4972cdec tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.317592 Apr 11 20:10:34.469426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1431/2623] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:34.530675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52546637-720f-405e-864a-841e0fc963e0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:34.539607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-52546637-720f-405e-864a-841e0fc963e0 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1366 microversion: 2.1 time: 0.343704 Apr 11 20:10:34.540505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1193/2624] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:34 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:35.071596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:35.072199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:35.091462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:35.092153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:35.093133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:35.093871 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:35.155287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19e644ae-006d-4105-9129-6e069c726625 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:35.159066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19e644ae-006d-4105-9129-6e069c726625 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:35.180387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19e644ae-006d-4105-9129-6e069c726625 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:35.181695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19e644ae-006d-4105-9129-6e069c726625 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:35.183905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19e644ae-006d-4105-9129-6e069c726625 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:35.184894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19e644ae-006d-4105-9129-6e069c726625 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:35.541534 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:35.555879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:35.560134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:35.562681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e23d3ec0-1403-43b1-b1d8-9fa00fd9d9d2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.495049 Apr 11 20:10:35.564018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1432/2625] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:35.571315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1ffbc68-f2fe-433e-bc76-64c32c423a94 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:35.572470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1ffbc68-f2fe-433e-bc76-64c32c423a94 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:35.581313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1ffbc68-f2fe-433e-bc76-64c32c423a94 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:35.582065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1ffbc68-f2fe-433e-bc76-64c32c423a94 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:35.583421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1ffbc68-f2fe-433e-bc76-64c32c423a94 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:35.584046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1ffbc68-f2fe-433e-bc76-64c32c423a94 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:35.623585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19e644ae-006d-4105-9129-6e069c726625 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:35.631533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19e644ae-006d-4105-9129-6e069c726625 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.482762 Apr 11 20:10:35.632436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1194/2626] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:35 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:35.637049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e9b00bc9-34ed-445d-a7e5-aeb5a6331728 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:35.637841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e9b00bc9-34ed-445d-a7e5-aeb5a6331728 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:35.644317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9b00bc9-34ed-445d-a7e5-aeb5a6331728 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:35.644773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9b00bc9-34ed-445d-a7e5-aeb5a6331728 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:35.645568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9b00bc9-34ed-445d-a7e5-aeb5a6331728 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:35.646000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9b00bc9-34ed-445d-a7e5-aeb5a6331728 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:36.137919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1ffbc68-f2fe-433e-bc76-64c32c423a94 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:36.145133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e9b00bc9-34ed-445d-a7e5-aeb5a6331728 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:36.147389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1ffbc68-f2fe-433e-bc76-64c32c423a94 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.581485 Apr 11 20:10:36.148291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1433/2627] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:36.154018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e9b00bc9-34ed-445d-a7e5-aeb5a6331728 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1366 microversion: 2.1 time: 0.520536 Apr 11 20:10:36.155123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1195/2628] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:35 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1366 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:36.585658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:36.586851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:36.593379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:36.593828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:36.594636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:36.595067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:36.775901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1773fb38-7cc1-42f2-9d4c-04575c50cf76 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Action: 'create', calling method: .version_select at 0x7f40877f5f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-473817053", "metadata": {"Type": "work"}}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:36.777554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1773fb38-7cc1-42f2-9d4c-04575c50cf76 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:10:36.778688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1773fb38-7cc1-42f2-9d4c-04575c50cf76 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141935 Apr 11 20:10:36.779225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1196/2629] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Apr 11 20:10:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:10:36.792895 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:36.802192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-262d5fac-4a31-4243-8db2-5bfa73f464b4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:36.802597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:36.804173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-262d5fac-4a31-4243-8db2-5bfa73f464b4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:36.804348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:36.805873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-28ee5a97-abc9-4116-8bbe-e51ed3612437 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.227495 Apr 11 20:10:36.815379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-262d5fac-4a31-4243-8db2-5bfa73f464b4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:36.816862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-262d5fac-4a31-4243-8db2-5bfa73f464b4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:36.817784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1434/2630] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:36 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:36.822968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59d4460f-de93-4888-8191-a7099b301597 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Action: 'create', calling method: .version_select at 0x7f4086dc3670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1167490612", "metadata": {"Type": "work"}}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:36.824836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59d4460f-de93-4888-8191-a7099b301597 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:10:36.825759 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59d4460f-de93-4888-8191-a7099b301597 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006833 Apr 11 20:10:36.826162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-262d5fac-4a31-4243-8db2-5bfa73f464b4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:36.826453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1435/2631] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Apr 11 20:10:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:10:36.833526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-262d5fac-4a31-4243-8db2-5bfa73f464b4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:36.836500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1cf19f06-798f-4ddc-8921-a8c8dc68e487 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Action: 'create', calling method: .version_select at 0x7f408c10ad30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1569548406", "metadata": {"Type": "work"}}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:36.842124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1cf19f06-798f-4ddc-8921-a8c8dc68e487 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:10:36.842124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1cf19f06-798f-4ddc-8921-a8c8dc68e487 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007818 Apr 11 20:10:36.842124 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1436/2632] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Apr 11 20:10:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:10:36.851329 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-576dff2c-8d47-40e2-aa28-6b41da08b89e tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Calling method '.version_select at 0x7f4086e2d280>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:37.075334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-262d5fac-4a31-4243-8db2-5bfa73f464b4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:37.095064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-262d5fac-4a31-4243-8db2-5bfa73f464b4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.309623 Apr 11 20:10:37.101798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1197/2633] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:36 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:37.164004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a712bf14-d7ea-486f-8821-77ad3ba4a321 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:37.164606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a712bf14-d7ea-486f-8821-77ad3ba4a321 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:37.174510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a712bf14-d7ea-486f-8821-77ad3ba4a321 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:37.175130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a712bf14-d7ea-486f-8821-77ad3ba4a321 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:37.176255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a712bf14-d7ea-486f-8821-77ad3ba4a321 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:37.177349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a712bf14-d7ea-486f-8821-77ad3ba4a321 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:37.320012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a712bf14-d7ea-486f-8821-77ad3ba4a321 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:37.328393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a712bf14-d7ea-486f-8821-77ad3ba4a321 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.168170 Apr 11 20:10:37.329220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1198/2634] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:37 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:37.334353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f12a0e14-c890-4c62-8542-ece431dca24f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:37.335287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f12a0e14-c890-4c62-8542-ece431dca24f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:37.341300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f12a0e14-c890-4c62-8542-ece431dca24f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:37.342134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f12a0e14-c890-4c62-8542-ece431dca24f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:37.342905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f12a0e14-c890-4c62-8542-ece431dca24f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:37.343336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f12a0e14-c890-4c62-8542-ece431dca24f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:37.479886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f12a0e14-c890-4c62-8542-ece431dca24f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:37.492510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f12a0e14-c890-4c62-8542-ece431dca24f tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1366 microversion: 2.1 time: 0.162079 Apr 11 20:10:37.493132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1199/2635] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:37 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:37.620127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-03b4f564-b158-4351-8edc-156f3fe06d63 req-9b9b9f67-4490-4084-9e17-216ed874e6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382b367c-812d-487b-8506-d246e8eb9a42", "name": "network-vif-plugged", "status": "completed", "tag": "1a0dc4a3-e7aa-4e5e-b8e5-05d88837ea90"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:37.628556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-03b4f564-b158-4351-8edc-156f3fe06d63 req-9b9b9f67-4490-4084-9e17-216ed874e6a2 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:37.629027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-03b4f564-b158-4351-8edc-156f3fe06d63 req-9b9b9f67-4490-4084-9e17-216ed874e6a2 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:37.640296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-03b4f564-b158-4351-8edc-156f3fe06d63 req-9b9b9f67-4490-4084-9e17-216ed874e6a2 service nova] Creating event network-vif-plugged:1a0dc4a3-e7aa-4e5e-b8e5-05d88837ea90 for instance 382b367c-812d-487b-8506-d246e8eb9a42 on hv-cinder-83078 Apr 11 20:10:37.645455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-03b4f564-b158-4351-8edc-156f3fe06d63 req-9b9b9f67-4490-4084-9e17-216ed874e6a2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148302 Apr 11 20:10:37.645979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1200/2636] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:10:37.825009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:37.826388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:37.834274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:37.834808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:37.835994 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:37.836734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:38.026796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:38.035573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:38.037207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:38.038453 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-06f31e32-4498-4e9b-ac55-27fae2647617 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.217862 Apr 11 20:10:38.039014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1201/2637] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:37 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:10:38.112849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e731bd1f-e2b7-40f6-bacd-97ada17c9b26 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:38.113518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e731bd1f-e2b7-40f6-bacd-97ada17c9b26 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:38.119632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e731bd1f-e2b7-40f6-bacd-97ada17c9b26 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:38.120298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e731bd1f-e2b7-40f6-bacd-97ada17c9b26 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:38.121196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e731bd1f-e2b7-40f6-bacd-97ada17c9b26 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:38.121627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e731bd1f-e2b7-40f6-bacd-97ada17c9b26 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:38.252815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e731bd1f-e2b7-40f6-bacd-97ada17c9b26 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:38.261369 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e731bd1f-e2b7-40f6-bacd-97ada17c9b26 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.152220 Apr 11 20:10:38.262155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1202/2638] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:38 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:38.346955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a38cec12-ec07-4a22-90e4-169337158e3a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:38.347572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a38cec12-ec07-4a22-90e4-169337158e3a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:38.354346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a38cec12-ec07-4a22-90e4-169337158e3a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:38.354798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a38cec12-ec07-4a22-90e4-169337158e3a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:38.355587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a38cec12-ec07-4a22-90e4-169337158e3a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:38.356024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a38cec12-ec07-4a22-90e4-169337158e3a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:38.496613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a38cec12-ec07-4a22-90e4-169337158e3a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:38.505256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a38cec12-ec07-4a22-90e4-169337158e3a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.162314 Apr 11 20:10:38.505860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1203/2639] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:38.510202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9714b996-1345-4e9b-bfb5-65c80db2b337 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:38.510802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9714b996-1345-4e9b-bfb5-65c80db2b337 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:38.516343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9714b996-1345-4e9b-bfb5-65c80db2b337 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:38.516792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9714b996-1345-4e9b-bfb5-65c80db2b337 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:38.517546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9714b996-1345-4e9b-bfb5-65c80db2b337 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:38.517981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9714b996-1345-4e9b-bfb5-65c80db2b337 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:38.647207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9714b996-1345-4e9b-bfb5-65c80db2b337 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:38.659345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9714b996-1345-4e9b-bfb5-65c80db2b337 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1366 microversion: 2.1 time: 0.152552 Apr 11 20:10:38.659890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1204/2640] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:38 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:39.058011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:39.058625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:39.065143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.065596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.066368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.066805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.201856 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:39.210362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:39.211865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:39.213095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ba223ed-700e-4633-a378-94e5738c0325 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159784 Apr 11 20:10:39.213660 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1205/2641] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:39 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:39.278819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1aa73ff9-77fa-4c24-a90d-b05642a2163d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:39.279553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1aa73ff9-77fa-4c24-a90d-b05642a2163d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:39.285817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aa73ff9-77fa-4c24-a90d-b05642a2163d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.286269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aa73ff9-77fa-4c24-a90d-b05642a2163d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.287036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aa73ff9-77fa-4c24-a90d-b05642a2163d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.287468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aa73ff9-77fa-4c24-a90d-b05642a2163d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.417244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1aa73ff9-77fa-4c24-a90d-b05642a2163d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:39.425228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1aa73ff9-77fa-4c24-a90d-b05642a2163d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.150222 Apr 11 20:10:39.425802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1206/2642] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:39 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:39.526373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fb012bf6-cf7b-492d-b1b0-920ce41ba902 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:39.527464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fb012bf6-cf7b-492d-b1b0-920ce41ba902 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:39.539294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb012bf6-cf7b-492d-b1b0-920ce41ba902 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.540186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb012bf6-cf7b-492d-b1b0-920ce41ba902 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.541493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb012bf6-cf7b-492d-b1b0-920ce41ba902 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.542258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb012bf6-cf7b-492d-b1b0-920ce41ba902 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.673615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fb012bf6-cf7b-492d-b1b0-920ce41ba902 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:39.681941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fb012bf6-cf7b-492d-b1b0-920ce41ba902 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.162049 Apr 11 20:10:39.682554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1207/2643] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:39.686953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cbeef39e-9f8b-430e-9617-2b731d6a1f26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:39.687548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cbeef39e-9f8b-430e-9617-2b731d6a1f26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:39.693697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbeef39e-9f8b-430e-9617-2b731d6a1f26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.694144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbeef39e-9f8b-430e-9617-2b731d6a1f26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.694895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbeef39e-9f8b-430e-9617-2b731d6a1f26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.695320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbeef39e-9f8b-430e-9617-2b731d6a1f26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.828746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cbeef39e-9f8b-430e-9617-2b731d6a1f26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:39.836305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cbeef39e-9f8b-430e-9617-2b731d6a1f26 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1557 microversion: 2.1 time: 0.152787 Apr 11 20:10:39.836871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1208/2644] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:39 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:39.852174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-114a9ecf-632b-4775-a922-9e9945c83f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:39.852665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-114a9ecf-632b-4775-a922-9e9945c83f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:39.858780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-114a9ecf-632b-4775-a922-9e9945c83f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.859258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-114a9ecf-632b-4775-a922-9e9945c83f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.860004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-114a9ecf-632b-4775-a922-9e9945c83f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:39.860433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-114a9ecf-632b-4775-a922-9e9945c83f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:39.940673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-114a9ecf-632b-4775-a922-9e9945c83f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091995 Apr 11 20:10:39.941304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1209/2645] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Apr 11 20:10:39 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:10:40.232282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:40.233002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:40.239551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:40.239998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:40.240742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:40.241231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:40.372961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:40.384233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:40.386120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:40.387292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef38fd39-1958-4015-bce0-62f8bd1b1d5e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159254 Apr 11 20:10:40.387849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1210/2646] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:40 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:40.442279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72a95312-4c12-4b03-ad45-298137421d39 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:40.442963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-72a95312-4c12-4b03-ad45-298137421d39 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:40.449077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72a95312-4c12-4b03-ad45-298137421d39 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:40.449524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72a95312-4c12-4b03-ad45-298137421d39 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:40.450271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72a95312-4c12-4b03-ad45-298137421d39 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:40.450731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72a95312-4c12-4b03-ad45-298137421d39 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:40.579081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-72a95312-4c12-4b03-ad45-298137421d39 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:40.586985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72a95312-4c12-4b03-ad45-298137421d39 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.148637 Apr 11 20:10:40.587556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1211/2647] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:40 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:40.699750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba2f94ae-b9cd-4a14-b8d3-6b5ec3f2357b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:40.700415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba2f94ae-b9cd-4a14-b8d3-6b5ec3f2357b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:40.707278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba2f94ae-b9cd-4a14-b8d3-6b5ec3f2357b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:40.707727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba2f94ae-b9cd-4a14-b8d3-6b5ec3f2357b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:40.708483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba2f94ae-b9cd-4a14-b8d3-6b5ec3f2357b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:40.708927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba2f94ae-b9cd-4a14-b8d3-6b5ec3f2357b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:40.834514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba2f94ae-b9cd-4a14-b8d3-6b5ec3f2357b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:40.842432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba2f94ae-b9cd-4a14-b8d3-6b5ec3f2357b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.146842 Apr 11 20:10:40.843042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1212/2648] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:40.934867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-863ea3a2-d161-4279-9e15-2533880e81cd req-d586176d-2742-4b8b-a32e-cae5879cef0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382b367c-812d-487b-8506-d246e8eb9a42", "tag": "1a0dc4a3-e7aa-4e5e-b8e5-05d88837ea90"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:10:40.943026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-863ea3a2-d161-4279-9e15-2533880e81cd req-d586176d-2742-4b8b-a32e-cae5879cef0b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:40.943463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-863ea3a2-d161-4279-9e15-2533880e81cd req-d586176d-2742-4b8b-a32e-cae5879cef0b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:40.954661 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-863ea3a2-d161-4279-9e15-2533880e81cd req-d586176d-2742-4b8b-a32e-cae5879cef0b service nova] Creating event network-changed:1a0dc4a3-e7aa-4e5e-b8e5-05d88837ea90 for instance 382b367c-812d-487b-8506-d246e8eb9a42 on hv-cinder-83078 Apr 11 20:10:40.959942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-863ea3a2-d161-4279-9e15-2533880e81cd req-d586176d-2742-4b8b-a32e-cae5879cef0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028785 Apr 11 20:10:40.960640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1213/2649] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:10:41.406164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:41.407004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:41.413315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:41.413860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:41.414729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:41.415263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:41.548499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:41.560046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:41.560046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:41.560046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8cdf5792-dc1d-40af-ba88-3371abeddc0c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.157617 Apr 11 20:10:41.560471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1214/2650] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:41 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:41.605157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ae93f8f-6b6c-4c50-96f4-ce1cc321fa5d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:41.605869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ae93f8f-6b6c-4c50-96f4-ce1cc321fa5d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:41.613077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ae93f8f-6b6c-4c50-96f4-ce1cc321fa5d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:41.613564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ae93f8f-6b6c-4c50-96f4-ce1cc321fa5d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:41.614325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ae93f8f-6b6c-4c50-96f4-ce1cc321fa5d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:41.614888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ae93f8f-6b6c-4c50-96f4-ce1cc321fa5d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:41.750980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ae93f8f-6b6c-4c50-96f4-ce1cc321fa5d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:41.759550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ae93f8f-6b6c-4c50-96f4-ce1cc321fa5d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.159014 Apr 11 20:10:41.760113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1215/2651] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:41 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:41.859634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74a7d9b9-7328-4b98-97aa-d0a42c02defb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:41.860310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74a7d9b9-7328-4b98-97aa-d0a42c02defb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:41.867052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74a7d9b9-7328-4b98-97aa-d0a42c02defb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:41.867574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74a7d9b9-7328-4b98-97aa-d0a42c02defb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:41.868408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74a7d9b9-7328-4b98-97aa-d0a42c02defb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:41.868934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74a7d9b9-7328-4b98-97aa-d0a42c02defb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:42.008061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74a7d9b9-7328-4b98-97aa-d0a42c02defb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:42.016117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74a7d9b9-7328-4b98-97aa-d0a42c02defb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.160465 Apr 11 20:10:42.016707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1216/2652] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:42.584045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:42.585133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:42.595444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:42.596176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:42.598118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:42.598880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:42.740493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:42.750475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:42.751965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:42.753189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94d28974-4225-4570-a394-ef0f130e80cd tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.175574 Apr 11 20:10:42.753750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1217/2653] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:42 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:42.775281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09c65ae0-0b01-4282-87d7-f79266499930 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:42.775872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09c65ae0-0b01-4282-87d7-f79266499930 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:42.781980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09c65ae0-0b01-4282-87d7-f79266499930 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:42.782425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09c65ae0-0b01-4282-87d7-f79266499930 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:42.783193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09c65ae0-0b01-4282-87d7-f79266499930 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:42.783606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09c65ae0-0b01-4282-87d7-f79266499930 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:42.913520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09c65ae0-0b01-4282-87d7-f79266499930 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:42.921569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09c65ae0-0b01-4282-87d7-f79266499930 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.149873 Apr 11 20:10:42.922171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1218/2654] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:42 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:43.033917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19d96463-32ed-4068-b45f-c49350299ae7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:43.034542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19d96463-32ed-4068-b45f-c49350299ae7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:43.045635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19d96463-32ed-4068-b45f-c49350299ae7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:43.046449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19d96463-32ed-4068-b45f-c49350299ae7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:43.047132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19d96463-32ed-4068-b45f-c49350299ae7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:43.047770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19d96463-32ed-4068-b45f-c49350299ae7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:43.197498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19d96463-32ed-4068-b45f-c49350299ae7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:43.206375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19d96463-32ed-4068-b45f-c49350299ae7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.176747 Apr 11 20:10:43.206950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1219/2655] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:43.775628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:43.776736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:43.783656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:43.784104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:43.784862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:43.785313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:43.915577 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:43.923982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:43.925539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:43.926696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6dc2ed5-6b68-4f25-acb1-edef5bac06bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.157610 Apr 11 20:10:43.927252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1220/2656] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:43 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:43.937985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95c6df66-8ed8-4e2b-8843-9986a79ee582 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:43.938586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95c6df66-8ed8-4e2b-8843-9986a79ee582 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:43.944630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c6df66-8ed8-4e2b-8843-9986a79ee582 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:43.945114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c6df66-8ed8-4e2b-8843-9986a79ee582 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:43.945890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c6df66-8ed8-4e2b-8843-9986a79ee582 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:43.946320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c6df66-8ed8-4e2b-8843-9986a79ee582 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:44.090499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-95c6df66-8ed8-4e2b-8843-9986a79ee582 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:44.099140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95c6df66-8ed8-4e2b-8843-9986a79ee582 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.164710 Apr 11 20:10:44.099712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1221/2657] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:43 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:44.226644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ea8998b-5f6d-4013-9353-28d8e9e96e79 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:44.227560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ea8998b-5f6d-4013-9353-28d8e9e96e79 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:44.234600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ea8998b-5f6d-4013-9353-28d8e9e96e79 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:44.235048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ea8998b-5f6d-4013-9353-28d8e9e96e79 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:44.235805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ea8998b-5f6d-4013-9353-28d8e9e96e79 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:44.236235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ea8998b-5f6d-4013-9353-28d8e9e96e79 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:44.366128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ea8998b-5f6d-4013-9353-28d8e9e96e79 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:44.375277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ea8998b-5f6d-4013-9353-28d8e9e96e79 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154829 Apr 11 20:10:44.375823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1222/2658] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:44.948869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:44.949624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:44.957051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:44.957548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:44.958389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:44.958872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:45.103424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:45.115038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:45.117081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:45.118863 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1aee3887-42f3-4562-95fe-cb5fb1180d3b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.176179 Apr 11 20:10:45.119640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1223/2659] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:44 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:45.124398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-321eaa7f-a147-4172-aee5-f2e6ee89ab15 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:45.125035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-321eaa7f-a147-4172-aee5-f2e6ee89ab15 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:45.130763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-321eaa7f-a147-4172-aee5-f2e6ee89ab15 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:45.131214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-321eaa7f-a147-4172-aee5-f2e6ee89ab15 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:45.131966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-321eaa7f-a147-4172-aee5-f2e6ee89ab15 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:45.132395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-321eaa7f-a147-4172-aee5-f2e6ee89ab15 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:45.281679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-321eaa7f-a147-4172-aee5-f2e6ee89ab15 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:45.293849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-321eaa7f-a147-4172-aee5-f2e6ee89ab15 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.172827 Apr 11 20:10:45.294467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1224/2660] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:45 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:45.396549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-935e27c7-ec4e-4e10-b292-d4a698ac69eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:45.397497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-935e27c7-ec4e-4e10-b292-d4a698ac69eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:45.407420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935e27c7-ec4e-4e10-b292-d4a698ac69eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:45.408061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935e27c7-ec4e-4e10-b292-d4a698ac69eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:45.409225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935e27c7-ec4e-4e10-b292-d4a698ac69eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:45.409917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935e27c7-ec4e-4e10-b292-d4a698ac69eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:45.554054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-935e27c7-ec4e-4e10-b292-d4a698ac69eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:45.562327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-935e27c7-ec4e-4e10-b292-d4a698ac69eb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.172221 Apr 11 20:10:45.562878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1225/2661] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:46.140557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:46.141452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:46.149620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:46.150181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:46.151124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:46.151664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:46.293344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:46.302036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:46.303531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:46.304699 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2410d5f-ba76-4c28-b296-2c1d5cf16ea9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169311 Apr 11 20:10:46.305287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1226/2662] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:46 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:46.315335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-85137c6b-d7c3-4619-956b-3dc822413991 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:46.315936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-85137c6b-d7c3-4619-956b-3dc822413991 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:46.321629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85137c6b-d7c3-4619-956b-3dc822413991 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:46.322083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85137c6b-d7c3-4619-956b-3dc822413991 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:46.322824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85137c6b-d7c3-4619-956b-3dc822413991 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:46.323308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85137c6b-d7c3-4619-956b-3dc822413991 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:46.452730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85137c6b-d7c3-4619-956b-3dc822413991 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:46.464226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-85137c6b-d7c3-4619-956b-3dc822413991 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.152129 Apr 11 20:10:46.464934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1227/2663] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:46 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:46.583208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d991522-b6fb-4225-b2f2-ccb214399a7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:46.584204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d991522-b6fb-4225-b2f2-ccb214399a7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:46.592141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d991522-b6fb-4225-b2f2-ccb214399a7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:46.592587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d991522-b6fb-4225-b2f2-ccb214399a7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:46.593368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d991522-b6fb-4225-b2f2-ccb214399a7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:46.593791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d991522-b6fb-4225-b2f2-ccb214399a7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:46.732346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d991522-b6fb-4225-b2f2-ccb214399a7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:46.740861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d991522-b6fb-4225-b2f2-ccb214399a7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.163972 Apr 11 20:10:46.741464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1228/2664] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:47.327340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:47.328297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:47.339172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:47.339617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:47.340375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:47.340804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:47.478387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:47.487289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:47.488764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:47.489968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-88a9ba2d-e94f-4c18-a6c4-2fec29ad5fc3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169335 Apr 11 20:10:47.490527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1229/2665] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:47 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:47.495090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-03cc382d-d7ae-4efa-99bf-bf26889208b7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:47.495691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-03cc382d-d7ae-4efa-99bf-bf26889208b7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:47.501504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03cc382d-d7ae-4efa-99bf-bf26889208b7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:47.501948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03cc382d-d7ae-4efa-99bf-bf26889208b7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:47.502695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03cc382d-d7ae-4efa-99bf-bf26889208b7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:47.503118 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03cc382d-d7ae-4efa-99bf-bf26889208b7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:47.650196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-03cc382d-d7ae-4efa-99bf-bf26889208b7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:47.658815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-03cc382d-d7ae-4efa-99bf-bf26889208b7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.167364 Apr 11 20:10:47.659389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1230/2666] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:47 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:47.765180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f7fe76a-08c5-4645-82f4-ee49c186cc90 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:47.766215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f7fe76a-08c5-4645-82f4-ee49c186cc90 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:47.776548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f7fe76a-08c5-4645-82f4-ee49c186cc90 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:47.777349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f7fe76a-08c5-4645-82f4-ee49c186cc90 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:47.778605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f7fe76a-08c5-4645-82f4-ee49c186cc90 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:47.779360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f7fe76a-08c5-4645-82f4-ee49c186cc90 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:47.913822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f7fe76a-08c5-4645-82f4-ee49c186cc90 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:47.922026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f7fe76a-08c5-4645-82f4-ee49c186cc90 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.163293 Apr 11 20:10:47.922594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1231/2667] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:48.513244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:48.514238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:48.524781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:48.525576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:48.526808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:48.527510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:48.668743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:48.680966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:48.683312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:48.685016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9407b425-921a-433f-a220-a3daaed92adf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.178399 Apr 11 20:10:48.685733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1232/2668] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:48 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:48.690030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-309c4e6a-56e4-44a4-ae4c-86effecfacbb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:48.690629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-309c4e6a-56e4-44a4-ae4c-86effecfacbb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:48.697166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-309c4e6a-56e4-44a4-ae4c-86effecfacbb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:48.697881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-309c4e6a-56e4-44a4-ae4c-86effecfacbb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:48.698688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-309c4e6a-56e4-44a4-ae4c-86effecfacbb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:48.699120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-309c4e6a-56e4-44a4-ae4c-86effecfacbb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:48.851402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-309c4e6a-56e4-44a4-ae4c-86effecfacbb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:48.863472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-309c4e6a-56e4-44a4-ae4c-86effecfacbb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.176508 Apr 11 20:10:48.864318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1233/2669] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:48 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:48.942700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9886b41f-e5df-4ddf-8033-443abc37d345 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:48.943700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9886b41f-e5df-4ddf-8033-443abc37d345 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:48.953719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9886b41f-e5df-4ddf-8033-443abc37d345 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:48.954454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9886b41f-e5df-4ddf-8033-443abc37d345 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:48.955754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9886b41f-e5df-4ddf-8033-443abc37d345 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:48.956403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9886b41f-e5df-4ddf-8033-443abc37d345 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:49.089199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9886b41f-e5df-4ddf-8033-443abc37d345 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:49.097170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9886b41f-e5df-4ddf-8033-443abc37d345 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.160619 Apr 11 20:10:49.097723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1234/2670] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:49.709310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:49.710885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:49.719173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:49.719619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:49.720372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:49.720800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:49.859606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:49.873690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:49.876024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:49.877357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7cbff541-5018-4682-91a1-3e7528480d01 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.175985 Apr 11 20:10:49.877917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1235/2671] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:49 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:49.885584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-765b6c9e-4c61-465d-bbb3-7d14062abbe3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:49.886203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-765b6c9e-4c61-465d-bbb3-7d14062abbe3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:49.892362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-765b6c9e-4c61-465d-bbb3-7d14062abbe3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:49.892811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-765b6c9e-4c61-465d-bbb3-7d14062abbe3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:49.893594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-765b6c9e-4c61-465d-bbb3-7d14062abbe3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:49.894025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-765b6c9e-4c61-465d-bbb3-7d14062abbe3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:50.025610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-765b6c9e-4c61-465d-bbb3-7d14062abbe3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:50.033914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-765b6c9e-4c61-465d-bbb3-7d14062abbe3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.154196 Apr 11 20:10:50.034459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1236/2672] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:49 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:50.116748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-609a2c40-1009-4cef-8f98-ad52ab9e8b76 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:50.117636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-609a2c40-1009-4cef-8f98-ad52ab9e8b76 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:50.126527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-609a2c40-1009-4cef-8f98-ad52ab9e8b76 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:50.127127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-609a2c40-1009-4cef-8f98-ad52ab9e8b76 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:50.128116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-609a2c40-1009-4cef-8f98-ad52ab9e8b76 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:50.128686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-609a2c40-1009-4cef-8f98-ad52ab9e8b76 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:50.263184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-609a2c40-1009-4cef-8f98-ad52ab9e8b76 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:50.271548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-609a2c40-1009-4cef-8f98-ad52ab9e8b76 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.160086 Apr 11 20:10:50.272338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1237/2673] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:50.902736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:50.903828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:50.914401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:50.915132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:50.916359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:50.917097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:51.047148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:51.055381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:51.057071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:51.058184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ada62b70-7326-4989-a5cc-7284023a1fac tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162169 Apr 11 20:10:51.058740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1238/2674] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:50 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:51.063152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-345fdeb1-8cd5-4202-965d-8641d6dfd332 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:51.063757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-345fdeb1-8cd5-4202-965d-8641d6dfd332 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:51.069715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-345fdeb1-8cd5-4202-965d-8641d6dfd332 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:51.070162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-345fdeb1-8cd5-4202-965d-8641d6dfd332 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:51.070923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-345fdeb1-8cd5-4202-965d-8641d6dfd332 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:51.071349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-345fdeb1-8cd5-4202-965d-8641d6dfd332 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:51.206573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-345fdeb1-8cd5-4202-965d-8641d6dfd332 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:51.214593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-345fdeb1-8cd5-4202-965d-8641d6dfd332 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.154909 Apr 11 20:10:51.215156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1239/2675] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:51 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:51.292553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7a3cb292-2c9d-4835-8095-f1fb4c343d64 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:51.293602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7a3cb292-2c9d-4835-8095-f1fb4c343d64 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:51.306452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a3cb292-2c9d-4835-8095-f1fb4c343d64 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:51.307205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a3cb292-2c9d-4835-8095-f1fb4c343d64 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:51.308159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a3cb292-2c9d-4835-8095-f1fb4c343d64 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:51.308599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a3cb292-2c9d-4835-8095-f1fb4c343d64 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:51.441630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7a3cb292-2c9d-4835-8095-f1fb4c343d64 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:51.449810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7a3cb292-2c9d-4835-8095-f1fb4c343d64 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.163321 Apr 11 20:10:51.450353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1240/2676] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:52.080818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:52.081951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:52.091330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:52.091780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:52.092540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:52.093006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:52.219941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:52.228197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:52.229845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:52.230977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-235a027f-665a-4349-bd38-afc9aa8b497b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.156826 Apr 11 20:10:52.231559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1241/2677] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:52 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:52.235830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8f21a5e-f095-44d8-a8b5-ebfc0f7c0c35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:52.236426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8f21a5e-f095-44d8-a8b5-ebfc0f7c0c35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:52.241936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8f21a5e-f095-44d8-a8b5-ebfc0f7c0c35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:52.242387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8f21a5e-f095-44d8-a8b5-ebfc0f7c0c35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:52.243126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8f21a5e-f095-44d8-a8b5-ebfc0f7c0c35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:52.243550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8f21a5e-f095-44d8-a8b5-ebfc0f7c0c35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:52.369546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8f21a5e-f095-44d8-a8b5-ebfc0f7c0c35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:52.377758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8f21a5e-f095-44d8-a8b5-ebfc0f7c0c35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.145278 Apr 11 20:10:52.378321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1242/2678] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:52 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:52.471081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2b780980-1bd1-426c-8e2f-fb6b31bad728 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:52.472068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2b780980-1bd1-426c-8e2f-fb6b31bad728 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:52.481135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b780980-1bd1-426c-8e2f-fb6b31bad728 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:52.481586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b780980-1bd1-426c-8e2f-fb6b31bad728 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:52.482337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b780980-1bd1-426c-8e2f-fb6b31bad728 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:52.482757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b780980-1bd1-426c-8e2f-fb6b31bad728 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:52.619661 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b780980-1bd1-426c-8e2f-fb6b31bad728 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:52.627928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2b780980-1bd1-426c-8e2f-fb6b31bad728 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.163039 Apr 11 20:10:52.628492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1243/2679] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:53.253916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:53.254932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:53.265707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:53.266447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:53.267749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:53.268434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:53.407351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:53.416136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:53.417704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:53.418861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0d512201-726b-4605-ad84-f1498e0785d8 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.172021 Apr 11 20:10:53.419429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1244/2680] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:53 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:53.423750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-86a2103c-95e2-4f9c-937c-86fe6e19d9a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:53.424351 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-86a2103c-95e2-4f9c-937c-86fe6e19d9a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:53.430024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86a2103c-95e2-4f9c-937c-86fe6e19d9a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:53.430469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86a2103c-95e2-4f9c-937c-86fe6e19d9a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:53.431211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86a2103c-95e2-4f9c-937c-86fe6e19d9a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:53.431638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86a2103c-95e2-4f9c-937c-86fe6e19d9a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:53.568603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-86a2103c-95e2-4f9c-937c-86fe6e19d9a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:53.578241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-86a2103c-95e2-4f9c-937c-86fe6e19d9a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.157886 Apr 11 20:10:53.578812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1245/2681] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:53 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:53.654257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-295cc77d-2cf4-4f98-884a-017a55c7fead tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:53.655284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-295cc77d-2cf4-4f98-884a-017a55c7fead tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:53.665165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295cc77d-2cf4-4f98-884a-017a55c7fead tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:53.665902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295cc77d-2cf4-4f98-884a-017a55c7fead tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:53.667124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295cc77d-2cf4-4f98-884a-017a55c7fead tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:53.667803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295cc77d-2cf4-4f98-884a-017a55c7fead tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:53.806813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-295cc77d-2cf4-4f98-884a-017a55c7fead tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:53.819285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-295cc77d-2cf4-4f98-884a-017a55c7fead tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.171008 Apr 11 20:10:53.820028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1246/2682] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:54.442390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:54.443443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:54.452161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:54.452610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:54.453404 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:54.453835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:54.592048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:54.601165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:54.602651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:54.603853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5eb97d42-25cf-41d5-91fe-925dc3204804 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168350 Apr 11 20:10:54.604413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1247/2683] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:54 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:54.608993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c54fe7be-1c84-4b63-bff9-40964e0f8dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:54.609588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c54fe7be-1c84-4b63-bff9-40964e0f8dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:54.615511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c54fe7be-1c84-4b63-bff9-40964e0f8dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:54.615957 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c54fe7be-1c84-4b63-bff9-40964e0f8dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:54.616718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c54fe7be-1c84-4b63-bff9-40964e0f8dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:54.617183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c54fe7be-1c84-4b63-bff9-40964e0f8dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:54.746190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c54fe7be-1c84-4b63-bff9-40964e0f8dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:54.755538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c54fe7be-1c84-4b63-bff9-40964e0f8dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.150036 Apr 11 20:10:54.756137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1248/2684] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:54 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:54.841091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-92b8e37e-4b3b-46d8-af2f-c6c3ee909864 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:54.841886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-92b8e37e-4b3b-46d8-af2f-c6c3ee909864 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:54.849886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-92b8e37e-4b3b-46d8-af2f-c6c3ee909864 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:54.850472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-92b8e37e-4b3b-46d8-af2f-c6c3ee909864 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:54.851462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-92b8e37e-4b3b-46d8-af2f-c6c3ee909864 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:54.852030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-92b8e37e-4b3b-46d8-af2f-c6c3ee909864 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:54.983333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-92b8e37e-4b3b-46d8-af2f-c6c3ee909864 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:54.991521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-92b8e37e-4b3b-46d8-af2f-c6c3ee909864 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.156443 Apr 11 20:10:54.992071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1249/2685] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:55.626848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:55.627848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:55.638295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:55.639034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:55.640267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:55.640977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:55.788573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:55.797641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:55.799123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:55.800294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d3ae1112-af21-452f-b578-167fc8b36fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.180565 Apr 11 20:10:55.800853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1250/2686] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:55 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:55.805262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56ede1bc-fbd4-4e59-bf99-13a9155ede80 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:55.805887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56ede1bc-fbd4-4e59-bf99-13a9155ede80 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:55.811860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56ede1bc-fbd4-4e59-bf99-13a9155ede80 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:55.812312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56ede1bc-fbd4-4e59-bf99-13a9155ede80 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:55.813108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56ede1bc-fbd4-4e59-bf99-13a9155ede80 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:55.813543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56ede1bc-fbd4-4e59-bf99-13a9155ede80 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:55.945535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56ede1bc-fbd4-4e59-bf99-13a9155ede80 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:55.953920 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56ede1bc-fbd4-4e59-bf99-13a9155ede80 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.152088 Apr 11 20:10:55.954499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1251/2687] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:55 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:56.009924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0093944c-9515-4ae9-8df1-d4372c2afb81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:56.010563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0093944c-9515-4ae9-8df1-d4372c2afb81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:56.017127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0093944c-9515-4ae9-8df1-d4372c2afb81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:56.017579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0093944c-9515-4ae9-8df1-d4372c2afb81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:56.018334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0093944c-9515-4ae9-8df1-d4372c2afb81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:56.018771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0093944c-9515-4ae9-8df1-d4372c2afb81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:56.155455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0093944c-9515-4ae9-8df1-d4372c2afb81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:56.164961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0093944c-9515-4ae9-8df1-d4372c2afb81 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.159164 Apr 11 20:10:56.165580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1252/2688] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:56.822875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:56.823949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:56.830685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:56.831132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:56.831878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:56.832306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:56.966438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:56.974808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:56.976275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:56.977487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cb541487-0d42-4c98-9d38-12d3cd952157 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.161218 Apr 11 20:10:56.978091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1253/2689] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:56 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:56.982437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a24b432-5893-46d4-aea3-988c8c5a5862 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:56.983043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a24b432-5893-46d4-aea3-988c8c5a5862 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:56.988498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a24b432-5893-46d4-aea3-988c8c5a5862 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:56.989120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a24b432-5893-46d4-aea3-988c8c5a5862 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:56.989879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a24b432-5893-46d4-aea3-988c8c5a5862 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:56.990318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a24b432-5893-46d4-aea3-988c8c5a5862 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:57.120073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a24b432-5893-46d4-aea3-988c8c5a5862 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:57.128359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a24b432-5893-46d4-aea3-988c8c5a5862 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.149358 Apr 11 20:10:57.128930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1254/2690] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:56 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:57.183186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0f385d6-e711-4606-9911-db737fd2bfb8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:57.183799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0f385d6-e711-4606-9911-db737fd2bfb8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:57.189990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0f385d6-e711-4606-9911-db737fd2bfb8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:57.190460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0f385d6-e711-4606-9911-db737fd2bfb8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:57.191223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0f385d6-e711-4606-9911-db737fd2bfb8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:57.191656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0f385d6-e711-4606-9911-db737fd2bfb8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:57.326047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0f385d6-e711-4606-9911-db737fd2bfb8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:57.334407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0f385d6-e711-4606-9911-db737fd2bfb8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.155254 Apr 11 20:10:57.334981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1255/2691] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:10:58.000205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:58.001299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:58.011767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:58.012548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:58.013844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:58.014555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:58.154547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:58.163135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:58.164718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:58.165936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a893911c-4bdd-494f-8b53-4ec1154febe3 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.172937 Apr 11 20:10:58.166496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1256/2692] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:57 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:58.170987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a302a049-7ad0-4ced-a76a-70ea25c515ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:58.171584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a302a049-7ad0-4ced-a76a-70ea25c515ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:58.177634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a302a049-7ad0-4ced-a76a-70ea25c515ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:58.178081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a302a049-7ad0-4ced-a76a-70ea25c515ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:58.178838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a302a049-7ad0-4ced-a76a-70ea25c515ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:58.179262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a302a049-7ad0-4ced-a76a-70ea25c515ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:58.311485 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a302a049-7ad0-4ced-a76a-70ea25c515ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:58.319267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a302a049-7ad0-4ced-a76a-70ea25c515ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.151845 Apr 11 20:10:58.319841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1257/2693] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:58 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:58.353931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77b8d8f1-05ed-4dbf-b5d0-a0d1d7c7c886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:58.354714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77b8d8f1-05ed-4dbf-b5d0-a0d1d7c7c886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:58.361120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77b8d8f1-05ed-4dbf-b5d0-a0d1d7c7c886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:58.361563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77b8d8f1-05ed-4dbf-b5d0-a0d1d7c7c886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:58.362306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77b8d8f1-05ed-4dbf-b5d0-a0d1d7c7c886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:58.362735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77b8d8f1-05ed-4dbf-b5d0-a0d1d7c7c886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:58.494202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77b8d8f1-05ed-4dbf-b5d0-a0d1d7c7c886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:58.503079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77b8d8f1-05ed-4dbf-b5d0-a0d1d7c7c886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154989 Apr 11 20:10:58.503659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1258/2694] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:59.188089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:59.189146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:59.199693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:59.200144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:59.200925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:59.201376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:59.345481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:59.353873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:59.355405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:59.356581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e7b334ea-e6a3-4ca3-9861-a2296be2aebc tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.175092 Apr 11 20:10:59.357173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1259/2695] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:10:59 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:10:59.361490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f43924b-eb11-4276-8ddc-cb322a38947d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:59.362073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f43924b-eb11-4276-8ddc-cb322a38947d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:59.368232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f43924b-eb11-4276-8ddc-cb322a38947d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:59.368678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f43924b-eb11-4276-8ddc-cb322a38947d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:59.369489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f43924b-eb11-4276-8ddc-cb322a38947d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:59.369925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f43924b-eb11-4276-8ddc-cb322a38947d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:59.500999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f43924b-eb11-4276-8ddc-cb322a38947d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:59.508850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f43924b-eb11-4276-8ddc-cb322a38947d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.150783 Apr 11 20:10:59.509474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1260/2696] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:59 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:10:59.519152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-60883e01-6cb1-486f-9cda-683da02d2316 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:10:59.519747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-60883e01-6cb1-486f-9cda-683da02d2316 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:10:59.525486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60883e01-6cb1-486f-9cda-683da02d2316 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:59.525923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60883e01-6cb1-486f-9cda-683da02d2316 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:59.526712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60883e01-6cb1-486f-9cda-683da02d2316 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:10:59.527151 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60883e01-6cb1-486f-9cda-683da02d2316 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:10:59.668565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60883e01-6cb1-486f-9cda-683da02d2316 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:10:59.680172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-60883e01-6cb1-486f-9cda-683da02d2316 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.164359 Apr 11 20:10:59.681040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1261/2697] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:10:59 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:11:00.380236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:00.381393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:00.389769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:00.390225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:00.390979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:00.391411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:00.527747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:00.536424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:00.537928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:00.539086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9faf9b1c-234c-4c7d-b712-cf5cce019d6d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165815 Apr 11 20:11:00.539644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1262/2698] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:00 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:00.544011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1821fa16-4485-437a-9b50-48fb7d276e0c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:00.544605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1821fa16-4485-437a-9b50-48fb7d276e0c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:00.550319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1821fa16-4485-437a-9b50-48fb7d276e0c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:00.550763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1821fa16-4485-437a-9b50-48fb7d276e0c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:00.551509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1821fa16-4485-437a-9b50-48fb7d276e0c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:00.551944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1821fa16-4485-437a-9b50-48fb7d276e0c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:00.679043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1821fa16-4485-437a-9b50-48fb7d276e0c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:00.686879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1821fa16-4485-437a-9b50-48fb7d276e0c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.146276 Apr 11 20:11:00.687443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1263/2699] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:00 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:00.699942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-44e0c24e-062d-47d0-b298-fcd4a2f84961 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:00.700597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-44e0c24e-062d-47d0-b298-fcd4a2f84961 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:00.706386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e0c24e-062d-47d0-b298-fcd4a2f84961 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:00.706830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e0c24e-062d-47d0-b298-fcd4a2f84961 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:00.707580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e0c24e-062d-47d0-b298-fcd4a2f84961 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:00.708005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e0c24e-062d-47d0-b298-fcd4a2f84961 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:00.841267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44e0c24e-062d-47d0-b298-fcd4a2f84961 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:00.849595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-44e0c24e-062d-47d0-b298-fcd4a2f84961 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153317 Apr 11 20:11:00.850169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1264/2700] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:11:01.562177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:01.563287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:01.573850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:01.574588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:01.575844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:01.576559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:01.715387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:01.723690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:01.725212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:01.726375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc06d4d7-ee7d-498b-88b4-4ea2817d7475 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170990 Apr 11 20:11:01.726939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1265/2701] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:01 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:01.731296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-152bed33-fade-45bb-a906-ea06d5d32169 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:01.731896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-152bed33-fade-45bb-a906-ea06d5d32169 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:01.737385 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-152bed33-fade-45bb-a906-ea06d5d32169 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:01.737837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-152bed33-fade-45bb-a906-ea06d5d32169 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:01.738592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-152bed33-fade-45bb-a906-ea06d5d32169 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:01.739028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-152bed33-fade-45bb-a906-ea06d5d32169 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:01.882244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-152bed33-fade-45bb-a906-ea06d5d32169 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:01.890564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-152bed33-fade-45bb-a906-ea06d5d32169 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.162695 Apr 11 20:11:01.891127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1266/2702] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:01 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:01.895484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6186db6f-2c2d-460d-8d33-0821740d2c45 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:01.896088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6186db6f-2c2d-460d-8d33-0821740d2c45 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:01.901664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6186db6f-2c2d-460d-8d33-0821740d2c45 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:01.902133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6186db6f-2c2d-460d-8d33-0821740d2c45 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:01.902878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6186db6f-2c2d-460d-8d33-0821740d2c45 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:01.903309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6186db6f-2c2d-460d-8d33-0821740d2c45 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:02.038845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6186db6f-2c2d-460d-8d33-0821740d2c45 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:02.047353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6186db6f-2c2d-460d-8d33-0821740d2c45 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.155258 Apr 11 20:11:02.047937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1267/2703] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:02.748829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:02.749893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:02.760496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:02.761323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:02.762059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:02.762498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:02.893184 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:02.902257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:02.904003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:02.905188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-11c86ba9-ab6f-4705-b45a-001f2e4ca691 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.163149 Apr 11 20:11:02.905741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1268/2704] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:02 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:02.910011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-926c4e30-a127-42ce-a86d-4ba8d17e57ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:02.910603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-926c4e30-a127-42ce-a86d-4ba8d17e57ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:02.916161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-926c4e30-a127-42ce-a86d-4ba8d17e57ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:02.916606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-926c4e30-a127-42ce-a86d-4ba8d17e57ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:02.917493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-926c4e30-a127-42ce-a86d-4ba8d17e57ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:02.917924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-926c4e30-a127-42ce-a86d-4ba8d17e57ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:03.050334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-926c4e30-a127-42ce-a86d-4ba8d17e57ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:03.058584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-926c4e30-a127-42ce-a86d-4ba8d17e57ab tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.151915 Apr 11 20:11:03.059157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1269/2705] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:02 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:03.070312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b50ee10b-3058-48ee-9704-92b9599472d1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:03.070921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b50ee10b-3058-48ee-9704-92b9599472d1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:03.077207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b50ee10b-3058-48ee-9704-92b9599472d1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:03.077656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b50ee10b-3058-48ee-9704-92b9599472d1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:03.078410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b50ee10b-3058-48ee-9704-92b9599472d1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:03.078866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b50ee10b-3058-48ee-9704-92b9599472d1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:03.211035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b50ee10b-3058-48ee-9704-92b9599472d1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:03.219542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b50ee10b-3058-48ee-9704-92b9599472d1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153143 Apr 11 20:11:03.220115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1270/2706] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:03.927002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:03.928046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:03.936687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:03.937175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:03.937927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:03.938390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:04.077994 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:04.086294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:04.087770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:04.088919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3cf39772-397d-46a5-b151-9b52cefe7e62 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168475 Apr 11 20:11:04.089516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1271/2707] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:03 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:04.093826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a3ff9e62-24c9-409d-88ff-5cfecd97149f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:04.094422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a3ff9e62-24c9-409d-88ff-5cfecd97149f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:04.100324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3ff9e62-24c9-409d-88ff-5cfecd97149f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:04.100765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3ff9e62-24c9-409d-88ff-5cfecd97149f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:04.101544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3ff9e62-24c9-409d-88ff-5cfecd97149f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:04.101972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3ff9e62-24c9-409d-88ff-5cfecd97149f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:04.247022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a3ff9e62-24c9-409d-88ff-5cfecd97149f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:04.259729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a3ff9e62-24c9-409d-88ff-5cfecd97149f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.169250 Apr 11 20:11:04.260524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1272/2708] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:04 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:04.264768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-edff9130-7ffb-4989-922d-8123ead5971e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:04.265366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-edff9130-7ffb-4989-922d-8123ead5971e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:04.270902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edff9130-7ffb-4989-922d-8123ead5971e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:04.271387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edff9130-7ffb-4989-922d-8123ead5971e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:04.272091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edff9130-7ffb-4989-922d-8123ead5971e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:04.272576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edff9130-7ffb-4989-922d-8123ead5971e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:04.399336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-edff9130-7ffb-4989-922d-8123ead5971e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:04.407926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-edff9130-7ffb-4989-922d-8123ead5971e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.146677 Apr 11 20:11:04.408497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1273/2709] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:05.109299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:05.110052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:05.118202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:05.118759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:05.119692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:05.120223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:05.258386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:05.271433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:05.273713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:05.275490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c6dd2de0-a48a-4137-a991-6ac3f11cc134 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171228 Apr 11 20:11:05.276325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1274/2710] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:05 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:05.280803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b468db3-e1b3-43bd-820b-fc3fa5b42ebc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:05.281433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b468db3-e1b3-43bd-820b-fc3fa5b42ebc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:05.287433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b468db3-e1b3-43bd-820b-fc3fa5b42ebc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:05.287878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b468db3-e1b3-43bd-820b-fc3fa5b42ebc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:05.288631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b468db3-e1b3-43bd-820b-fc3fa5b42ebc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:05.289102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b468db3-e1b3-43bd-820b-fc3fa5b42ebc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:05.416631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3b468db3-e1b3-43bd-820b-fc3fa5b42ebc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:05.426851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b468db3-e1b3-43bd-820b-fc3fa5b42ebc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.149368 Apr 11 20:11:05.427635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1275/2711] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:05 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:05.431950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ba0c7bb-218d-43ef-9d11-88787dd14b5c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:05.432542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ba0c7bb-218d-43ef-9d11-88787dd14b5c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:05.438058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ba0c7bb-218d-43ef-9d11-88787dd14b5c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:05.438504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ba0c7bb-218d-43ef-9d11-88787dd14b5c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:05.439248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ba0c7bb-218d-43ef-9d11-88787dd14b5c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:05.439674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ba0c7bb-218d-43ef-9d11-88787dd14b5c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:05.571405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ba0c7bb-218d-43ef-9d11-88787dd14b5c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:05.580254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ba0c7bb-218d-43ef-9d11-88787dd14b5c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.151661 Apr 11 20:11:05.580829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1276/2712] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:06.298286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:06.299287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:06.309616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:06.310061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:06.310814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:06.311246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:06.446005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:06.455076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:06.456568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:06.457778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b32a05ed-2a7a-4602-bd51-0070cfc71c47 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166132 Apr 11 20:11:06.458344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1277/2713] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:06 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:06.462811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-233de718-2ca4-42bb-907b-04afa2f1b973 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:06.463416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-233de718-2ca4-42bb-907b-04afa2f1b973 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:06.469449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-233de718-2ca4-42bb-907b-04afa2f1b973 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:06.469893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-233de718-2ca4-42bb-907b-04afa2f1b973 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:06.470652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-233de718-2ca4-42bb-907b-04afa2f1b973 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:06.471082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-233de718-2ca4-42bb-907b-04afa2f1b973 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:06.599912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-233de718-2ca4-42bb-907b-04afa2f1b973 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:06.608352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-233de718-2ca4-42bb-907b-04afa2f1b973 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.149035 Apr 11 20:11:06.609032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1278/2714] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:06 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:06.613561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a08938ed-2da3-482f-8e38-a0d314316eab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:06.614133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a08938ed-2da3-482f-8e38-a0d314316eab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:06.620040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a08938ed-2da3-482f-8e38-a0d314316eab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:06.620489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a08938ed-2da3-482f-8e38-a0d314316eab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:06.621286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a08938ed-2da3-482f-8e38-a0d314316eab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:06.621718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a08938ed-2da3-482f-8e38-a0d314316eab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:06.759575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a08938ed-2da3-482f-8e38-a0d314316eab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:06.772424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a08938ed-2da3-482f-8e38-a0d314316eab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.162374 Apr 11 20:11:06.773259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1279/2715] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:07.475986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:07.476685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:07.483893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:07.484361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:07.485193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:07.485622 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:07.607465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:11:07.608396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:11:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-1172057786 (ip 10.222.0.62) !!! Apr 11 20:11:07.618656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:07.628471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:07.630308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:07.631604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a50519b4-fde4-4a0d-8560-af11ca53c0f2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159588 Apr 11 20:11:07.632340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1280/2716] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:07 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:07.834026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5fbd935d-8053-4a97-867e-710c532f8eb1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:07.834640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5fbd935d-8053-4a97-867e-710c532f8eb1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:07.840705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fbd935d-8053-4a97-867e-710c532f8eb1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:07.841185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fbd935d-8053-4a97-867e-710c532f8eb1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:07.841944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fbd935d-8053-4a97-867e-710c532f8eb1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:07.842375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fbd935d-8053-4a97-867e-710c532f8eb1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:07.977719 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5fbd935d-8053-4a97-867e-710c532f8eb1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:07.985761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5fbd935d-8053-4a97-867e-710c532f8eb1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.352286 Apr 11 20:11:07.986347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1281/2717] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:07 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:08.112524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7ec6029f-9159-4713-86be-ab58191947dd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:08.113170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7ec6029f-9159-4713-86be-ab58191947dd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:08.119057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ec6029f-9159-4713-86be-ab58191947dd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:08.119505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ec6029f-9159-4713-86be-ab58191947dd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:08.120260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ec6029f-9159-4713-86be-ab58191947dd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:08.120693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ec6029f-9159-4713-86be-ab58191947dd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:08.253776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7ec6029f-9159-4713-86be-ab58191947dd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:08.262094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7ec6029f-9159-4713-86be-ab58191947dd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.274811 Apr 11 20:11:08.262668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1282/2718] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:08.654009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:08.655029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:08.665489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:08.666228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:08.667459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:08.668204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:08.802434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:08.810738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:08.812216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:08.813448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d5a5fc8e-ce68-4005-a8bc-6fad144f669a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166077 Apr 11 20:11:08.813977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1283/2719] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:09.006731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ef3532d-84e2-4480-be4b-2922fd18a590 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:09.007742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ef3532d-84e2-4480-be4b-2922fd18a590 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:09.017964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ef3532d-84e2-4480-be4b-2922fd18a590 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:09.018708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ef3532d-84e2-4480-be4b-2922fd18a590 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:09.019953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ef3532d-84e2-4480-be4b-2922fd18a590 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:09.020674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ef3532d-84e2-4480-be4b-2922fd18a590 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:09.154714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ef3532d-84e2-4480-be4b-2922fd18a590 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:09.166967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ef3532d-84e2-4480-be4b-2922fd18a590 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.166265 Apr 11 20:11:09.167652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1284/2720] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:08 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:09.283312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-68a27165-be39-4a00-830b-06591db1830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:09.284157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-68a27165-be39-4a00-830b-06591db1830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:09.293801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68a27165-be39-4a00-830b-06591db1830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:09.294529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68a27165-be39-4a00-830b-06591db1830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:09.295771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68a27165-be39-4a00-830b-06591db1830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:09.296450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68a27165-be39-4a00-830b-06591db1830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:09.436517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-68a27165-be39-4a00-830b-06591db1830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:09.445220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-68a27165-be39-4a00-830b-06591db1830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.168561 Apr 11 20:11:09.445905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1285/2721] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:09.833783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:09.834877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:09.842538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:09.842980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:09.843734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:09.844157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:09.984089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:09.993035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:09.994514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:09.995669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0e32e4b3-3c2f-4669-806c-c1191ff39fd9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166121 Apr 11 20:11:09.996308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1286/2722] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:10.188563 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-80cd68ab-be2a-427c-94ac-65cc3b8c08c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:10.189630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-80cd68ab-be2a-427c-94ac-65cc3b8c08c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:10.199669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80cd68ab-be2a-427c-94ac-65cc3b8c08c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:10.200113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80cd68ab-be2a-427c-94ac-65cc3b8c08c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:10.200866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80cd68ab-be2a-427c-94ac-65cc3b8c08c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:10.201322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80cd68ab-be2a-427c-94ac-65cc3b8c08c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:10.333052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-80cd68ab-be2a-427c-94ac-65cc3b8c08c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:10.341642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-80cd68ab-be2a-427c-94ac-65cc3b8c08c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.159071 Apr 11 20:11:10.342222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1287/2723] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:10 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:10.467434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-29e78631-6e99-41fc-86fa-bfae9c3feeac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:10.467955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-29e78631-6e99-41fc-86fa-bfae9c3feeac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:10.474642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29e78631-6e99-41fc-86fa-bfae9c3feeac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:10.475090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29e78631-6e99-41fc-86fa-bfae9c3feeac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:10.475838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29e78631-6e99-41fc-86fa-bfae9c3feeac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:10.476265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29e78631-6e99-41fc-86fa-bfae9c3feeac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:10.608552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29e78631-6e99-41fc-86fa-bfae9c3feeac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:10.617290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-29e78631-6e99-41fc-86fa-bfae9c3feeac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154951 Apr 11 20:11:10.617997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1288/2724] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:11.023635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:11.024708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:11.035151 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:11.035895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:11.037203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:11.037923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:11.165659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:11.174413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:11.175911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:11.177137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-03a9d32c-5d3b-49d7-ae7b-b91f84f77386 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.159996 Apr 11 20:11:11.177698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1289/2725] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:11 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:11.368156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f84771c-23a7-4a6d-b116-1ac85ea4d240 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:11.369088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0f84771c-23a7-4a6d-b116-1ac85ea4d240 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:11.376790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f84771c-23a7-4a6d-b116-1ac85ea4d240 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:11.377298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f84771c-23a7-4a6d-b116-1ac85ea4d240 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:11.378095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f84771c-23a7-4a6d-b116-1ac85ea4d240 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:11.378548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f84771c-23a7-4a6d-b116-1ac85ea4d240 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:11.512527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0f84771c-23a7-4a6d-b116-1ac85ea4d240 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:11.524297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0f84771c-23a7-4a6d-b116-1ac85ea4d240 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.162368 Apr 11 20:11:11.525178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1290/2726] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:11 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:11.638839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-955da124-49eb-4d85-bfec-90477f7faa52 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:11.639768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-955da124-49eb-4d85-bfec-90477f7faa52 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:11.649648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-955da124-49eb-4d85-bfec-90477f7faa52 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:11.650383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-955da124-49eb-4d85-bfec-90477f7faa52 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:11.651612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-955da124-49eb-4d85-bfec-90477f7faa52 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:11.652355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-955da124-49eb-4d85-bfec-90477f7faa52 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:11.801876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-955da124-49eb-4d85-bfec-90477f7faa52 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:11.810103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-955da124-49eb-4d85-bfec-90477f7faa52 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.177675 Apr 11 20:11:11.810677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1291/2727] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:12.198654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:12.199378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:12.209029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:12.209663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:12.210722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:12.211336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:12.353806 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:12.362835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:12.364290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:12.365480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-76332ed0-60d1-40eb-b469-cc4354572299 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171216 Apr 11 20:11:12.366044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1292/2728] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:12 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:12.546360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2fb97e46-5d4c-4d55-baa4-8ba5632fa276 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:12.547236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2fb97e46-5d4c-4d55-baa4-8ba5632fa276 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:12.557391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fb97e46-5d4c-4d55-baa4-8ba5632fa276 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:12.558144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fb97e46-5d4c-4d55-baa4-8ba5632fa276 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:12.559464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fb97e46-5d4c-4d55-baa4-8ba5632fa276 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:12.560185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fb97e46-5d4c-4d55-baa4-8ba5632fa276 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:12.698023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2fb97e46-5d4c-4d55-baa4-8ba5632fa276 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:12.706623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2fb97e46-5d4c-4d55-baa4-8ba5632fa276 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.167296 Apr 11 20:11:12.707181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1293/2729] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:12 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:12.833861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-28899227-1e27-4026-925f-60e4779c4aea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:12.834794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-28899227-1e27-4026-925f-60e4779c4aea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:12.843060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28899227-1e27-4026-925f-60e4779c4aea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:12.843507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28899227-1e27-4026-925f-60e4779c4aea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:12.844252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28899227-1e27-4026-925f-60e4779c4aea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:12.844679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28899227-1e27-4026-925f-60e4779c4aea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:12.980376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-28899227-1e27-4026-925f-60e4779c4aea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:12.989174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-28899227-1e27-4026-925f-60e4779c4aea tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.161708 Apr 11 20:11:12.989716 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1294/2730] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:13.388665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:13.389744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:13.400341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:13.401141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:13.402391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:13.403107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:13.549365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:13.558564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:13.560050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:13.561253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d5956bf-d7c2-4aec-94db-016fd07b0414 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179162 Apr 11 20:11:13.561789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1295/2731] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:13 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:13.566343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4acc7b74-74d3-4b38-84a2-04d5993b27cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:13.566794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4acc7b74-74d3-4b38-84a2-04d5993b27cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:13.572790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4acc7b74-74d3-4b38-84a2-04d5993b27cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:13.573259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4acc7b74-74d3-4b38-84a2-04d5993b27cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:13.574017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4acc7b74-74d3-4b38-84a2-04d5993b27cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:13.574448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4acc7b74-74d3-4b38-84a2-04d5993b27cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:13.597875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4acc7b74-74d3-4b38-84a2-04d5993b27cf tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42/ips" status: 200 len: 151 microversion: 2.1 time: 0.034949 Apr 11 20:11:13.598464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1296/2732] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 20:11:13 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:11:13.727421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53a03c6c-11bf-4398-b6aa-a8c16d13ca1b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:13.728422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53a03c6c-11bf-4398-b6aa-a8c16d13ca1b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:13.738574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53a03c6c-11bf-4398-b6aa-a8c16d13ca1b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:13.739313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53a03c6c-11bf-4398-b6aa-a8c16d13ca1b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:13.740557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53a03c6c-11bf-4398-b6aa-a8c16d13ca1b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:13.741345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53a03c6c-11bf-4398-b6aa-a8c16d13ca1b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:13.884487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53a03c6c-11bf-4398-b6aa-a8c16d13ca1b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:13.893912 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53a03c6c-11bf-4398-b6aa-a8c16d13ca1b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.173022 Apr 11 20:11:13.894489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1297/2733] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:13 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:14.010637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-304fc925-472f-4532-9f26-4a875f254007 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:14.011759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-304fc925-472f-4532-9f26-4a875f254007 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:14.018108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-304fc925-472f-4532-9f26-4a875f254007 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:14.018558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-304fc925-472f-4532-9f26-4a875f254007 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:14.019301 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-304fc925-472f-4532-9f26-4a875f254007 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:14.019735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-304fc925-472f-4532-9f26-4a875f254007 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:14.157816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-304fc925-472f-4532-9f26-4a875f254007 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:14.166122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-304fc925-472f-4532-9f26-4a875f254007 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.161856 Apr 11 20:11:14.166690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1298/2734] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:14.582360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:14.583069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:14.591335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:14.591778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:14.592761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:14.593376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:14.732639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:14.741465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:14.742958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:14.744125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5dc2cd0-ea2c-4043-8220-b6d8166e19e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.167973 Apr 11 20:11:14.744665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1299/2735] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:14 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:14.915505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54a7cad0-c203-41ba-92e8-ce775d34b40c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:14.916224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54a7cad0-c203-41ba-92e8-ce775d34b40c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:14.922696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54a7cad0-c203-41ba-92e8-ce775d34b40c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:14.923154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54a7cad0-c203-41ba-92e8-ce775d34b40c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:14.923918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54a7cad0-c203-41ba-92e8-ce775d34b40c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:14.924333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54a7cad0-c203-41ba-92e8-ce775d34b40c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:15.066556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54a7cad0-c203-41ba-92e8-ce775d34b40c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:15.074958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54a7cad0-c203-41ba-92e8-ce775d34b40c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.166142 Apr 11 20:11:15.075541 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1300/2736] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:14 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:15.185579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6263a68-0e6c-4583-bf19-80911c1c0754 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:15.186202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6263a68-0e6c-4583-bf19-80911c1c0754 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:15.192734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6263a68-0e6c-4583-bf19-80911c1c0754 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:15.193215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6263a68-0e6c-4583-bf19-80911c1c0754 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:15.193980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6263a68-0e6c-4583-bf19-80911c1c0754 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:15.194411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6263a68-0e6c-4583-bf19-80911c1c0754 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:15.336155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6263a68-0e6c-4583-bf19-80911c1c0754 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:15.348949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6263a68-0e6c-4583-bf19-80911c1c0754 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.168131 Apr 11 20:11:15.349733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1301/2737] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:15.766738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:15.767772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:15.777855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:15.778305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:15.779065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:15.779497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:15.917800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:15.926314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:15.927789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:15.928942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-093272fd-7a1c-4402-a636-61b6e4a74410 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.169050 Apr 11 20:11:15.929539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1302/2738] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:15 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:16.093390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7a937034-b62f-423b-87e9-b6f84f5e2e21 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:16.094057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7a937034-b62f-423b-87e9-b6f84f5e2e21 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:16.101939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a937034-b62f-423b-87e9-b6f84f5e2e21 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:16.102556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a937034-b62f-423b-87e9-b6f84f5e2e21 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:16.103486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a937034-b62f-423b-87e9-b6f84f5e2e21 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:16.104031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a937034-b62f-423b-87e9-b6f84f5e2e21 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:16.235293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7a937034-b62f-423b-87e9-b6f84f5e2e21 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:16.248526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7a937034-b62f-423b-87e9-b6f84f5e2e21 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.159536 Apr 11 20:11:16.249350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1303/2739] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:16 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:16.371696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4b5d3028-a090-4d31-b04c-b71c3ee8f95b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:16.372582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4b5d3028-a090-4d31-b04c-b71c3ee8f95b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:16.383013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b5d3028-a090-4d31-b04c-b71c3ee8f95b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:16.383757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b5d3028-a090-4d31-b04c-b71c3ee8f95b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:16.385063 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b5d3028-a090-4d31-b04c-b71c3ee8f95b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:16.385787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b5d3028-a090-4d31-b04c-b71c3ee8f95b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:16.523871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b5d3028-a090-4d31-b04c-b71c3ee8f95b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:16.532498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4b5d3028-a090-4d31-b04c-b71c3ee8f95b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.167397 Apr 11 20:11:16.533119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1304/2740] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:16.950726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:16.951438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:16.957936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:16.958389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:16.959150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:16.959586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:17.102636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:17.111085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:17.112568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:17.113764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b78b86cd-7251-4d51-95da-14eacba6d52b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.168899 Apr 11 20:11:17.114335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1305/2741] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:16 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:17.269517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-becf25a4-0faa-434b-a000-4634444bb96b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:17.270468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-becf25a4-0faa-434b-a000-4634444bb96b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:17.279695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-becf25a4-0faa-434b-a000-4634444bb96b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:17.280170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-becf25a4-0faa-434b-a000-4634444bb96b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:17.280939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-becf25a4-0faa-434b-a000-4634444bb96b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:17.281389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-becf25a4-0faa-434b-a000-4634444bb96b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:17.426194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-becf25a4-0faa-434b-a000-4634444bb96b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:17.437112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-becf25a4-0faa-434b-a000-4634444bb96b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.174124 Apr 11 20:11:17.437664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1306/2742] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:17 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:17.553591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7b7f95b-2b22-4c8d-8cf7-3ff945e544e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:17.554486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7b7f95b-2b22-4c8d-8cf7-3ff945e544e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:17.562573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7b7f95b-2b22-4c8d-8cf7-3ff945e544e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:17.563040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7b7f95b-2b22-4c8d-8cf7-3ff945e544e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:17.563767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7b7f95b-2b22-4c8d-8cf7-3ff945e544e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:17.564192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7b7f95b-2b22-4c8d-8cf7-3ff945e544e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:17.703995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7b7f95b-2b22-4c8d-8cf7-3ff945e544e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:17.715784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7b7f95b-2b22-4c8d-8cf7-3ff945e544e4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.168312 Apr 11 20:11:17.716542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1307/2743] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:18.136588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:18.137691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:18.147945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:18.148684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:18.149967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:18.150674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:18.293482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:18.306228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:18.308632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:18.309930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19f743bb-d344-41a8-8bd8-3d98dfce65e5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179884 Apr 11 20:11:18.310489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1308/2744] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:18 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:18.463922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1baad7de-8b00-4d7f-b6b4-6a22d8f03f58 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:18.464983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1baad7de-8b00-4d7f-b6b4-6a22d8f03f58 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:18.474797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1baad7de-8b00-4d7f-b6b4-6a22d8f03f58 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:18.475575 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1baad7de-8b00-4d7f-b6b4-6a22d8f03f58 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:18.476808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1baad7de-8b00-4d7f-b6b4-6a22d8f03f58 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:18.477587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1baad7de-8b00-4d7f-b6b4-6a22d8f03f58 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:18.827584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1baad7de-8b00-4d7f-b6b4-6a22d8f03f58 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:18.835886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1baad7de-8b00-4d7f-b6b4-6a22d8f03f58 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.378239 Apr 11 20:11:18.836463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1309/2745] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:18 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:18.840830 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d3db93e-09d6-4790-af62-8973e0e8d9fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:18.841458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d3db93e-09d6-4790-af62-8973e0e8d9fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:18.847322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d3db93e-09d6-4790-af62-8973e0e8d9fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:18.847764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d3db93e-09d6-4790-af62-8973e0e8d9fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:18.848511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d3db93e-09d6-4790-af62-8973e0e8d9fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:18.848963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d3db93e-09d6-4790-af62-8973e0e8d9fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:18.977248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d3db93e-09d6-4790-af62-8973e0e8d9fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:18.990165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d3db93e-09d6-4790-af62-8973e0e8d9fc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.152386 Apr 11 20:11:18.990869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1310/2746] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:19.330182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:19.330854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:19.338173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:19.338667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:19.339476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:19.339972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:19.473319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:19.484697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:19.486224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:19.487877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2b2aeda-bb0a-4856-a115-91f42d5d2af2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.161862 Apr 11 20:11:19.488808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1311/2747] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:19 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:11:19.856700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43aa3c7c-dd8a-4102-bbc3-69b67eff22cf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:19.857538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43aa3c7c-dd8a-4102-bbc3-69b67eff22cf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:19.866443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43aa3c7c-dd8a-4102-bbc3-69b67eff22cf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:19.867060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43aa3c7c-dd8a-4102-bbc3-69b67eff22cf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:19.868116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43aa3c7c-dd8a-4102-bbc3-69b67eff22cf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:19.868696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43aa3c7c-dd8a-4102-bbc3-69b67eff22cf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:20.016231 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43aa3c7c-dd8a-4102-bbc3-69b67eff22cf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:20.024560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43aa3c7c-dd8a-4102-bbc3-69b67eff22cf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.173867 Apr 11 20:11:20.025180 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1312/2748] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:19 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:20.029506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6239dd14-2377-4832-94da-ca001b70de57 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:20.030112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6239dd14-2377-4832-94da-ca001b70de57 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:20.036105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6239dd14-2377-4832-94da-ca001b70de57 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:20.036587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6239dd14-2377-4832-94da-ca001b70de57 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:20.037386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6239dd14-2377-4832-94da-ca001b70de57 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:20.037821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6239dd14-2377-4832-94da-ca001b70de57 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:20.166444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6239dd14-2377-4832-94da-ca001b70de57 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:20.175264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6239dd14-2377-4832-94da-ca001b70de57 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.149110 Apr 11 20:11:20.175854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1313/2749] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:20.511296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:20.512372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:20.522929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:20.523675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:20.524946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:20.525652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:20.656739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:20.665447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:20.666940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:20.668197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3929a12d-f079-4af8-b309-11f8ae343f71 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.163455 Apr 11 20:11:20.668763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1314/2750] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:20 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:21.044982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7891a85-0894-4c3a-ab48-cf6f8252f2e7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:21.046013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7891a85-0894-4c3a-ab48-cf6f8252f2e7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:21.056155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7891a85-0894-4c3a-ab48-cf6f8252f2e7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:21.056898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7891a85-0894-4c3a-ab48-cf6f8252f2e7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:21.058319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7891a85-0894-4c3a-ab48-cf6f8252f2e7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:21.058747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7891a85-0894-4c3a-ab48-cf6f8252f2e7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:21.189572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7891a85-0894-4c3a-ab48-cf6f8252f2e7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:21.197601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7891a85-0894-4c3a-ab48-cf6f8252f2e7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.159144 Apr 11 20:11:21.198175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1315/2751] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:21 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:21.202514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e24aba61-24de-4784-bd57-781ce4868495 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:21.203114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e24aba61-24de-4784-bd57-781ce4868495 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:21.208978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e24aba61-24de-4784-bd57-781ce4868495 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:21.209428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e24aba61-24de-4784-bd57-781ce4868495 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:21.210182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e24aba61-24de-4784-bd57-781ce4868495 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:21.210614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e24aba61-24de-4784-bd57-781ce4868495 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:21.342906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e24aba61-24de-4784-bd57-781ce4868495 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:21.351334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e24aba61-24de-4784-bd57-781ce4868495 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.152232 Apr 11 20:11:21.351902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1316/2752] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:21.690779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:21.691835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:21.702380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:21.703126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:21.704366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:21.705131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:21.838508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:21.847605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:21.849121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:21.850287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-250b7dc0-325b-48c3-941d-c7612e399562 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.166034 Apr 11 20:11:21.850862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1317/2753] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:21 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:22.215071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-935c8893-3872-4f2a-a801-123ba6cb036a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:22.215680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-935c8893-3872-4f2a-a801-123ba6cb036a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:22.222559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935c8893-3872-4f2a-a801-123ba6cb036a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:22.223005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935c8893-3872-4f2a-a801-123ba6cb036a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:22.223765 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935c8893-3872-4f2a-a801-123ba6cb036a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:22.224196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935c8893-3872-4f2a-a801-123ba6cb036a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:22.361706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-935c8893-3872-4f2a-a801-123ba6cb036a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:22.370038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-935c8893-3872-4f2a-a801-123ba6cb036a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.159109 Apr 11 20:11:22.370610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1318/2754] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:22 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:22.375414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba858426-e145-43e0-9cc5-56a0867f9511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:22.376013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba858426-e145-43e0-9cc5-56a0867f9511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:22.382484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba858426-e145-43e0-9cc5-56a0867f9511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:22.382926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba858426-e145-43e0-9cc5-56a0867f9511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:22.383672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba858426-e145-43e0-9cc5-56a0867f9511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:22.384098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba858426-e145-43e0-9cc5-56a0867f9511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:22.513643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba858426-e145-43e0-9cc5-56a0867f9511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:22.521450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba858426-e145-43e0-9cc5-56a0867f9511 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.149863 Apr 11 20:11:22.522027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1319/2755] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:22.873535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:22.874595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:22.885347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:22.886106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:22.887057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:22.887483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:23.032243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:23.043127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:23.045986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:23.048119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ae46934-93d3-47ef-96e6-dc5edb229735 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.181347 Apr 11 20:11:23.049088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1320/2756] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:22 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:23.392169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8db1b627-e698-4222-a2b3-1bf0681e01af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:23.393220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8db1b627-e698-4222-a2b3-1bf0681e01af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:23.403067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8db1b627-e698-4222-a2b3-1bf0681e01af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:23.403515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8db1b627-e698-4222-a2b3-1bf0681e01af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:23.404270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8db1b627-e698-4222-a2b3-1bf0681e01af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:23.404700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8db1b627-e698-4222-a2b3-1bf0681e01af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:23.536105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8db1b627-e698-4222-a2b3-1bf0681e01af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:23.544616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8db1b627-e698-4222-a2b3-1bf0681e01af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.159081 Apr 11 20:11:23.545198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1321/2757] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:23 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:23.549643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3edde813-f47d-4d75-bc83-c6fe4bf8e237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:23.550252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3edde813-f47d-4d75-bc83-c6fe4bf8e237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:23.556194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3edde813-f47d-4d75-bc83-c6fe4bf8e237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:23.556647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3edde813-f47d-4d75-bc83-c6fe4bf8e237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:23.557428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3edde813-f47d-4d75-bc83-c6fe4bf8e237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:23.557867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3edde813-f47d-4d75-bc83-c6fe4bf8e237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:23.691183 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3edde813-f47d-4d75-bc83-c6fe4bf8e237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:23.699670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3edde813-f47d-4d75-bc83-c6fe4bf8e237 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153503 Apr 11 20:11:23.700546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1322/2758] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:24.071379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:24.072409 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:24.083511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:24.084267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:24.085576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:24.086299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:24.219039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:24.232084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:24.234438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:24.236143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0d662896-d7a1-48bd-b2d3-2d4efe26d5f0 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171298 Apr 11 20:11:24.236959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1323/2759] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:24 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:24.561638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b34bf26a-15d7-47a4-bb41-3b0f26d4123a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:24.562279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b34bf26a-15d7-47a4-bb41-3b0f26d4123a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:24.568602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b34bf26a-15d7-47a4-bb41-3b0f26d4123a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:24.569082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b34bf26a-15d7-47a4-bb41-3b0f26d4123a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:24.569837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b34bf26a-15d7-47a4-bb41-3b0f26d4123a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:24.570262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b34bf26a-15d7-47a4-bb41-3b0f26d4123a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:24.698702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b34bf26a-15d7-47a4-bb41-3b0f26d4123a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:24.711070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b34bf26a-15d7-47a4-bb41-3b0f26d4123a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.153559 Apr 11 20:11:24.711930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1324/2760] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:24 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:24.716441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-096f4a26-77a0-4a09-95d0-5657e47fbd9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:24.717065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-096f4a26-77a0-4a09-95d0-5657e47fbd9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:24.723005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-096f4a26-77a0-4a09-95d0-5657e47fbd9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:24.723442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-096f4a26-77a0-4a09-95d0-5657e47fbd9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:24.724186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-096f4a26-77a0-4a09-95d0-5657e47fbd9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:24.724614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-096f4a26-77a0-4a09-95d0-5657e47fbd9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:24.853253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-096f4a26-77a0-4a09-95d0-5657e47fbd9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:24.864933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-096f4a26-77a0-4a09-95d0-5657e47fbd9a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.151727 Apr 11 20:11:24.865749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1325/2761] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:25.262555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:25.263501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:25.274271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:25.274986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:25.276274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:25.277128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:25.416244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:25.425037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:25.426502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:25.427682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4d7b0e58-3a20-4e2e-bbd0-673f9620d581 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.171802 Apr 11 20:11:25.428220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1326/2762] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:25 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:25.732423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3e32b88a-2277-4923-87c3-2ace3af467cd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:25.733482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3e32b88a-2277-4923-87c3-2ace3af467cd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:25.745077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e32b88a-2277-4923-87c3-2ace3af467cd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:25.745936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e32b88a-2277-4923-87c3-2ace3af467cd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:25.746708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e32b88a-2277-4923-87c3-2ace3af467cd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:25.747146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e32b88a-2277-4923-87c3-2ace3af467cd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:25.883124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3e32b88a-2277-4923-87c3-2ace3af467cd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:25.891064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3e32b88a-2277-4923-87c3-2ace3af467cd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.165331 Apr 11 20:11:25.891609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1327/2763] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:25 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:25.895921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f441fc3-a031-4e3d-b724-e0435549bc35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:25.896521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f441fc3-a031-4e3d-b724-e0435549bc35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:25.902004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f441fc3-a031-4e3d-b724-e0435549bc35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:25.902454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f441fc3-a031-4e3d-b724-e0435549bc35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:25.903210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f441fc3-a031-4e3d-b724-e0435549bc35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:25.903647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f441fc3-a031-4e3d-b724-e0435549bc35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:26.034784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f441fc3-a031-4e3d-b724-e0435549bc35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:26.042793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f441fc3-a031-4e3d-b724-e0435549bc35 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.150194 Apr 11 20:11:26.043368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1328/2764] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:26.450685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:26.451701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:26.462235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:26.462973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:26.464340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:26.464810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:26.595659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:26.607125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:26.608596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:26.609776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a798b5b2-494b-4770-bfa9-b4727aea8cf9 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.165806 Apr 11 20:11:26.610332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1329/2765] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:26 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:26.912387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4a536db2-aa68-4713-b4e4-99abb839d5ca tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:26.913312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4a536db2-aa68-4713-b4e4-99abb839d5ca tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:26.921243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a536db2-aa68-4713-b4e4-99abb839d5ca tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:26.921688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a536db2-aa68-4713-b4e4-99abb839d5ca tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:26.922436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a536db2-aa68-4713-b4e4-99abb839d5ca tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:26.922861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a536db2-aa68-4713-b4e4-99abb839d5ca tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:27.057377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4a536db2-aa68-4713-b4e4-99abb839d5ca tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:27.065875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4a536db2-aa68-4713-b4e4-99abb839d5ca tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.160075 Apr 11 20:11:27.066442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1330/2766] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:26 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:27.070789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-08b3aa2c-2f42-4579-8926-27bb0d902715 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:27.071492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-08b3aa2c-2f42-4579-8926-27bb0d902715 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:27.077759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08b3aa2c-2f42-4579-8926-27bb0d902715 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:27.077759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08b3aa2c-2f42-4579-8926-27bb0d902715 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:27.078490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08b3aa2c-2f42-4579-8926-27bb0d902715 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:27.078911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08b3aa2c-2f42-4579-8926-27bb0d902715 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:27.209532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-08b3aa2c-2f42-4579-8926-27bb0d902715 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:27.217854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-08b3aa2c-2f42-4579-8926-27bb0d902715 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.150487 Apr 11 20:11:27.218418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1331/2767] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:27.638147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:27.638981 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:27.646842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:27.647393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:27.648356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:27.648884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:27.805570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:27.815482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:27.817215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:27.818392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-76ee9d6e-64c0-4c23-97a4-629c5b9a423f tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.186636 Apr 11 20:11:27.818966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1332/2768] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:27 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:28.083823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ef5278e-df61-4f21-844b-714c96e9144c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:28.084935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ef5278e-df61-4f21-844b-714c96e9144c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:28.092800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ef5278e-df61-4f21-844b-714c96e9144c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:28.093275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ef5278e-df61-4f21-844b-714c96e9144c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:28.094035 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ef5278e-df61-4f21-844b-714c96e9144c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:28.094456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ef5278e-df61-4f21-844b-714c96e9144c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:28.232919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1ef5278e-df61-4f21-844b-714c96e9144c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:28.241338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ef5278e-df61-4f21-844b-714c96e9144c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.162887 Apr 11 20:11:28.241885 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1333/2769] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:28 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:28.246222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7b79634-14d9-45cd-a4f6-5479c118df31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:28.246823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7b79634-14d9-45cd-a4f6-5479c118df31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:28.252594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7b79634-14d9-45cd-a4f6-5479c118df31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:28.253089 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7b79634-14d9-45cd-a4f6-5479c118df31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:28.253844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7b79634-14d9-45cd-a4f6-5479c118df31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:28.254273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7b79634-14d9-45cd-a4f6-5479c118df31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:28.395319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7b79634-14d9-45cd-a4f6-5479c118df31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:28.404177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7b79634-14d9-45cd-a4f6-5479c118df31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.161357 Apr 11 20:11:28.404752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1334/2770] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:28.840965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:28.842026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:28.852610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:28.853436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:28.854793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:28.855630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:28.999965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:29.009172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:29.010679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:29.011993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b06e2ba3-95b0-4c0c-bf20-9caa8785a69e tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.177444 Apr 11 20:11:29.012544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1335/2771] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:28 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:29.262762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9f7bff81-c3e2-4cd1-95f9-6203762d5b02 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:29.263790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9f7bff81-c3e2-4cd1-95f9-6203762d5b02 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:29.274026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f7bff81-c3e2-4cd1-95f9-6203762d5b02 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:29.274768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f7bff81-c3e2-4cd1-95f9-6203762d5b02 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:29.276006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f7bff81-c3e2-4cd1-95f9-6203762d5b02 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:29.276725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f7bff81-c3e2-4cd1-95f9-6203762d5b02 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:29.400266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9f7bff81-c3e2-4cd1-95f9-6203762d5b02 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:29.408248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9f7bff81-c3e2-4cd1-95f9-6203762d5b02 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.151969 Apr 11 20:11:29.408841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1336/2772] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:29 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:29.426031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-96d854c6-7553-47ac-bba2-a729672631f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:29.426900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-96d854c6-7553-47ac-bba2-a729672631f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:29.436229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96d854c6-7553-47ac-bba2-a729672631f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:29.436669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96d854c6-7553-47ac-bba2-a729672631f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:29.437459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96d854c6-7553-47ac-bba2-a729672631f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:29.437883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96d854c6-7553-47ac-bba2-a729672631f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:29.580232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-96d854c6-7553-47ac-bba2-a729672631f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:29.592653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-96d854c6-7553-47ac-bba2-a729672631f2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.172288 Apr 11 20:11:29.593496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1337/2773] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:11:30.033999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:30.034842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:30.043287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:30.043852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:30.044794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:30.045347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:30.173648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:30.182732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:30.184325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:30.185540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0869c8fb-95a6-46f0-b8d5-cd0d917c83f7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.156511 Apr 11 20:11:30.186072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1338/2774] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:30 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:30.435800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ab8470a-4ff4-40bc-b995-b6582a168147 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:30.436802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ab8470a-4ff4-40bc-b995-b6582a168147 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:30.446959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ab8470a-4ff4-40bc-b995-b6582a168147 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:30.447696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ab8470a-4ff4-40bc-b995-b6582a168147 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:30.449058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ab8470a-4ff4-40bc-b995-b6582a168147 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:30.449605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ab8470a-4ff4-40bc-b995-b6582a168147 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:30.587818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ab8470a-4ff4-40bc-b995-b6582a168147 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:30.599764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ab8470a-4ff4-40bc-b995-b6582a168147 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.170391 Apr 11 20:11:30.600573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1339/2775] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:30 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:30.614237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0e3b40bc-e7eb-4720-ab77-68c03f5b8952 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:30.614838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0e3b40bc-e7eb-4720-ab77-68c03f5b8952 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:30.621315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e3b40bc-e7eb-4720-ab77-68c03f5b8952 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:30.621775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e3b40bc-e7eb-4720-ab77-68c03f5b8952 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:30.622598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e3b40bc-e7eb-4720-ab77-68c03f5b8952 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:30.623028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e3b40bc-e7eb-4720-ab77-68c03f5b8952 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:30.750292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0e3b40bc-e7eb-4720-ab77-68c03f5b8952 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:30.758573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0e3b40bc-e7eb-4720-ab77-68c03f5b8952 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.147883 Apr 11 20:11:30.759165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1340/2776] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:11:31.209734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:31.210708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:31.220606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:31.221350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:31.222286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:31.222714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:31.359402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:31.373880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:31.376259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:31.378045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a40e8043-3542-4448-a388-2177bcc3b4d5 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.173348 Apr 11 20:11:31.378804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1341/2777] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:31 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:31.625126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cb745ea6-4f61-4cbf-9d24-671cf3be346a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:31.625126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cb745ea6-4f61-4cbf-9d24-671cf3be346a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:31.631435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb745ea6-4f61-4cbf-9d24-671cf3be346a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:31.631988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb745ea6-4f61-4cbf-9d24-671cf3be346a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:31.632959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb745ea6-4f61-4cbf-9d24-671cf3be346a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:31.633491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb745ea6-4f61-4cbf-9d24-671cf3be346a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:31.767828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb745ea6-4f61-4cbf-9d24-671cf3be346a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:31.775705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cb745ea6-4f61-4cbf-9d24-671cf3be346a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.159399 Apr 11 20:11:31.776267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1342/2778] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:31 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:31.780705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-603447f1-bce5-4d07-b6cb-1214c9dcf72b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:31.781326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-603447f1-bce5-4d07-b6cb-1214c9dcf72b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:31.787279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-603447f1-bce5-4d07-b6cb-1214c9dcf72b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:31.787695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-603447f1-bce5-4d07-b6cb-1214c9dcf72b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:31.788439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-603447f1-bce5-4d07-b6cb-1214c9dcf72b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:31.788865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-603447f1-bce5-4d07-b6cb-1214c9dcf72b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:31.917628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-603447f1-bce5-4d07-b6cb-1214c9dcf72b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:31.925506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-603447f1-bce5-4d07-b6cb-1214c9dcf72b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.148334 Apr 11 20:11:31.926090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1343/2779] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:32.404041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:32.405205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:32.416058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:32.416832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:32.418236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:32.418987 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:32.560589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:32.573858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:32.575443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:32.576604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5999a4b9-a3bf-4b93-bec4-63366edb896d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.179403 Apr 11 20:11:32.577190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1344/2780] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:32 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:32.795925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81e36ec6-cade-47b4-b5bb-ed3156e6420a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:32.796540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81e36ec6-cade-47b4-b5bb-ed3156e6420a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:32.803861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81e36ec6-cade-47b4-b5bb-ed3156e6420a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:32.804406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81e36ec6-cade-47b4-b5bb-ed3156e6420a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:32.805333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81e36ec6-cade-47b4-b5bb-ed3156e6420a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:32.805843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81e36ec6-cade-47b4-b5bb-ed3156e6420a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:32.941967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-81e36ec6-cade-47b4-b5bb-ed3156e6420a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:32.954203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81e36ec6-cade-47b4-b5bb-ed3156e6420a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.163530 Apr 11 20:11:32.955001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1345/2781] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:32 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:32.959603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb2911d4-3741-4c26-827b-015cb6a4b484 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:32.960200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb2911d4-3741-4c26-827b-015cb6a4b484 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:32.966311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb2911d4-3741-4c26-827b-015cb6a4b484 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:32.966759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb2911d4-3741-4c26-827b-015cb6a4b484 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:32.967508 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb2911d4-3741-4c26-827b-015cb6a4b484 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:32.967941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb2911d4-3741-4c26-827b-015cb6a4b484 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:33.104403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb2911d4-3741-4c26-827b-015cb6a4b484 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:33.112675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb2911d4-3741-4c26-827b-015cb6a4b484 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.156754 Apr 11 20:11:33.113282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1346/2782] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:33.599021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:33.600137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:33.608877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:33.609353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:33.610096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:33.610552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:33.759392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:33.768516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:33.770031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:33.771196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-efb04267-a0af-43e9-ae0f-c061d39f9f7c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.178737 Apr 11 20:11:33.771758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1347/2783] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:33 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:33.975245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b6f201d5-b787-433c-97a7-3f31be527521 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:33.976246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b6f201d5-b787-433c-97a7-3f31be527521 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:33.986380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6f201d5-b787-433c-97a7-3f31be527521 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:33.987117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6f201d5-b787-433c-97a7-3f31be527521 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:33.988377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6f201d5-b787-433c-97a7-3f31be527521 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:33.989124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6f201d5-b787-433c-97a7-3f31be527521 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:34.128133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b6f201d5-b787-433c-97a7-3f31be527521 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:34.136944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b6f201d5-b787-433c-97a7-3f31be527521 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.168142 Apr 11 20:11:34.137499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1348/2784] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:33 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:34.141931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74cb3606-ea0b-46c1-9116-eb0eacf45620 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:34.142537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74cb3606-ea0b-46c1-9116-eb0eacf45620 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:34.148445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74cb3606-ea0b-46c1-9116-eb0eacf45620 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:34.148897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74cb3606-ea0b-46c1-9116-eb0eacf45620 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:34.149682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74cb3606-ea0b-46c1-9116-eb0eacf45620 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:34.150123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74cb3606-ea0b-46c1-9116-eb0eacf45620 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:34.282714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74cb3606-ea0b-46c1-9116-eb0eacf45620 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:34.290684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74cb3606-ea0b-46c1-9116-eb0eacf45620 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.152231 Apr 11 20:11:34.291256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1349/2785] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:34.793668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:34.794758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:34.801623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:34.802074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:34.802839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:34.803276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:34.945631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:34.955283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:34.956757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:34.957970 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0891ec6d-333f-4f39-ac04-6ee77a8a4597 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170655 Apr 11 20:11:34.958517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1350/2786] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:34 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:35.157781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e65f9f18-c238-40f2-ab7a-b5cf8adb2c96 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:35.158779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e65f9f18-c238-40f2-ab7a-b5cf8adb2c96 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:35.168639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e65f9f18-c238-40f2-ab7a-b5cf8adb2c96 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:35.169115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e65f9f18-c238-40f2-ab7a-b5cf8adb2c96 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:35.169867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e65f9f18-c238-40f2-ab7a-b5cf8adb2c96 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:35.170292 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e65f9f18-c238-40f2-ab7a-b5cf8adb2c96 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:35.306906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e65f9f18-c238-40f2-ab7a-b5cf8adb2c96 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:35.315286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e65f9f18-c238-40f2-ab7a-b5cf8adb2c96 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.163857 Apr 11 20:11:35.315866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1351/2787] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:35 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:35.320247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79b15167-6680-4360-96fa-06eaea90d656 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:35.320855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-79b15167-6680-4360-96fa-06eaea90d656 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:35.326852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79b15167-6680-4360-96fa-06eaea90d656 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:35.327295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79b15167-6680-4360-96fa-06eaea90d656 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:35.328049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79b15167-6680-4360-96fa-06eaea90d656 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:35.328477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79b15167-6680-4360-96fa-06eaea90d656 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:35.463014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79b15167-6680-4360-96fa-06eaea90d656 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:35.471621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79b15167-6680-4360-96fa-06eaea90d656 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154819 Apr 11 20:11:35.472175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1352/2788] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:35.980518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:35.981653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:35.992463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:35.993270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:35.994518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:35.995237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:36.127709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:36.140641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:36.142937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:36.144772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-97ef12d1-ab9f-4180-bfc7-0ac8e84f82fa tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.170553 Apr 11 20:11:36.145591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1353/2789] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:11:35 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:11:36.331747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-922871f7-0dd7-418c-b086-e44aefc44324 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:36.332356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-922871f7-0dd7-418c-b086-e44aefc44324 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:36.338712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-922871f7-0dd7-418c-b086-e44aefc44324 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:36.339157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-922871f7-0dd7-418c-b086-e44aefc44324 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:36.339904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-922871f7-0dd7-418c-b086-e44aefc44324 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:36.340326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-922871f7-0dd7-418c-b086-e44aefc44324 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:36.475925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-922871f7-0dd7-418c-b086-e44aefc44324 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:36.485552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-922871f7-0dd7-418c-b086-e44aefc44324 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.157671 Apr 11 20:11:36.486125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1354/2790] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:36 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:36.490491 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79426975-c752-4e1a-addf-fe8fe7688a13 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:11:36.491087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-79426975-c752-4e1a-addf-fe8fe7688a13 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:11:36.497147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79426975-c752-4e1a-addf-fe8fe7688a13 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:36.497595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79426975-c752-4e1a-addf-fe8fe7688a13 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:36.498667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79426975-c752-4e1a-addf-fe8fe7688a13 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:11:36.499096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79426975-c752-4e1a-addf-fe8fe7688a13 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:11:36.625081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79426975-c752-4e1a-addf-fe8fe7688a13 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:11:36.633002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79426975-c752-4e1a-addf-fe8fe7688a13 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.145920 Apr 11 20:11:36.633536 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1355/2791] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:11:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:11:36.915650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-358f78b1-c4d7-446d-ab06-704a8c3e4ea9 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Calling method '.version_select at 0x7f4086dc59d0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:08.706178 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-576dff2c-8d47-40e2-aa28-6b41da08b89e tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] HTTP exception thrown: Volume tempest-invalid-1172057786 could not be found. Apr 11 20:12:08.706770 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-576dff2c-8d47-40e2-aa28-6b41da08b89e tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Returning 404 to user: Volume tempest-invalid-1172057786 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:12:08.707632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-576dff2c-8d47-40e2-aa28-6b41da08b89e tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1172057786" status: 404 len: 99 microversion: 2.1 time: 91.861311 Apr 11 20:12:08.708186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1437/2792] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Apr 11 20:10:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1172057786 => generated 99 bytes in 91862 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 20:12:08.713525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:08.714131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:08.720384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:08.721152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:08.722162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:08.722596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:08.857848 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:08.868169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:08.869933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:08.871427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e7ca2061-5ee0-426c-a719-3d8aeaadd236 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 200 len: 1801 microversion: 2.20 time: 0.162154 Apr 11 20:12:08.871919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1438/2793] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:08 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:08.876752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53da6f04-c1cb-4799-947e-8d75af477f20 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:08.877400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53da6f04-c1cb-4799-947e-8d75af477f20 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:08.884229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53da6f04-c1cb-4799-947e-8d75af477f20 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:08.884686 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53da6f04-c1cb-4799-947e-8d75af477f20 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:08.885496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53da6f04-c1cb-4799-947e-8d75af477f20 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:08.886182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53da6f04-c1cb-4799-947e-8d75af477f20 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:08.919992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-358f78b1-c4d7-446d-ab06-704a8c3e4ea9 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] HTTP exception thrown: Volume tempest-invalid-1172057786 could not be found. Apr 11 20:12:08.920670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-358f78b1-c4d7-446d-ab06-704a8c3e4ea9 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Returning 404 to user: Volume tempest-invalid-1172057786 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:12:08.921600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-358f78b1-c4d7-446d-ab06-704a8c3e4ea9 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1172057786" status: 404 len: 99 microversion: 2.1 time: 32.012589 Apr 11 20:12:08.922380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1356/2794] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Apr 11 20:11:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1172057786 => generated 99 bytes in 32014 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 20:12:08.926878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd8c8305-0d38-4512-be19-05d69c9c7973 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:08.929200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd8c8305-0d38-4512-be19-05d69c9c7973 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:08.940762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd8c8305-0d38-4512-be19-05d69c9c7973 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:08.941311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd8c8305-0d38-4512-be19-05d69c9c7973 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:08.942149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd8c8305-0d38-4512-be19-05d69c9c7973 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:08.942848 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd8c8305-0d38-4512-be19-05d69c9c7973 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:09.103311 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-53da6f04-c1cb-4799-947e-8d75af477f20 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:09.112708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53da6f04-c1cb-4799-947e-8d75af477f20 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.239758 Apr 11 20:12:09.113380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1439/2795] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:08 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:09.114308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd8c8305-0d38-4512-be19-05d69c9c7973 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:09.118246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-69aa170d-347d-4ef3-99d1-b34481cf761c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '.version_select at 0x7f4086dc3d30>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:09.122645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd8c8305-0d38-4512-be19-05d69c9c7973 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.199379 Apr 11 20:12:09.123538 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1357/2796] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:09.128340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4608dc8-0553-4c38-ad06-20434e78157e tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003664 Apr 11 20:12:09.128827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1358/2797] 10.222.0.62 () {58 vars in 1139 bytes} [Mon Apr 11 20:12:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 20:12:09.138138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-28a9a0f3-aae2-4552-84d1-580f1ced4716 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004006 Apr 11 20:12:09.138624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1359/2798] 10.222.0.62 () {58 vars in 1136 bytes} [Mon Apr 11 20:12:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 20:12:09.144550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-69aa170d-347d-4ef3-99d1-b34481cf761c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840447429" status: 204 len: 0 microversion: 2.20 time: 0.030057 Apr 11 20:12:09.145240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1440/2799] 10.222.0.62 () {60 vars in 1258 bytes} [Mon Apr 11 20:12:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840447429 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:12:09.147043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cda626ea-b4da-4d84-aa58-f348d212c035 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Calling method '.version_select at 0x7f4086de5700>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:10.133493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e9c986d9-1c03-4016-8b23-d4dfad8a3774 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:10.134046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e9c986d9-1c03-4016-8b23-d4dfad8a3774 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:10.140939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9c986d9-1c03-4016-8b23-d4dfad8a3774 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:10.141386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9c986d9-1c03-4016-8b23-d4dfad8a3774 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:10.142158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9c986d9-1c03-4016-8b23-d4dfad8a3774 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:10.142588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9c986d9-1c03-4016-8b23-d4dfad8a3774 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:10.274442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e9c986d9-1c03-4016-8b23-d4dfad8a3774 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:10.283014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e9c986d9-1c03-4016-8b23-d4dfad8a3774 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.156162 Apr 11 20:12:10.292695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1441/2800] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:10 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:10.298045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb5df98b-6d76-4812-a12a-2c227fc1bbb2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:10.298724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb5df98b-6d76-4812-a12a-2c227fc1bbb2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:10.304825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb5df98b-6d76-4812-a12a-2c227fc1bbb2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:10.305306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb5df98b-6d76-4812-a12a-2c227fc1bbb2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:10.306092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb5df98b-6d76-4812-a12a-2c227fc1bbb2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:10.306519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb5df98b-6d76-4812-a12a-2c227fc1bbb2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:10.450104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bb5df98b-6d76-4812-a12a-2c227fc1bbb2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:10.459023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb5df98b-6d76-4812-a12a-2c227fc1bbb2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.165254 Apr 11 20:12:10.459829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1442/2801] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:10.473529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-68d74286-6bfc-41c9-b1a8-4a948d8559bd req-ccaf527d-89d4-4cbf-91e0-3261ab07c85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6aea71-8b17-46b8-ab07-b42b41b573a5", "tag": "043741af-b872-498e-a793-2860d820736a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:12:10.481657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-68d74286-6bfc-41c9-b1a8-4a948d8559bd req-ccaf527d-89d4-4cbf-91e0-3261ab07c85e service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:10.482086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-68d74286-6bfc-41c9-b1a8-4a948d8559bd req-ccaf527d-89d4-4cbf-91e0-3261ab07c85e service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:10.493824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-68d74286-6bfc-41c9-b1a8-4a948d8559bd req-ccaf527d-89d4-4cbf-91e0-3261ab07c85e service nova] Creating event network-changed:043741af-b872-498e-a793-2860d820736a for instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 on hv-cinder-83078 Apr 11 20:12:10.499603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-68d74286-6bfc-41c9-b1a8-4a948d8559bd req-ccaf527d-89d4-4cbf-91e0-3261ab07c85e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 Apr 11 20:12:10.500367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1443/2802] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:12:10.519071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb01356b-8c79-4e5e-bf30-9b39909352ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Action: 'create', calling method: .version_select at 0x7f408ff6e1f0>, body: {"keypair": {"name": "tempest-keypair-1825902299"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:12:10.533314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-cb01356b-8c79-4e5e-bf30-9b39909352ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:12:10.537958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-cb01356b-8c79-4e5e-bf30-9b39909352ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for user 6342f0d42fd04a6abd7d1da1e692de34 and project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:12:10.689358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-cb01356b-8c79-4e5e-bf30-9b39909352ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:12:10.693145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-cb01356b-8c79-4e5e-bf30-9b39909352ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for user 6342f0d42fd04a6abd7d1da1e692de34 and project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:12:10.706352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb01356b-8c79-4e5e-bf30-9b39909352ae tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.191560 Apr 11 20:12:10.707251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1444/2803] 10.222.0.62 () {62 vars in 1198 bytes} [Mon Apr 11 20:12:10 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 11 20:12:11.300357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ec2a972-682c-438a-833c-e48d0e067300 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:11.301212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ec2a972-682c-438a-833c-e48d0e067300 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:11.308790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ec2a972-682c-438a-833c-e48d0e067300 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:11.309657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ec2a972-682c-438a-833c-e48d0e067300 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:11.310455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ec2a972-682c-438a-833c-e48d0e067300 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:11.310885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ec2a972-682c-438a-833c-e48d0e067300 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:11.442232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0ec2a972-682c-438a-833c-e48d0e067300 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:11.450563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ec2a972-682c-438a-833c-e48d0e067300 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.154545 Apr 11 20:12:11.451106 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1445/2804] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:11 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:12:11.479707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c32733c3-54d0-4079-be7f-fb5d9510f6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:11.480320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c32733c3-54d0-4079-be7f-fb5d9510f6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:11.486188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c32733c3-54d0-4079-be7f-fb5d9510f6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:11.486647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c32733c3-54d0-4079-be7f-fb5d9510f6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:11.487413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c32733c3-54d0-4079-be7f-fb5d9510f6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:11.487850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c32733c3-54d0-4079-be7f-fb5d9510f6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:11.620828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c32733c3-54d0-4079-be7f-fb5d9510f6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:11.629038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c32733c3-54d0-4079-be7f-fb5d9510f6da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153207 Apr 11 20:12:11.629592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1446/2805] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:12:12.036575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1099635041", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4987ff82-d882-41eb-93e0-80dec0d86a06"}], "security_groups": [{"name": "tempest-securitygroup--1033618923"}], "key_name": "tempest-keypair-1825902299", "user_data": "}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:12:12.136323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] validate_networks() for [('4987ff82-d882-41eb-93e0-80dec0d86a06', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 20:12:12.637142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:12:12.638169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:12:12.638427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:12:12.639044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:12:12.639623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:12:12.653051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:12.653815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:12.654617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:12.655038 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:12.671500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:12:12.675910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Getting quotas for user 6342f0d42fd04a6abd7d1da1e692de34 and project c697a9ca9d1a403cb1b812db1874dfcd. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:12:12.688084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 20:12:12.690384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 20:12:12.748615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68f8a03e-e1ff-4d21-8f2c-5b5b0a3617e2 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.716069 Apr 11 20:12:12.749567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1447/2806] 10.222.0.62 () {62 vars in 1187 bytes} [Mon Apr 11 20:12:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 11 20:12:12.756833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83f49d70-326a-4464-944b-a7aefc25e95d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:12.757716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83f49d70-326a-4464-944b-a7aefc25e95d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:12.763827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83f49d70-326a-4464-944b-a7aefc25e95d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:12.764265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83f49d70-326a-4464-944b-a7aefc25e95d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:12.766946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83f49d70-326a-4464-944b-a7aefc25e95d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:12.767391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83f49d70-326a-4464-944b-a7aefc25e95d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:12.901739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83f49d70-326a-4464-944b-a7aefc25e95d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:12.909829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83f49d70-326a-4464-944b-a7aefc25e95d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.156906 Apr 11 20:12:12.910398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1448/2807] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:12 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:12.914733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c1e18fd0-5da4-4146-8252-10955c32a159 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:12.915333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c1e18fd0-5da4-4146-8252-10955c32a159 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:12.920859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1e18fd0-5da4-4146-8252-10955c32a159 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:12.921358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1e18fd0-5da4-4146-8252-10955c32a159 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:12.922110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1e18fd0-5da4-4146-8252-10955c32a159 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:12.922652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1e18fd0-5da4-4146-8252-10955c32a159 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:13.058440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c1e18fd0-5da4-4146-8252-10955c32a159 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:13.066399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c1e18fd0-5da4-4146-8252-10955c32a159 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.155033 Apr 11 20:12:13.066935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1449/2808] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:13.076077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50d6c4e2-0384-4f0f-99d8-1bbcecfad186 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:13.076077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50d6c4e2-0384-4f0f-99d8-1bbcecfad186 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:13.128192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50d6c4e2-0384-4f0f-99d8-1bbcecfad186 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:13.135337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50d6c4e2-0384-4f0f-99d8-1bbcecfad186 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:13.136969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50d6c4e2-0384-4f0f-99d8-1bbcecfad186 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:13.138123 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50d6c4e2-0384-4f0f-99d8-1bbcecfad186 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1282 microversion: 2.20 time: 0.070223 Apr 11 20:12:13.138685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1450/2809] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:13 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:13.927104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd4bd001-e790-42fd-bbc7-82e5f5ab95c0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:13.927756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd4bd001-e790-42fd-bbc7-82e5f5ab95c0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:13.935715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd4bd001-e790-42fd-bbc7-82e5f5ab95c0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:13.936165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd4bd001-e790-42fd-bbc7-82e5f5ab95c0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:13.936933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd4bd001-e790-42fd-bbc7-82e5f5ab95c0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:13.937385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd4bd001-e790-42fd-bbc7-82e5f5ab95c0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:14.068976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bd4bd001-e790-42fd-bbc7-82e5f5ab95c0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:14.077060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd4bd001-e790-42fd-bbc7-82e5f5ab95c0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.154104 Apr 11 20:12:14.077629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1451/2810] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:13 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:14.083409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d4cf39a4-4abb-4fd4-8550-8eab10aafcfe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:14.084252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d4cf39a4-4abb-4fd4-8550-8eab10aafcfe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:14.090269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a4-4abb-4fd4-8550-8eab10aafcfe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:14.090747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a4-4abb-4fd4-8550-8eab10aafcfe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:14.091481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a4-4abb-4fd4-8550-8eab10aafcfe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:14.091908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a4-4abb-4fd4-8550-8eab10aafcfe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:14.235824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d4cf39a4-4abb-4fd4-8550-8eab10aafcfe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:14.244255 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d4cf39a4-4abb-4fd4-8550-8eab10aafcfe tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.164669 Apr 11 20:12:14.244804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1452/2811] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:14.250068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:14.250682 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:14.256865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:14.257366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:14.258143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:14.258582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:14.320588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:14.328580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:14.330206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:14.331352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b2341bc1-f848-478a-8a86-7197cf3ba336 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1340 microversion: 2.20 time: 0.085413 Apr 11 20:12:14.331972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1453/2812] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:14 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1340 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:15.089731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-3947e189-7f7f-4712-99df-010c30bfee27 req-1cd53cc0-7fb9-4953-8d49-9df3158a3cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e7987e-b5e1-4839-b663-b9edb28e960b", "tag": "0e1a2432-3d2a-438b-9a40-93147e10d312"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:12:15.101510 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-3947e189-7f7f-4712-99df-010c30bfee27 req-1cd53cc0-7fb9-4953-8d49-9df3158a3cea service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:15.101946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-3947e189-7f7f-4712-99df-010c30bfee27 req-1cd53cc0-7fb9-4953-8d49-9df3158a3cea service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:15.114960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-3947e189-7f7f-4712-99df-010c30bfee27 req-1cd53cc0-7fb9-4953-8d49-9df3158a3cea service nova] Creating event network-changed:0e1a2432-3d2a-438b-9a40-93147e10d312 for instance 09e7987e-b5e1-4839-b663-b9edb28e960b on hv-cinder-83078 Apr 11 20:12:15.120185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-3947e189-7f7f-4712-99df-010c30bfee27 req-1cd53cc0-7fb9-4953-8d49-9df3158a3cea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035043 Apr 11 20:12:15.121083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1454/2813] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:12:15.128048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c86d851e-1173-47e7-8d86-4c0e39b005a4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:15.128745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c86d851e-1173-47e7-8d86-4c0e39b005a4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:15.135958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c86d851e-1173-47e7-8d86-4c0e39b005a4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:15.136506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c86d851e-1173-47e7-8d86-4c0e39b005a4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:15.137501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c86d851e-1173-47e7-8d86-4c0e39b005a4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:15.138175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c86d851e-1173-47e7-8d86-4c0e39b005a4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:15.274563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c86d851e-1173-47e7-8d86-4c0e39b005a4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:15.283021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c86d851e-1173-47e7-8d86-4c0e39b005a4 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.160508 Apr 11 20:12:15.283593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1455/2814] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:15 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:15.288420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc23f889-defb-430a-9039-1246cd65ccf4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:15.289330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc23f889-defb-430a-9039-1246cd65ccf4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:15.296657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc23f889-defb-430a-9039-1246cd65ccf4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:15.297132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc23f889-defb-430a-9039-1246cd65ccf4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:15.297892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc23f889-defb-430a-9039-1246cd65ccf4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:15.298344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc23f889-defb-430a-9039-1246cd65ccf4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:15.426250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dc23f889-defb-430a-9039-1246cd65ccf4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:15.434005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc23f889-defb-430a-9039-1246cd65ccf4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.149143 Apr 11 20:12:15.434792 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1456/2815] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:15.438924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:15.439489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:15.445296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:15.445731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:15.446478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:15.446930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:15.575265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:15.583601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:15.585108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:15.586201 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c4f3e8d5-26ff-4e12-b785-99147a8014b7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1408 microversion: 2.20 time: 0.150725 Apr 11 20:12:15.586753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1457/2816] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:15 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:16.301250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ab7acd3-ab83-4a2e-b70c-523211efc077 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:16.301902 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ab7acd3-ab83-4a2e-b70c-523211efc077 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:16.308837 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ab7acd3-ab83-4a2e-b70c-523211efc077 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:16.309398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ab7acd3-ab83-4a2e-b70c-523211efc077 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:16.310180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ab7acd3-ab83-4a2e-b70c-523211efc077 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:16.310590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ab7acd3-ab83-4a2e-b70c-523211efc077 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:16.453867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5ab7acd3-ab83-4a2e-b70c-523211efc077 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:16.462719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ab7acd3-ab83-4a2e-b70c-523211efc077 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.166029 Apr 11 20:12:16.463325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1458/2817] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:16 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:16.467878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-de24f41d-c135-4d59-bcf1-a6eacf8d1b3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:16.468468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-de24f41d-c135-4d59-bcf1-a6eacf8d1b3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:16.474064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de24f41d-c135-4d59-bcf1-a6eacf8d1b3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:16.474533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de24f41d-c135-4d59-bcf1-a6eacf8d1b3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:16.475276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de24f41d-c135-4d59-bcf1-a6eacf8d1b3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:16.475696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de24f41d-c135-4d59-bcf1-a6eacf8d1b3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:16.602262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-de24f41d-c135-4d59-bcf1-a6eacf8d1b3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:16.610619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-de24f41d-c135-4d59-bcf1-a6eacf8d1b3d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.146321 Apr 11 20:12:16.611200 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1459/2818] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:16.621252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:16.621252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:16.622230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:16.622795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:16.623877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:16.624309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:16.755494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:16.763593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:16.765125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:16.766270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a26720f-64bc-44a2-8a4c-f9647c6808d6 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1408 microversion: 2.20 time: 0.154156 Apr 11 20:12:16.766830 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1460/2819] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:16 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:17.483922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1be7057e-4377-4f75-acb4-fad423d7be77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:17.485046 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1be7057e-4377-4f75-acb4-fad423d7be77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:17.495519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1be7057e-4377-4f75-acb4-fad423d7be77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:17.496251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1be7057e-4377-4f75-acb4-fad423d7be77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:17.497498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1be7057e-4377-4f75-acb4-fad423d7be77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:17.497923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1be7057e-4377-4f75-acb4-fad423d7be77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:17.632946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1be7057e-4377-4f75-acb4-fad423d7be77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:17.641702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1be7057e-4377-4f75-acb4-fad423d7be77 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.164239 Apr 11 20:12:17.642276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1461/2820] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:17 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:17.646768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-240271b9-1a5e-4480-b4fe-9b992c9ca90a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:17.647372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-240271b9-1a5e-4480-b4fe-9b992c9ca90a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:17.653048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-240271b9-1a5e-4480-b4fe-9b992c9ca90a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:17.653536 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-240271b9-1a5e-4480-b4fe-9b992c9ca90a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:17.654280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-240271b9-1a5e-4480-b4fe-9b992c9ca90a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:17.654727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-240271b9-1a5e-4480-b4fe-9b992c9ca90a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:17.782930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-240271b9-1a5e-4480-b4fe-9b992c9ca90a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:17.791176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-240271b9-1a5e-4480-b4fe-9b992c9ca90a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.147928 Apr 11 20:12:17.791773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1462/2821] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:17.796484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:17.798166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:17.802739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:17.803182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:17.803927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:17.804350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:17.929820 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:17.937853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:17.939328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:17.940428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13f00c5b-b341-4a92-95ec-792f56806a65 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1408 microversion: 2.20 time: 0.147751 Apr 11 20:12:17.941012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1463/2822] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:17 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:18.662227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56831039-2d64-4b55-af9e-5ccbec01c021 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:18.663340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56831039-2d64-4b55-af9e-5ccbec01c021 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:18.673751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56831039-2d64-4b55-af9e-5ccbec01c021 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:18.674497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56831039-2d64-4b55-af9e-5ccbec01c021 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:18.675717 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56831039-2d64-4b55-af9e-5ccbec01c021 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:18.676467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56831039-2d64-4b55-af9e-5ccbec01c021 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:18.811437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56831039-2d64-4b55-af9e-5ccbec01c021 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:18.819644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56831039-2d64-4b55-af9e-5ccbec01c021 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.163812 Apr 11 20:12:18.820210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1464/2823] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:18 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:18.824524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-761c9643-c927-4929-b799-3c73f329d491 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:18.825158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-761c9643-c927-4929-b799-3c73f329d491 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:18.830865 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-761c9643-c927-4929-b799-3c73f329d491 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:18.831307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-761c9643-c927-4929-b799-3c73f329d491 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:18.832051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-761c9643-c927-4929-b799-3c73f329d491 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:18.832474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-761c9643-c927-4929-b799-3c73f329d491 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:18.964529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-761c9643-c927-4929-b799-3c73f329d491 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:18.972421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-761c9643-c927-4929-b799-3c73f329d491 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.151313 Apr 11 20:12:18.973003 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1465/2824] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:18.977308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:18.977964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:18.983659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:18.984127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:18.984856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:18.985315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:19.119960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:19.128612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:19.131104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:19.132760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-62355db0-1d3d-45c1-a653-cca938a1f5bf tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1408 microversion: 2.20 time: 0.158551 Apr 11 20:12:19.133674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1466/2825] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:18 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:19.837254 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-db1bf186-31e2-4747-9685-972759f314e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:19.837949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-db1bf186-31e2-4747-9685-972759f314e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:19.844441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db1bf186-31e2-4747-9685-972759f314e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:19.844886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db1bf186-31e2-4747-9685-972759f314e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:19.845693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db1bf186-31e2-4747-9685-972759f314e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:19.846122 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db1bf186-31e2-4747-9685-972759f314e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:19.976508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-db1bf186-31e2-4747-9685-972759f314e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:19.984937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-db1bf186-31e2-4747-9685-972759f314e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.151855 Apr 11 20:12:19.985515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1467/2826] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:19 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:19.989847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-da5c576d-378f-4f98-bc30-e340761c0ccb req-db012349-3780-4489-ac12-604307f8a65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e7987e-b5e1-4839-b663-b9edb28e960b", "name": "network-vif-plugged", "status": "completed", "tag": "0e1a2432-3d2a-438b-9a40-93147e10d312"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:12:19.997896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-da5c576d-378f-4f98-bc30-e340761c0ccb req-db012349-3780-4489-ac12-604307f8a65d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:19.998642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-da5c576d-378f-4f98-bc30-e340761c0ccb req-db012349-3780-4489-ac12-604307f8a65d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:20.009496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-da5c576d-378f-4f98-bc30-e340761c0ccb req-db012349-3780-4489-ac12-604307f8a65d service nova] Creating event network-vif-plugged:0e1a2432-3d2a-438b-9a40-93147e10d312 for instance 09e7987e-b5e1-4839-b663-b9edb28e960b on hv-cinder-83078 Apr 11 20:12:20.014805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-da5c576d-378f-4f98-bc30-e340761c0ccb req-db012349-3780-4489-ac12-604307f8a65d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028188 Apr 11 20:12:20.015366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1468/2827] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:12:20.020174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-306c98b5-7bbc-4b65-9216-9b80d1fe2202 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:20.020854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-306c98b5-7bbc-4b65-9216-9b80d1fe2202 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:20.028012 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306c98b5-7bbc-4b65-9216-9b80d1fe2202 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:20.028533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306c98b5-7bbc-4b65-9216-9b80d1fe2202 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:20.029336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306c98b5-7bbc-4b65-9216-9b80d1fe2202 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:20.029802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306c98b5-7bbc-4b65-9216-9b80d1fe2202 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:20.162740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-306c98b5-7bbc-4b65-9216-9b80d1fe2202 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:20.170726 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-306c98b5-7bbc-4b65-9216-9b80d1fe2202 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154271 Apr 11 20:12:20.171299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1469/2828] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:20.176535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:20.177161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:20.183083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:20.183539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:20.184305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:20.184784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:20.313702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:20.321655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:20.323133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:20.324248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-31cc4dd0-7303-4d25-a697-ff606e57a41b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1408 microversion: 2.20 time: 0.151374 Apr 11 20:12:20.324800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1470/2829] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:20 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:21.006630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-061d22b0-f3cd-4269-a0dc-3ee1f027cd3c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:21.007699 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-061d22b0-f3cd-4269-a0dc-3ee1f027cd3c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:21.018219 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-061d22b0-f3cd-4269-a0dc-3ee1f027cd3c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:21.018945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-061d22b0-f3cd-4269-a0dc-3ee1f027cd3c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:21.020177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-061d22b0-f3cd-4269-a0dc-3ee1f027cd3c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:21.020881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-061d22b0-f3cd-4269-a0dc-3ee1f027cd3c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:21.176346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-061d22b0-f3cd-4269-a0dc-3ee1f027cd3c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:21.185065 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-061d22b0-f3cd-4269-a0dc-3ee1f027cd3c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.184831 Apr 11 20:12:21.185605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1471/2830] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:20 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:21.190103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f333f067-daeb-49e4-8b91-2e5b09423822 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:21.190738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f333f067-daeb-49e4-8b91-2e5b09423822 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:21.196661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f333f067-daeb-49e4-8b91-2e5b09423822 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:21.197152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f333f067-daeb-49e4-8b91-2e5b09423822 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:21.197903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f333f067-daeb-49e4-8b91-2e5b09423822 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:21.198309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f333f067-daeb-49e4-8b91-2e5b09423822 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:21.332857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f333f067-daeb-49e4-8b91-2e5b09423822 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:21.340932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f333f067-daeb-49e4-8b91-2e5b09423822 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154340 Apr 11 20:12:21.341526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1472/2831] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:21.345908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:21.346500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:21.352285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:21.352731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:21.353512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:21.353939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:21.489583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:21.497515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:21.499296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:21.500428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a0528cf4-1026-467b-ac9b-4db3f17e3886 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1599 microversion: 2.20 time: 0.158005 Apr 11 20:12:21.501019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1473/2832] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:12:21 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:12:21.521636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9e3d520b-f9f8-4d1f-9fa1-d76fe7a72cd4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:21.522139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9e3d520b-f9f8-4d1f-9fa1-d76fe7a72cd4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:21.527799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e3d520b-f9f8-4d1f-9fa1-d76fe7a72cd4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:21.528382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e3d520b-f9f8-4d1f-9fa1-d76fe7a72cd4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:21.529165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e3d520b-f9f8-4d1f-9fa1-d76fe7a72cd4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:21.529587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9e3d520b-f9f8-4d1f-9fa1-d76fe7a72cd4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:21.605256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9e3d520b-f9f8-4d1f-9fa1-d76fe7a72cd4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087020 Apr 11 20:12:21.605868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1474/2833] 10.222.0.62 () {60 vars in 1315 bytes} [Mon Apr 11 20:12:21 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 20:12:22.202301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1544e1d3-e5df-4c3e-8cd5-002f5f7a86ee tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:22.202957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1544e1d3-e5df-4c3e-8cd5-002f5f7a86ee tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:22.208742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1544e1d3-e5df-4c3e-8cd5-002f5f7a86ee tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:22.209210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1544e1d3-e5df-4c3e-8cd5-002f5f7a86ee tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:22.209960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1544e1d3-e5df-4c3e-8cd5-002f5f7a86ee tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:22.210382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1544e1d3-e5df-4c3e-8cd5-002f5f7a86ee tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:22.651574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1544e1d3-e5df-4c3e-8cd5-002f5f7a86ee tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:22.660355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1544e1d3-e5df-4c3e-8cd5-002f5f7a86ee tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.462480 Apr 11 20:12:22.661032 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1475/2834] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:22 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:22.665498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d71959a3-de9d-49ef-b80c-93e7c22ea7a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:22.666153 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d71959a3-de9d-49ef-b80c-93e7c22ea7a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:22.672239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d71959a3-de9d-49ef-b80c-93e7c22ea7a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:22.672752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d71959a3-de9d-49ef-b80c-93e7c22ea7a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:22.673545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d71959a3-de9d-49ef-b80c-93e7c22ea7a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:22.673965 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d71959a3-de9d-49ef-b80c-93e7c22ea7a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:22.881102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d71959a3-de9d-49ef-b80c-93e7c22ea7a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:22.889956 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d71959a3-de9d-49ef-b80c-93e7c22ea7a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.227887 Apr 11 20:12:22.890533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1476/2835] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:23.027854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-d99e3415-7cf6-4d13-9bb1-8ad07bed8a30 req-16842bbe-8773-4d7b-b982-3b6a60f7364c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e7987e-b5e1-4839-b663-b9edb28e960b", "tag": "0e1a2432-3d2a-438b-9a40-93147e10d312"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:12:23.035908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-d99e3415-7cf6-4d13-9bb1-8ad07bed8a30 req-16842bbe-8773-4d7b-b982-3b6a60f7364c service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:23.036341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-d99e3415-7cf6-4d13-9bb1-8ad07bed8a30 req-16842bbe-8773-4d7b-b982-3b6a60f7364c service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:23.048439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-d99e3415-7cf6-4d13-9bb1-8ad07bed8a30 req-16842bbe-8773-4d7b-b982-3b6a60f7364c service nova] Creating event network-changed:0e1a2432-3d2a-438b-9a40-93147e10d312 for instance 09e7987e-b5e1-4839-b663-b9edb28e960b on hv-cinder-83078 Apr 11 20:12:23.054143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-d99e3415-7cf6-4d13-9bb1-8ad07bed8a30 req-16842bbe-8773-4d7b-b982-3b6a60f7364c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115411 Apr 11 20:12:23.055115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1477/2836] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:12:23.678285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a3ec6ec-a1a5-49a0-9e4d-f19d5bf56953 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:23.678979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a3ec6ec-a1a5-49a0-9e4d-f19d5bf56953 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:23.686076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a3ec6ec-a1a5-49a0-9e4d-f19d5bf56953 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:23.686877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a3ec6ec-a1a5-49a0-9e4d-f19d5bf56953 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:23.687278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a3ec6ec-a1a5-49a0-9e4d-f19d5bf56953 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:23.687705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a3ec6ec-a1a5-49a0-9e4d-f19d5bf56953 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:23.826507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0a3ec6ec-a1a5-49a0-9e4d-f19d5bf56953 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:23.836109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a3ec6ec-a1a5-49a0-9e4d-f19d5bf56953 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.162058 Apr 11 20:12:23.837041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1478/2837] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:23 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:23.907883 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a781e045-8498-4896-9209-30245eee7d34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:23.908485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a781e045-8498-4896-9209-30245eee7d34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:23.915230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a781e045-8498-4896-9209-30245eee7d34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:23.915665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a781e045-8498-4896-9209-30245eee7d34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:23.916412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a781e045-8498-4896-9209-30245eee7d34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:23.916834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a781e045-8498-4896-9209-30245eee7d34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:24.048570 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a781e045-8498-4896-9209-30245eee7d34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:24.057991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a781e045-8498-4896-9209-30245eee7d34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153923 Apr 11 20:12:24.058788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1479/2838] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:24.801706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-cda626ea-b4da-4d84-aa58-f348d212c035 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] HTTP exception thrown: Volume f0d76562-6d53-48a4-bae7-47e1f9d17114 could not be found. Apr 11 20:12:24.802310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cda626ea-b4da-4d84-aa58-f348d212c035 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Returning 404 to user: Volume f0d76562-6d53-48a4-bae7-47e1f9d17114 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:12:24.803146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cda626ea-b4da-4d84-aa58-f348d212c035 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/f0d76562-6d53-48a4-bae7-47e1f9d17114" status: 404 len: 109 microversion: 2.1 time: 15.659611 Apr 11 20:12:24.803700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1360/2839] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 20:12:09 2022] DELETE /compute/v2.1/os-volumes/f0d76562-6d53-48a4-bae7-47e1f9d17114 => generated 109 bytes in 15661 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 20:12:24.813005 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fbf8ad46-9669-4bd1-bf93-30ae4aa17733 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Calling method '.version_select at 0x7f4086dc34c0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:24.855829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53e4ad83-3014-45ef-8a56-b35d4d6bb44e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:24.856440 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53e4ad83-3014-45ef-8a56-b35d4d6bb44e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:24.862693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53e4ad83-3014-45ef-8a56-b35d4d6bb44e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:24.863144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53e4ad83-3014-45ef-8a56-b35d4d6bb44e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:24.863902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53e4ad83-3014-45ef-8a56-b35d4d6bb44e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:24.864336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53e4ad83-3014-45ef-8a56-b35d4d6bb44e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:24.993434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53e4ad83-3014-45ef-8a56-b35d4d6bb44e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:25.002484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53e4ad83-3014-45ef-8a56-b35d4d6bb44e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.152697 Apr 11 20:12:25.003093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1361/2840] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:24 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:25.079413 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0dab58ae-45b8-43b5-a99b-893a0b35fe27 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:25.080398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0dab58ae-45b8-43b5-a99b-893a0b35fe27 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:25.090336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dab58ae-45b8-43b5-a99b-893a0b35fe27 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:25.091073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dab58ae-45b8-43b5-a99b-893a0b35fe27 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:25.092315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dab58ae-45b8-43b5-a99b-893a0b35fe27 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:25.093074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dab58ae-45b8-43b5-a99b-893a0b35fe27 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:25.231658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0dab58ae-45b8-43b5-a99b-893a0b35fe27 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:25.239974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0dab58ae-45b8-43b5-a99b-893a0b35fe27 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.166925 Apr 11 20:12:25.240551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1362/2841] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:26.026040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb8a7a69-9570-440e-9abb-f3969b386bc9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:26.026696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb8a7a69-9570-440e-9abb-f3969b386bc9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:26.035348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb8a7a69-9570-440e-9abb-f3969b386bc9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:26.035890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb8a7a69-9570-440e-9abb-f3969b386bc9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:26.037081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb8a7a69-9570-440e-9abb-f3969b386bc9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:26.037715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb8a7a69-9570-440e-9abb-f3969b386bc9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:26.167663 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb8a7a69-9570-440e-9abb-f3969b386bc9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:26.176083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb8a7a69-9570-440e-9abb-f3969b386bc9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.155395 Apr 11 20:12:26.176653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1363/2842] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:26 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:26.261224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3a4816ee-42b1-4800-ad64-c065ec5f616a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:26.262109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3a4816ee-42b1-4800-ad64-c065ec5f616a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:26.272135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a4816ee-42b1-4800-ad64-c065ec5f616a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:26.272952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a4816ee-42b1-4800-ad64-c065ec5f616a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:26.274201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a4816ee-42b1-4800-ad64-c065ec5f616a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:26.274941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a4816ee-42b1-4800-ad64-c065ec5f616a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:26.409096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3a4816ee-42b1-4800-ad64-c065ec5f616a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:26.420870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3a4816ee-42b1-4800-ad64-c065ec5f616a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.165765 Apr 11 20:12:26.421635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1364/2843] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:12:27.193727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a363065c-4f97-4e45-baa3-cbc5ec6143e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:27.194305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a363065c-4f97-4e45-baa3-cbc5ec6143e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:27.201106 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a363065c-4f97-4e45-baa3-cbc5ec6143e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:27.201558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a363065c-4f97-4e45-baa3-cbc5ec6143e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:27.202319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a363065c-4f97-4e45-baa3-cbc5ec6143e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:27.202753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a363065c-4f97-4e45-baa3-cbc5ec6143e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:27.341862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a363065c-4f97-4e45-baa3-cbc5ec6143e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:27.354100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a363065c-4f97-4e45-baa3-cbc5ec6143e0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.164309 Apr 11 20:12:27.354842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1365/2844] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:27 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:27.442969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-210da43a-05c8-404e-8862-3919802b3989 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:27.443598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-210da43a-05c8-404e-8862-3919802b3989 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:27.449868 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-210da43a-05c8-404e-8862-3919802b3989 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:27.450410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-210da43a-05c8-404e-8862-3919802b3989 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:27.451162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-210da43a-05c8-404e-8862-3919802b3989 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:27.451592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-210da43a-05c8-404e-8862-3919802b3989 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:27.580101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-210da43a-05c8-404e-8862-3919802b3989 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:27.589050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-210da43a-05c8-404e-8862-3919802b3989 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.149824 Apr 11 20:12:27.589626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1366/2845] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:28.374937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d816c840-0b22-45d8-bd57-774a96b27d1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:28.375640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d816c840-0b22-45d8-bd57-774a96b27d1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:28.382569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d816c840-0b22-45d8-bd57-774a96b27d1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:28.383040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d816c840-0b22-45d8-bd57-774a96b27d1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:28.383832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d816c840-0b22-45d8-bd57-774a96b27d1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:28.384286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d816c840-0b22-45d8-bd57-774a96b27d1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:28.526031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d816c840-0b22-45d8-bd57-774a96b27d1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:28.534962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d816c840-0b22-45d8-bd57-774a96b27d1a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.165667 Apr 11 20:12:28.535533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1367/2846] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:28 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:28.610495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7abf9265-bdfc-457a-bb02-a08c5111a086 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:28.611536 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7abf9265-bdfc-457a-bb02-a08c5111a086 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:28.621775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7abf9265-bdfc-457a-bb02-a08c5111a086 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:28.622483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7abf9265-bdfc-457a-bb02-a08c5111a086 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:28.623686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7abf9265-bdfc-457a-bb02-a08c5111a086 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:28.624218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7abf9265-bdfc-457a-bb02-a08c5111a086 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:28.761638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7abf9265-bdfc-457a-bb02-a08c5111a086 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:28.770023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7abf9265-bdfc-457a-bb02-a08c5111a086 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.166341 Apr 11 20:12:28.770635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1368/2847] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:29.551683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed7c52ca-a377-4bbe-9b54-b0ae3c5ce07b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:29.552343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed7c52ca-a377-4bbe-9b54-b0ae3c5ce07b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:29.559018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed7c52ca-a377-4bbe-9b54-b0ae3c5ce07b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:29.559553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed7c52ca-a377-4bbe-9b54-b0ae3c5ce07b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:29.560304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed7c52ca-a377-4bbe-9b54-b0ae3c5ce07b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:29.560726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed7c52ca-a377-4bbe-9b54-b0ae3c5ce07b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:29.711863 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed7c52ca-a377-4bbe-9b54-b0ae3c5ce07b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:29.723829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed7c52ca-a377-4bbe-9b54-b0ae3c5ce07b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.175748 Apr 11 20:12:29.724680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1369/2848] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:29 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:29.786736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f5b80311-89ae-4eaa-8e53-4eac45230f22 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:29.787338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f5b80311-89ae-4eaa-8e53-4eac45230f22 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:29.793411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5b80311-89ae-4eaa-8e53-4eac45230f22 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:29.793900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5b80311-89ae-4eaa-8e53-4eac45230f22 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:29.794649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5b80311-89ae-4eaa-8e53-4eac45230f22 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:29.795105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5b80311-89ae-4eaa-8e53-4eac45230f22 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:29.948120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5b80311-89ae-4eaa-8e53-4eac45230f22 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:29.960046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f5b80311-89ae-4eaa-8e53-4eac45230f22 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.176760 Apr 11 20:12:29.960850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1370/2849] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:12:30.746728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f335e359-0172-4175-90f3-a3c52c67f98d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:30.747590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f335e359-0172-4175-90f3-a3c52c67f98d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:30.754650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f335e359-0172-4175-90f3-a3c52c67f98d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:30.755096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f335e359-0172-4175-90f3-a3c52c67f98d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:30.755849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f335e359-0172-4175-90f3-a3c52c67f98d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:30.756282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f335e359-0172-4175-90f3-a3c52c67f98d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:30.885769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f335e359-0172-4175-90f3-a3c52c67f98d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:30.897997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f335e359-0172-4175-90f3-a3c52c67f98d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.156947 Apr 11 20:12:30.898808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1371/2850] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:30 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:30.982545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0426976-6cef-4626-a64c-3d0d9ae07010 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:30.983594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0426976-6cef-4626-a64c-3d0d9ae07010 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:30.994346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0426976-6cef-4626-a64c-3d0d9ae07010 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:30.995519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0426976-6cef-4626-a64c-3d0d9ae07010 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:30.996927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0426976-6cef-4626-a64c-3d0d9ae07010 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:30.997364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0426976-6cef-4626-a64c-3d0d9ae07010 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:31.140396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0426976-6cef-4626-a64c-3d0d9ae07010 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:31.148513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0426976-6cef-4626-a64c-3d0d9ae07010 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.172312 Apr 11 20:12:31.149142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1372/2851] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:31.916741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f116f7e8-442f-4475-a42a-3ecc3c8f7d78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:31.917683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f116f7e8-442f-4475-a42a-3ecc3c8f7d78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:31.924476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f116f7e8-442f-4475-a42a-3ecc3c8f7d78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:31.924938 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f116f7e8-442f-4475-a42a-3ecc3c8f7d78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:31.925702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f116f7e8-442f-4475-a42a-3ecc3c8f7d78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:31.926133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f116f7e8-442f-4475-a42a-3ecc3c8f7d78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:32.074341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f116f7e8-442f-4475-a42a-3ecc3c8f7d78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:32.082670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f116f7e8-442f-4475-a42a-3ecc3c8f7d78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.169874 Apr 11 20:12:32.083248 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1373/2852] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:31 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:32.169636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5fcc90b6-18ac-4140-9792-3f9f4098d027 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:32.170737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5fcc90b6-18ac-4140-9792-3f9f4098d027 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:32.181161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fcc90b6-18ac-4140-9792-3f9f4098d027 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:32.181916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fcc90b6-18ac-4140-9792-3f9f4098d027 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:32.183160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fcc90b6-18ac-4140-9792-3f9f4098d027 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:32.183911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fcc90b6-18ac-4140-9792-3f9f4098d027 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:32.331826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5fcc90b6-18ac-4140-9792-3f9f4098d027 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:32.340143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5fcc90b6-18ac-4140-9792-3f9f4098d027 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.176964 Apr 11 20:12:32.340767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1374/2853] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:33.099796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7b66badc-1661-4404-a37e-9acbedb43d8a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:33.100437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7b66badc-1661-4404-a37e-9acbedb43d8a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:33.107189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b66badc-1661-4404-a37e-9acbedb43d8a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:33.107635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b66badc-1661-4404-a37e-9acbedb43d8a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:33.108384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b66badc-1661-4404-a37e-9acbedb43d8a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:33.108814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b66badc-1661-4404-a37e-9acbedb43d8a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:33.234047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7b66badc-1661-4404-a37e-9acbedb43d8a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:33.242378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7b66badc-1661-4404-a37e-9acbedb43d8a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.146491 Apr 11 20:12:33.242926 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1375/2854] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:33 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:33.361324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3abf9d60-b4c1-4bcc-9149-82257ca7bc85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:33.362185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3abf9d60-b4c1-4bcc-9149-82257ca7bc85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:33.372157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3abf9d60-b4c1-4bcc-9149-82257ca7bc85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:33.372929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3abf9d60-b4c1-4bcc-9149-82257ca7bc85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:33.374573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3abf9d60-b4c1-4bcc-9149-82257ca7bc85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:33.375279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3abf9d60-b4c1-4bcc-9149-82257ca7bc85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:33.509941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3abf9d60-b4c1-4bcc-9149-82257ca7bc85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:33.518722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3abf9d60-b4c1-4bcc-9149-82257ca7bc85 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.163880 Apr 11 20:12:33.519266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1376/2855] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:34.263643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c40b01ac-092a-42f4-abf1-0f109dc17770 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:34.264613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c40b01ac-092a-42f4-abf1-0f109dc17770 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:34.275110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c40b01ac-092a-42f4-abf1-0f109dc17770 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:34.275851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c40b01ac-092a-42f4-abf1-0f109dc17770 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:34.277233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c40b01ac-092a-42f4-abf1-0f109dc17770 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:34.278070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c40b01ac-092a-42f4-abf1-0f109dc17770 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:34.422627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c40b01ac-092a-42f4-abf1-0f109dc17770 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:34.431205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c40b01ac-092a-42f4-abf1-0f109dc17770 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.174142 Apr 11 20:12:34.431780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1377/2856] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:34 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:34.546807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-88021982-c10b-43e9-ba27-3e24bab179d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:34.547942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-88021982-c10b-43e9-ba27-3e24bab179d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:34.558510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88021982-c10b-43e9-ba27-3e24bab179d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:34.559330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88021982-c10b-43e9-ba27-3e24bab179d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:34.560153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88021982-c10b-43e9-ba27-3e24bab179d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:34.560729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88021982-c10b-43e9-ba27-3e24bab179d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:34.689449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-88021982-c10b-43e9-ba27-3e24bab179d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:34.699169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-88021982-c10b-43e9-ba27-3e24bab179d6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.158767 Apr 11 20:12:34.700030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1378/2857] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:35.452483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5cdf6c14-4e26-4047-98d8-043484235f64 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:35.453593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5cdf6c14-4e26-4047-98d8-043484235f64 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:35.463983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cdf6c14-4e26-4047-98d8-043484235f64 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:35.464712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cdf6c14-4e26-4047-98d8-043484235f64 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:35.466126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cdf6c14-4e26-4047-98d8-043484235f64 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:35.466559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cdf6c14-4e26-4047-98d8-043484235f64 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:35.599650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5cdf6c14-4e26-4047-98d8-043484235f64 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:35.609934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5cdf6c14-4e26-4047-98d8-043484235f64 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.163876 Apr 11 20:12:35.610477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1379/2858] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:35 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:35.719519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c861b1c8-0dbf-4812-9764-46331355e214 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:35.720381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c861b1c8-0dbf-4812-9764-46331355e214 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:35.728879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c861b1c8-0dbf-4812-9764-46331355e214 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:35.729528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c861b1c8-0dbf-4812-9764-46331355e214 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:35.730566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c861b1c8-0dbf-4812-9764-46331355e214 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:35.731070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c861b1c8-0dbf-4812-9764-46331355e214 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:35.869408 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c861b1c8-0dbf-4812-9764-46331355e214 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:35.878328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c861b1c8-0dbf-4812-9764-46331355e214 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.164912 Apr 11 20:12:35.878904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1380/2859] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:12:36.632087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d24fc689-e850-4253-b0d1-b03269fa1c67 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:36.633139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d24fc689-e850-4253-b0d1-b03269fa1c67 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:36.643659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d24fc689-e850-4253-b0d1-b03269fa1c67 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:36.644405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d24fc689-e850-4253-b0d1-b03269fa1c67 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:36.645812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d24fc689-e850-4253-b0d1-b03269fa1c67 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:36.646528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d24fc689-e850-4253-b0d1-b03269fa1c67 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:36.782447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d24fc689-e850-4253-b0d1-b03269fa1c67 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:36.793799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d24fc689-e850-4253-b0d1-b03269fa1c67 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.168245 Apr 11 20:12:36.794584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1381/2860] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:36 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:36.899478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8f26077-cb49-44b3-9c4e-b6b4c641c6e1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:36.900365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8f26077-cb49-44b3-9c4e-b6b4c641c6e1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:36.907920 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8f26077-cb49-44b3-9c4e-b6b4c641c6e1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:36.908367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8f26077-cb49-44b3-9c4e-b6b4c641c6e1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:36.909230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8f26077-cb49-44b3-9c4e-b6b4c641c6e1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:36.909667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8f26077-cb49-44b3-9c4e-b6b4c641c6e1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:37.043115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8f26077-cb49-44b3-9c4e-b6b4c641c6e1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:37.051191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8f26077-cb49-44b3-9c4e-b6b4c641c6e1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.158122 Apr 11 20:12:37.051770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1382/2861] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:37.819168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6c96da55-23e5-4c98-947f-87f6bf3e905d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:37.820230 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6c96da55-23e5-4c98-947f-87f6bf3e905d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:37.831297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c96da55-23e5-4c98-947f-87f6bf3e905d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:37.831872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c96da55-23e5-4c98-947f-87f6bf3e905d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:37.832874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c96da55-23e5-4c98-947f-87f6bf3e905d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:37.833325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c96da55-23e5-4c98-947f-87f6bf3e905d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:37.967568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6c96da55-23e5-4c98-947f-87f6bf3e905d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:37.975953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6c96da55-23e5-4c98-947f-87f6bf3e905d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.163335 Apr 11 20:12:37.976500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1383/2862] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:37 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:38.071636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5f2dc85-d9bb-49c7-8f0e-f41475defc4f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:38.072521 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5f2dc85-d9bb-49c7-8f0e-f41475defc4f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:38.079869 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5f2dc85-d9bb-49c7-8f0e-f41475defc4f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:38.080341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5f2dc85-d9bb-49c7-8f0e-f41475defc4f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:38.081128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5f2dc85-d9bb-49c7-8f0e-f41475defc4f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:38.081551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5f2dc85-d9bb-49c7-8f0e-f41475defc4f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:38.211545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5f2dc85-d9bb-49c7-8f0e-f41475defc4f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:38.219991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5f2dc85-d9bb-49c7-8f0e-f41475defc4f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154981 Apr 11 20:12:38.220544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1384/2863] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:38.998829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d333118b-d4ae-4768-a93d-4e346d5764df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:38.999691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d333118b-d4ae-4768-a93d-4e346d5764df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:39.007952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d333118b-d4ae-4768-a93d-4e346d5764df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:39.008509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d333118b-d4ae-4768-a93d-4e346d5764df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:39.009514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d333118b-d4ae-4768-a93d-4e346d5764df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:39.010051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d333118b-d4ae-4768-a93d-4e346d5764df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:39.142026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d333118b-d4ae-4768-a93d-4e346d5764df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:39.150615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d333118b-d4ae-4768-a93d-4e346d5764df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.158487 Apr 11 20:12:39.151161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1385/2864] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:38 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:39.240893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0e46546-a026-4739-8e5a-4ff8b0420fa4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:39.242074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0e46546-a026-4739-8e5a-4ff8b0420fa4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:39.252511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0e46546-a026-4739-8e5a-4ff8b0420fa4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:39.253222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0e46546-a026-4739-8e5a-4ff8b0420fa4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:39.254411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0e46546-a026-4739-8e5a-4ff8b0420fa4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:39.255173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0e46546-a026-4739-8e5a-4ff8b0420fa4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:39.389003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0e46546-a026-4739-8e5a-4ff8b0420fa4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:39.397549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0e46546-a026-4739-8e5a-4ff8b0420fa4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.162965 Apr 11 20:12:39.398124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1386/2865] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:40.171451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-99d3081a-b79f-4144-b8bc-90072ee732d7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:40.172296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-99d3081a-b79f-4144-b8bc-90072ee732d7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:40.179861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99d3081a-b79f-4144-b8bc-90072ee732d7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:40.180379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99d3081a-b79f-4144-b8bc-90072ee732d7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:40.181307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99d3081a-b79f-4144-b8bc-90072ee732d7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:40.181807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99d3081a-b79f-4144-b8bc-90072ee732d7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:40.315881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-99d3081a-b79f-4144-b8bc-90072ee732d7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:40.324246 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-99d3081a-b79f-4144-b8bc-90072ee732d7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.158463 Apr 11 20:12:40.324829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1387/2866] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:40 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:40.418210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e0cbc396-ff17-41a9-b3cd-3f0bb1530002 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:40.419200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e0cbc396-ff17-41a9-b3cd-3f0bb1530002 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:40.429168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0cbc396-ff17-41a9-b3cd-3f0bb1530002 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:40.429906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0cbc396-ff17-41a9-b3cd-3f0bb1530002 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:40.431132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0cbc396-ff17-41a9-b3cd-3f0bb1530002 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:40.431834 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0cbc396-ff17-41a9-b3cd-3f0bb1530002 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:40.561059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e0cbc396-ff17-41a9-b3cd-3f0bb1530002 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:40.569459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e0cbc396-ff17-41a9-b3cd-3f0bb1530002 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.157565 Apr 11 20:12:40.570006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1388/2867] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:41.345738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a47e60f0-f8b2-4b06-9b81-8e3f90c4f980 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:41.347793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a47e60f0-f8b2-4b06-9b81-8e3f90c4f980 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:41.358428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a47e60f0-f8b2-4b06-9b81-8e3f90c4f980 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:41.359171 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a47e60f0-f8b2-4b06-9b81-8e3f90c4f980 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:41.360421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a47e60f0-f8b2-4b06-9b81-8e3f90c4f980 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:41.361185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a47e60f0-f8b2-4b06-9b81-8e3f90c4f980 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:41.500893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a47e60f0-f8b2-4b06-9b81-8e3f90c4f980 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:41.512940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a47e60f0-f8b2-4b06-9b81-8e3f90c4f980 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.173497 Apr 11 20:12:41.513545 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1389/2868] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:41 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:41.590037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0a4dd64-a802-4a31-bef6-4ad9c6413e63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:41.591084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0a4dd64-a802-4a31-bef6-4ad9c6413e63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:41.601206 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0a4dd64-a802-4a31-bef6-4ad9c6413e63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:41.601946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0a4dd64-a802-4a31-bef6-4ad9c6413e63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:41.603191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0a4dd64-a802-4a31-bef6-4ad9c6413e63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:41.603905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0a4dd64-a802-4a31-bef6-4ad9c6413e63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:41.737627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0a4dd64-a802-4a31-bef6-4ad9c6413e63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:41.746315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0a4dd64-a802-4a31-bef6-4ad9c6413e63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.162502 Apr 11 20:12:41.746892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1390/2869] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:42.534684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d38a513f-6195-4797-90ea-6944822112f9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:42.535730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d38a513f-6195-4797-90ea-6944822112f9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:42.545598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d38a513f-6195-4797-90ea-6944822112f9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:42.546047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d38a513f-6195-4797-90ea-6944822112f9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:42.546807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d38a513f-6195-4797-90ea-6944822112f9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:42.547240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d38a513f-6195-4797-90ea-6944822112f9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:42.681379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d38a513f-6195-4797-90ea-6944822112f9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:42.692093 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d38a513f-6195-4797-90ea-6944822112f9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.164088 Apr 11 20:12:42.692952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1391/2870] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:42 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:42.767285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-83f2ab85-d8b9-43b0-99cb-112de9f5aba6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:42.768284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-83f2ab85-d8b9-43b0-99cb-112de9f5aba6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:42.778293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83f2ab85-d8b9-43b0-99cb-112de9f5aba6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:42.778883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83f2ab85-d8b9-43b0-99cb-112de9f5aba6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:42.779631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83f2ab85-d8b9-43b0-99cb-112de9f5aba6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:42.780054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83f2ab85-d8b9-43b0-99cb-112de9f5aba6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:42.907798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-83f2ab85-d8b9-43b0-99cb-112de9f5aba6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:42.917343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-83f2ab85-d8b9-43b0-99cb-112de9f5aba6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.156352 Apr 11 20:12:42.917920 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1392/2871] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:43.710499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cc678aa6-c328-41d6-8208-cf0b3d7d2e41 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:43.711282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc678aa6-c328-41d6-8208-cf0b3d7d2e41 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:43.718388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc678aa6-c328-41d6-8208-cf0b3d7d2e41 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:43.718941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc678aa6-c328-41d6-8208-cf0b3d7d2e41 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:43.719596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc678aa6-c328-41d6-8208-cf0b3d7d2e41 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:43.720025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc678aa6-c328-41d6-8208-cf0b3d7d2e41 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:43.861160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc678aa6-c328-41d6-8208-cf0b3d7d2e41 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:43.873930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cc678aa6-c328-41d6-8208-cf0b3d7d2e41 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.167145 Apr 11 20:12:43.874729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1393/2872] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:43 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:43.934914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-247cffee-593c-45e0-9a73-aea0fec201e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:43.935530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-247cffee-593c-45e0-9a73-aea0fec201e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:43.942137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-247cffee-593c-45e0-9a73-aea0fec201e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:43.942609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-247cffee-593c-45e0-9a73-aea0fec201e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:43.943386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-247cffee-593c-45e0-9a73-aea0fec201e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:43.943823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-247cffee-593c-45e0-9a73-aea0fec201e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:44.090968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-247cffee-593c-45e0-9a73-aea0fec201e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:44.101383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-247cffee-593c-45e0-9a73-aea0fec201e6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.169959 Apr 11 20:12:44.102154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1394/2873] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:44.895808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19606e5e-8ba7-4e8a-ab3f-e22866480c74 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:44.896972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19606e5e-8ba7-4e8a-ab3f-e22866480c74 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:44.906227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19606e5e-8ba7-4e8a-ab3f-e22866480c74 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:44.906613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19606e5e-8ba7-4e8a-ab3f-e22866480c74 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:44.907367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19606e5e-8ba7-4e8a-ab3f-e22866480c74 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:44.907799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19606e5e-8ba7-4e8a-ab3f-e22866480c74 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:45.051061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19606e5e-8ba7-4e8a-ab3f-e22866480c74 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:45.061951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19606e5e-8ba7-4e8a-ab3f-e22866480c74 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.172788 Apr 11 20:12:45.062511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1395/2874] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:44 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:45.120480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-86f6cc01-c1a8-48ed-9db3-a5f86b98ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:45.121119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-86f6cc01-c1a8-48ed-9db3-a5f86b98ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:45.127728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86f6cc01-c1a8-48ed-9db3-a5f86b98ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:45.128170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86f6cc01-c1a8-48ed-9db3-a5f86b98ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:45.128945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86f6cc01-c1a8-48ed-9db3-a5f86b98ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:45.129406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86f6cc01-c1a8-48ed-9db3-a5f86b98ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:45.262427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-86f6cc01-c1a8-48ed-9db3-a5f86b98ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:45.270415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-86f6cc01-c1a8-48ed-9db3-a5f86b98ca74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153843 Apr 11 20:12:45.270993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1396/2875] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:46.080514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-01376ffa-8fe2-40b6-92f1-634de1f4965f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:46.081479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-01376ffa-8fe2-40b6-92f1-634de1f4965f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:46.089665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01376ffa-8fe2-40b6-92f1-634de1f4965f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:46.090221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01376ffa-8fe2-40b6-92f1-634de1f4965f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:46.092816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01376ffa-8fe2-40b6-92f1-634de1f4965f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:46.093438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01376ffa-8fe2-40b6-92f1-634de1f4965f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:46.228592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01376ffa-8fe2-40b6-92f1-634de1f4965f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:46.237024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-01376ffa-8fe2-40b6-92f1-634de1f4965f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.161721 Apr 11 20:12:46.237564 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1397/2876] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:46 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:46.287275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00c555a3-b130-40ba-9ca9-d931b7d0521b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:46.287867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00c555a3-b130-40ba-9ca9-d931b7d0521b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:46.294176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00c555a3-b130-40ba-9ca9-d931b7d0521b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:46.294610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00c555a3-b130-40ba-9ca9-d931b7d0521b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:46.295355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00c555a3-b130-40ba-9ca9-d931b7d0521b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:46.295779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00c555a3-b130-40ba-9ca9-d931b7d0521b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:46.429212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00c555a3-b130-40ba-9ca9-d931b7d0521b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:46.437551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00c555a3-b130-40ba-9ca9-d931b7d0521b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153855 Apr 11 20:12:46.438101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1398/2877] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:47.258817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a950384e-4a03-48ed-b979-414902b7c25a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:47.259839 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a950384e-4a03-48ed-b979-414902b7c25a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:47.270333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a950384e-4a03-48ed-b979-414902b7c25a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:47.271077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a950384e-4a03-48ed-b979-414902b7c25a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:47.272321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a950384e-4a03-48ed-b979-414902b7c25a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:47.273095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a950384e-4a03-48ed-b979-414902b7c25a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:47.407965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a950384e-4a03-48ed-b979-414902b7c25a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:47.416590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a950384e-4a03-48ed-b979-414902b7c25a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.164315 Apr 11 20:12:47.417203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1399/2878] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:47 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:47.455193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d8501d1-5c7d-45f5-8163-38e04b5df005 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:47.455789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d8501d1-5c7d-45f5-8163-38e04b5df005 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:47.461991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d8501d1-5c7d-45f5-8163-38e04b5df005 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:47.462475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d8501d1-5c7d-45f5-8163-38e04b5df005 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:47.463233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d8501d1-5c7d-45f5-8163-38e04b5df005 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:47.463664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d8501d1-5c7d-45f5-8163-38e04b5df005 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:47.597185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d8501d1-5c7d-45f5-8163-38e04b5df005 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:47.605704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d8501d1-5c7d-45f5-8163-38e04b5df005 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154078 Apr 11 20:12:47.606353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1400/2879] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:48.437979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-862f5ff7-d495-4744-a53b-2523254dce31 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:48.439173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-862f5ff7-d495-4744-a53b-2523254dce31 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:48.449894 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-862f5ff7-d495-4744-a53b-2523254dce31 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:48.450496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-862f5ff7-d495-4744-a53b-2523254dce31 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:48.451262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-862f5ff7-d495-4744-a53b-2523254dce31 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:48.451698 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-862f5ff7-d495-4744-a53b-2523254dce31 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:48.599742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-862f5ff7-d495-4744-a53b-2523254dce31 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:48.607835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-862f5ff7-d495-4744-a53b-2523254dce31 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.176330 Apr 11 20:12:48.608386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1401/2880] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:48 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:48.622754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f863c4d6-38c6-445b-900c-75250f370d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:48.623673 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f863c4d6-38c6-445b-900c-75250f370d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:48.630262 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f863c4d6-38c6-445b-900c-75250f370d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:48.630700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f863c4d6-38c6-445b-900c-75250f370d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:48.631450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f863c4d6-38c6-445b-900c-75250f370d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:48.631882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f863c4d6-38c6-445b-900c-75250f370d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:48.762297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f863c4d6-38c6-445b-900c-75250f370d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:48.770465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f863c4d6-38c6-445b-900c-75250f370d36 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.151338 Apr 11 20:12:48.771013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1402/2881] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:12:49.627879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ccfadc20-ffe5-425e-8420-88fae8a7dc2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:49.628986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ccfadc20-ffe5-425e-8420-88fae8a7dc2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:49.638694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ccfadc20-ffe5-425e-8420-88fae8a7dc2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:49.639403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ccfadc20-ffe5-425e-8420-88fae8a7dc2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:49.640515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ccfadc20-ffe5-425e-8420-88fae8a7dc2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:49.641226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ccfadc20-ffe5-425e-8420-88fae8a7dc2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:49.794109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ccfadc20-ffe5-425e-8420-88fae8a7dc2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:49.802546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ccfadc20-ffe5-425e-8420-88fae8a7dc2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.181033 Apr 11 20:12:49.803120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1403/2882] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:49 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:49.807472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5104561b-5270-453f-8552-b3da93b519ab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:49.808079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5104561b-5270-453f-8552-b3da93b519ab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:49.813650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5104561b-5270-453f-8552-b3da93b519ab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:49.814101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5104561b-5270-453f-8552-b3da93b519ab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:49.814947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5104561b-5270-453f-8552-b3da93b519ab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:49.815378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5104561b-5270-453f-8552-b3da93b519ab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:49.946754 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5104561b-5270-453f-8552-b3da93b519ab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:49.956403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5104561b-5270-453f-8552-b3da93b519ab tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.152349 Apr 11 20:12:49.956976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1404/2883] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:50.824142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-345a76b0-4285-41d6-a59e-5612d676fdfd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:50.825594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-345a76b0-4285-41d6-a59e-5612d676fdfd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:50.835835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-345a76b0-4285-41d6-a59e-5612d676fdfd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:50.836571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-345a76b0-4285-41d6-a59e-5612d676fdfd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:50.837945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-345a76b0-4285-41d6-a59e-5612d676fdfd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:50.838664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-345a76b0-4285-41d6-a59e-5612d676fdfd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:50.982017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-345a76b0-4285-41d6-a59e-5612d676fdfd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:50.990712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-345a76b0-4285-41d6-a59e-5612d676fdfd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.173415 Apr 11 20:12:50.991288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1405/2884] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:50 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:50.995752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d60e8f63-9f3e-4ab6-8998-8d75540aa632 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:50.996355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d60e8f63-9f3e-4ab6-8998-8d75540aa632 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:51.002327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d60e8f63-9f3e-4ab6-8998-8d75540aa632 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:51.002771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d60e8f63-9f3e-4ab6-8998-8d75540aa632 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:51.003527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d60e8f63-9f3e-4ab6-8998-8d75540aa632 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:51.003958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d60e8f63-9f3e-4ab6-8998-8d75540aa632 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:51.146764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d60e8f63-9f3e-4ab6-8998-8d75540aa632 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:51.155098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d60e8f63-9f3e-4ab6-8998-8d75540aa632 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.162873 Apr 11 20:12:51.155683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1406/2885] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:52.007748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b9f8043f-e6c8-4692-bd1a-6f07325ea325 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:52.008448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b9f8043f-e6c8-4692-bd1a-6f07325ea325 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:52.014800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9f8043f-e6c8-4692-bd1a-6f07325ea325 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:52.015243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9f8043f-e6c8-4692-bd1a-6f07325ea325 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:52.015991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9f8043f-e6c8-4692-bd1a-6f07325ea325 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:52.016401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9f8043f-e6c8-4692-bd1a-6f07325ea325 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:52.149462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b9f8043f-e6c8-4692-bd1a-6f07325ea325 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:52.161034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9f8043f-e6c8-4692-bd1a-6f07325ea325 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.156897 Apr 11 20:12:52.161918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1407/2886] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:52 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:52.171080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82407f39-ece5-47f5-8831-1276f2b3869d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:52.171727 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82407f39-ece5-47f5-8831-1276f2b3869d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:52.177931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82407f39-ece5-47f5-8831-1276f2b3869d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:52.178375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82407f39-ece5-47f5-8831-1276f2b3869d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:52.179129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82407f39-ece5-47f5-8831-1276f2b3869d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:52.179579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82407f39-ece5-47f5-8831-1276f2b3869d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:52.313418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82407f39-ece5-47f5-8831-1276f2b3869d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:52.321588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82407f39-ece5-47f5-8831-1276f2b3869d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154029 Apr 11 20:12:52.322165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1408/2887] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:12:53.180135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81e38e23-48f6-4455-8b1e-33022effba38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:53.180867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81e38e23-48f6-4455-8b1e-33022effba38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:53.188343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81e38e23-48f6-4455-8b1e-33022effba38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:53.188779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81e38e23-48f6-4455-8b1e-33022effba38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:53.190162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81e38e23-48f6-4455-8b1e-33022effba38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:53.190162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81e38e23-48f6-4455-8b1e-33022effba38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:53.323620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-81e38e23-48f6-4455-8b1e-33022effba38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:53.335705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81e38e23-48f6-4455-8b1e-33022effba38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.160095 Apr 11 20:12:53.336524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1409/2888] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:53 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:53.341007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-205ee762-4c02-4778-b526-e33ffe219c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:53.341601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-205ee762-4c02-4778-b526-e33ffe219c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:53.347509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-205ee762-4c02-4778-b526-e33ffe219c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:53.347948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-205ee762-4c02-4778-b526-e33ffe219c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:53.348695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-205ee762-4c02-4778-b526-e33ffe219c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:53.349165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-205ee762-4c02-4778-b526-e33ffe219c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:53.479101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-205ee762-4c02-4778-b526-e33ffe219c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:53.487683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-205ee762-4c02-4778-b526-e33ffe219c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.150174 Apr 11 20:12:53.488249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1410/2889] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:54.357350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-690e4474-3da4-4ced-b398-b3957ec31719 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:54.358214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-690e4474-3da4-4ced-b398-b3957ec31719 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:54.366141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-690e4474-3da4-4ced-b398-b3957ec31719 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:54.366694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-690e4474-3da4-4ced-b398-b3957ec31719 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:54.367619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-690e4474-3da4-4ced-b398-b3957ec31719 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:54.368150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-690e4474-3da4-4ced-b398-b3957ec31719 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:54.510256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-690e4474-3da4-4ced-b398-b3957ec31719 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:54.518258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-690e4474-3da4-4ced-b398-b3957ec31719 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.167469 Apr 11 20:12:54.518826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1411/2890] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:54 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:54.523368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65d28dab-161d-439e-87ff-097563ad5b56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:54.523961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65d28dab-161d-439e-87ff-097563ad5b56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:54.530136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65d28dab-161d-439e-87ff-097563ad5b56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:54.530594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65d28dab-161d-439e-87ff-097563ad5b56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:54.531316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65d28dab-161d-439e-87ff-097563ad5b56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:54.531739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65d28dab-161d-439e-87ff-097563ad5b56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:54.664321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65d28dab-161d-439e-87ff-097563ad5b56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:54.676092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65d28dab-161d-439e-87ff-097563ad5b56 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.156017 Apr 11 20:12:54.676794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1412/2891] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:55.539657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f5a75a55-acc3-4171-b95a-b807c95f31f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:55.540709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f5a75a55-acc3-4171-b95a-b807c95f31f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:55.551177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5a75a55-acc3-4171-b95a-b807c95f31f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:55.551931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5a75a55-acc3-4171-b95a-b807c95f31f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:55.553229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5a75a55-acc3-4171-b95a-b807c95f31f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:55.553949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5a75a55-acc3-4171-b95a-b807c95f31f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:55.691687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5a75a55-acc3-4171-b95a-b807c95f31f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:55.702334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f5a75a55-acc3-4171-b95a-b807c95f31f0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.168856 Apr 11 20:12:55.703287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1413/2892] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:55 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:55.707902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1996c273-10ec-453c-af38-08148c673946 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:55.708511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1996c273-10ec-453c-af38-08148c673946 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:55.715950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1996c273-10ec-453c-af38-08148c673946 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:55.716547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1996c273-10ec-453c-af38-08148c673946 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:55.717344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1996c273-10ec-453c-af38-08148c673946 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:55.717783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1996c273-10ec-453c-af38-08148c673946 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:55.848962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1996c273-10ec-453c-af38-08148c673946 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:55.857022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1996c273-10ec-453c-af38-08148c673946 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.152627 Apr 11 20:12:55.857572 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1414/2893] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:56.723843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e88fd59-ac32-40ed-805f-60a001fb629e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:56.724951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e88fd59-ac32-40ed-805f-60a001fb629e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:56.734503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e88fd59-ac32-40ed-805f-60a001fb629e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:56.734946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e88fd59-ac32-40ed-805f-60a001fb629e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:56.735989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e88fd59-ac32-40ed-805f-60a001fb629e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:56.736411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e88fd59-ac32-40ed-805f-60a001fb629e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:56.871567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e88fd59-ac32-40ed-805f-60a001fb629e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:56.880160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e88fd59-ac32-40ed-805f-60a001fb629e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.162824 Apr 11 20:12:56.880768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1415/2894] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:56 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:56.885223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6fc03f44-1088-4805-84a2-2caecbc1793a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:56.885853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6fc03f44-1088-4805-84a2-2caecbc1793a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:56.891710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc03f44-1088-4805-84a2-2caecbc1793a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:56.892154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc03f44-1088-4805-84a2-2caecbc1793a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:56.892936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc03f44-1088-4805-84a2-2caecbc1793a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:56.893353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fc03f44-1088-4805-84a2-2caecbc1793a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:57.026212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6fc03f44-1088-4805-84a2-2caecbc1793a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:57.035013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6fc03f44-1088-4805-84a2-2caecbc1793a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153290 Apr 11 20:12:57.035585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1416/2895] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:57.812965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fda44b87-5835-41ad-9e74-cadef5b85c93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:57.813568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fda44b87-5835-41ad-9e74-cadef5b85c93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:57.820382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fda44b87-5835-41ad-9e74-cadef5b85c93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:57.820824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fda44b87-5835-41ad-9e74-cadef5b85c93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:57.821681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fda44b87-5835-41ad-9e74-cadef5b85c93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:57.822116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fda44b87-5835-41ad-9e74-cadef5b85c93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:57.846175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fda44b87-5835-41ad-9e74-cadef5b85c93 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b/ips" status: 200 len: 150 microversion: 2.20 time: 0.037273 Apr 11 20:12:57.846742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1417/2896] 10.222.0.62 () {60 vars in 1288 bytes} [Mon Apr 11 20:12:57 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 20:12:57.896492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-472af706-4b15-45d8-81d1-56f61b68f0ad tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:57.897121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-472af706-4b15-45d8-81d1-56f61b68f0ad tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:57.903705 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-472af706-4b15-45d8-81d1-56f61b68f0ad tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:57.904147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-472af706-4b15-45d8-81d1-56f61b68f0ad tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:57.904944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-472af706-4b15-45d8-81d1-56f61b68f0ad tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:57.905386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-472af706-4b15-45d8-81d1-56f61b68f0ad tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:58.038176 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-472af706-4b15-45d8-81d1-56f61b68f0ad tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:58.046645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-472af706-4b15-45d8-81d1-56f61b68f0ad tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.153804 Apr 11 20:12:58.047225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1418/2897] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:57 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:58.051634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8939e7c5-70f9-4ddc-b64e-34789607ff31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:58.052229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8939e7c5-70f9-4ddc-b64e-34789607ff31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:58.058110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8939e7c5-70f9-4ddc-b64e-34789607ff31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:58.058552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8939e7c5-70f9-4ddc-b64e-34789607ff31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:58.059298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8939e7c5-70f9-4ddc-b64e-34789607ff31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:58.059728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8939e7c5-70f9-4ddc-b64e-34789607ff31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:58.201227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8939e7c5-70f9-4ddc-b64e-34789607ff31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:58.209581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8939e7c5-70f9-4ddc-b64e-34789607ff31 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.161417 Apr 11 20:12:58.210161 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1419/2898] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:59.063956 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b19547c5-ff03-498f-8acc-2822fb04a5fc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:59.064543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b19547c5-ff03-498f-8acc-2822fb04a5fc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:59.071295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b19547c5-ff03-498f-8acc-2822fb04a5fc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:59.071735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b19547c5-ff03-498f-8acc-2822fb04a5fc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:59.072486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b19547c5-ff03-498f-8acc-2822fb04a5fc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:59.072929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b19547c5-ff03-498f-8acc-2822fb04a5fc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:59.209819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b19547c5-ff03-498f-8acc-2822fb04a5fc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:59.218518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b19547c5-ff03-498f-8acc-2822fb04a5fc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.158586 Apr 11 20:12:59.219116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1420/2899] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:59 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:12:59.226600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e00494a5-c08d-4f0e-afc9-d1b5a4e9ab8b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:12:59.227233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e00494a5-c08d-4f0e-afc9-d1b5a4e9ab8b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:12:59.235717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e00494a5-c08d-4f0e-afc9-d1b5a4e9ab8b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:59.236532 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e00494a5-c08d-4f0e-afc9-d1b5a4e9ab8b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:59.237506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e00494a5-c08d-4f0e-afc9-d1b5a4e9ab8b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:12:59.238119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e00494a5-c08d-4f0e-afc9-d1b5a4e9ab8b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:12:59.375706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e00494a5-c08d-4f0e-afc9-d1b5a4e9ab8b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:12:59.384349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e00494a5-c08d-4f0e-afc9-d1b5a4e9ab8b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.161390 Apr 11 20:12:59.384931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1421/2900] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:12:59 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:00.236182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9f55bee1-05cc-4a45-b75d-cabad1afa54d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:00.236816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9f55bee1-05cc-4a45-b75d-cabad1afa54d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:00.243865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f55bee1-05cc-4a45-b75d-cabad1afa54d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:00.244310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f55bee1-05cc-4a45-b75d-cabad1afa54d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:00.245094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f55bee1-05cc-4a45-b75d-cabad1afa54d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:00.245518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f55bee1-05cc-4a45-b75d-cabad1afa54d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:00.386934 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9f55bee1-05cc-4a45-b75d-cabad1afa54d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:00.395220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9f55bee1-05cc-4a45-b75d-cabad1afa54d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.163020 Apr 11 20:13:00.396112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1422/2901] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:00 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:00.400306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dad88b4b-5c89-4fd5-a90a-06a0c3419a26 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:00.400935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dad88b4b-5c89-4fd5-a90a-06a0c3419a26 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:00.406805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dad88b4b-5c89-4fd5-a90a-06a0c3419a26 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:00.407252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dad88b4b-5c89-4fd5-a90a-06a0c3419a26 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:00.408010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dad88b4b-5c89-4fd5-a90a-06a0c3419a26 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:00.408441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dad88b4b-5c89-4fd5-a90a-06a0c3419a26 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:00.544320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dad88b4b-5c89-4fd5-a90a-06a0c3419a26 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:00.552940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dad88b4b-5c89-4fd5-a90a-06a0c3419a26 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.156045 Apr 11 20:13:00.553546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1423/2902] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:01.411857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0727176a-7c9e-4591-bf97-e38e7759dde8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:01.412525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0727176a-7c9e-4591-bf97-e38e7759dde8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:01.419311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0727176a-7c9e-4591-bf97-e38e7759dde8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:01.419755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0727176a-7c9e-4591-bf97-e38e7759dde8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:01.420557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0727176a-7c9e-4591-bf97-e38e7759dde8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:01.421017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0727176a-7c9e-4591-bf97-e38e7759dde8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:01.551422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0727176a-7c9e-4591-bf97-e38e7759dde8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:01.559384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0727176a-7c9e-4591-bf97-e38e7759dde8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.151577 Apr 11 20:13:01.559954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1424/2903] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:01 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:13:01.569495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5404522-7f45-4668-b30a-b8bedb3f3a1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:01.570102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5404522-7f45-4668-b30a-b8bedb3f3a1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:01.576004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5404522-7f45-4668-b30a-b8bedb3f3a1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:01.576444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5404522-7f45-4668-b30a-b8bedb3f3a1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:01.577224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5404522-7f45-4668-b30a-b8bedb3f3a1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:01.577649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5404522-7f45-4668-b30a-b8bedb3f3a1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:01.702238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5404522-7f45-4668-b30a-b8bedb3f3a1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:01.710326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5404522-7f45-4668-b30a-b8bedb3f3a1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.144567 Apr 11 20:13:01.710915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1425/2904] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:13:02.576795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-11c6e285-1f91-424f-93c6-7567c4844e09 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:02.577559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-11c6e285-1f91-424f-93c6-7567c4844e09 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:02.584160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11c6e285-1f91-424f-93c6-7567c4844e09 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:02.584604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11c6e285-1f91-424f-93c6-7567c4844e09 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:02.585396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11c6e285-1f91-424f-93c6-7567c4844e09 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:02.585819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11c6e285-1f91-424f-93c6-7567c4844e09 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:02.726803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11c6e285-1f91-424f-93c6-7567c4844e09 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:02.735069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-11c6e285-1f91-424f-93c6-7567c4844e09 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.162298 Apr 11 20:13:02.735630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1426/2905] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:02 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:02.740037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-21ccfa5a-1074-4f81-96e1-d602a2ff2067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:02.740632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-21ccfa5a-1074-4f81-96e1-d602a2ff2067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:02.746479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21ccfa5a-1074-4f81-96e1-d602a2ff2067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:02.746917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21ccfa5a-1074-4f81-96e1-d602a2ff2067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:02.747659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21ccfa5a-1074-4f81-96e1-d602a2ff2067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:02.748529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21ccfa5a-1074-4f81-96e1-d602a2ff2067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:02.885445 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21ccfa5a-1074-4f81-96e1-d602a2ff2067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:02.893405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-21ccfa5a-1074-4f81-96e1-d602a2ff2067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.156873 Apr 11 20:13:02.894012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1427/2906] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:03.515499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:13:03.515874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:13:03.757514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-868a4a2d-4061-491e-85ad-d6b5baf7bf35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:03.758688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-868a4a2d-4061-491e-85ad-d6b5baf7bf35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:03.769701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-868a4a2d-4061-491e-85ad-d6b5baf7bf35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:03.770366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-868a4a2d-4061-491e-85ad-d6b5baf7bf35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:03.771608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-868a4a2d-4061-491e-85ad-d6b5baf7bf35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:03.772321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-868a4a2d-4061-491e-85ad-d6b5baf7bf35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:03.918218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-868a4a2d-4061-491e-85ad-d6b5baf7bf35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:03.926651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-868a4a2d-4061-491e-85ad-d6b5baf7bf35 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.176172 Apr 11 20:13:03.927253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1428/2907] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:03 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:03.931807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1273f584-a3fb-4f83-b8ff-799c74afb11c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:03.932412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1273f584-a3fb-4f83-b8ff-799c74afb11c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:03.938299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1273f584-a3fb-4f83-b8ff-799c74afb11c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:03.938764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1273f584-a3fb-4f83-b8ff-799c74afb11c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:03.939516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1273f584-a3fb-4f83-b8ff-799c74afb11c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:03.939953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1273f584-a3fb-4f83-b8ff-799c74afb11c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:04.077278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1273f584-a3fb-4f83-b8ff-799c74afb11c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:04.085896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1273f584-a3fb-4f83-b8ff-799c74afb11c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.157701 Apr 11 20:13:04.086449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1429/2908] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:04.948133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1234fe63-e963-4ff8-a82e-c7408f7ddc9f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:04.949283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1234fe63-e963-4ff8-a82e-c7408f7ddc9f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:04.956918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1234fe63-e963-4ff8-a82e-c7408f7ddc9f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:04.957399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1234fe63-e963-4ff8-a82e-c7408f7ddc9f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:04.958197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1234fe63-e963-4ff8-a82e-c7408f7ddc9f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:04.958875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1234fe63-e963-4ff8-a82e-c7408f7ddc9f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:05.090901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1234fe63-e963-4ff8-a82e-c7408f7ddc9f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:05.099796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1234fe63-e963-4ff8-a82e-c7408f7ddc9f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.158127 Apr 11 20:13:05.100368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1430/2909] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:04 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:05.104889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e4e48e67-9f05-4273-8adb-60bbd331b168 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:05.105535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e4e48e67-9f05-4273-8adb-60bbd331b168 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:05.111583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4e48e67-9f05-4273-8adb-60bbd331b168 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:05.112031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4e48e67-9f05-4273-8adb-60bbd331b168 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:05.112785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4e48e67-9f05-4273-8adb-60bbd331b168 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:05.113257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4e48e67-9f05-4273-8adb-60bbd331b168 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:05.241247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4e48e67-9f05-4273-8adb-60bbd331b168 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:05.249610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e4e48e67-9f05-4273-8adb-60bbd331b168 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.148240 Apr 11 20:13:05.250190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1431/2910] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:05 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:06.121340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6948b4d7-ac35-47f5-a036-2911383af09f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:06.122417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6948b4d7-ac35-47f5-a036-2911383af09f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:06.129636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6948b4d7-ac35-47f5-a036-2911383af09f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:06.130064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6948b4d7-ac35-47f5-a036-2911383af09f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:06.130810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6948b4d7-ac35-47f5-a036-2911383af09f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:06.131238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6948b4d7-ac35-47f5-a036-2911383af09f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:06.262988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6948b4d7-ac35-47f5-a036-2911383af09f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:06.271264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6948b4d7-ac35-47f5-a036-2911383af09f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.157005 Apr 11 20:13:06.271838 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1432/2911] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:06 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:06.276304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1cbaaaf3-ab0b-402b-a69b-9bebf43faaf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:06.277001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1cbaaaf3-ab0b-402b-a69b-9bebf43faaf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:06.282954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cbaaaf3-ab0b-402b-a69b-9bebf43faaf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:06.283394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cbaaaf3-ab0b-402b-a69b-9bebf43faaf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:06.284402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cbaaaf3-ab0b-402b-a69b-9bebf43faaf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:06.284592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cbaaaf3-ab0b-402b-a69b-9bebf43faaf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:06.418860 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1cbaaaf3-ab0b-402b-a69b-9bebf43faaf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:06.427319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1cbaaaf3-ab0b-402b-a69b-9bebf43faaf1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154508 Apr 11 20:13:06.427865 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1433/2912] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:07.292711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-34292a36-5948-4007-8f3c-06e66a9bc39d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:07.293764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-34292a36-5948-4007-8f3c-06e66a9bc39d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:07.301639 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34292a36-5948-4007-8f3c-06e66a9bc39d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:07.302125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34292a36-5948-4007-8f3c-06e66a9bc39d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:07.302958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34292a36-5948-4007-8f3c-06e66a9bc39d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:07.303424 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34292a36-5948-4007-8f3c-06e66a9bc39d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:07.449558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-34292a36-5948-4007-8f3c-06e66a9bc39d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:07.457587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-34292a36-5948-4007-8f3c-06e66a9bc39d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.171216 Apr 11 20:13:07.458160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1434/2913] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:07 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:07.462701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-15a6e3d5-9b04-4b93-bb2a-ebb8450e7b19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:07.463306 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-15a6e3d5-9b04-4b93-bb2a-ebb8450e7b19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:07.469525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15a6e3d5-9b04-4b93-bb2a-ebb8450e7b19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:07.469996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15a6e3d5-9b04-4b93-bb2a-ebb8450e7b19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:07.470840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15a6e3d5-9b04-4b93-bb2a-ebb8450e7b19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:07.471275 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15a6e3d5-9b04-4b93-bb2a-ebb8450e7b19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:07.609927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-15a6e3d5-9b04-4b93-bb2a-ebb8450e7b19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:07.618703 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-15a6e3d5-9b04-4b93-bb2a-ebb8450e7b19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.159605 Apr 11 20:13:07.619271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1435/2914] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:08.479038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-906fec15-b918-459b-ba88-a94cb78d7c2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:08.480070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-906fec15-b918-459b-ba88-a94cb78d7c2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:08.487364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-906fec15-b918-459b-ba88-a94cb78d7c2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:08.487815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-906fec15-b918-459b-ba88-a94cb78d7c2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:08.488569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-906fec15-b918-459b-ba88-a94cb78d7c2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:08.489036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-906fec15-b918-459b-ba88-a94cb78d7c2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:08.630383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-906fec15-b918-459b-ba88-a94cb78d7c2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:08.638741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-906fec15-b918-459b-ba88-a94cb78d7c2d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.166164 Apr 11 20:13:08.639310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1436/2915] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:08 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:08.643672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ad1bf327-52e0-4c1d-8691-dbc2c4ea4d9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:08.644397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ad1bf327-52e0-4c1d-8691-dbc2c4ea4d9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:08.650268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad1bf327-52e0-4c1d-8691-dbc2c4ea4d9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:08.650713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad1bf327-52e0-4c1d-8691-dbc2c4ea4d9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:08.651460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad1bf327-52e0-4c1d-8691-dbc2c4ea4d9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:08.651892 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad1bf327-52e0-4c1d-8691-dbc2c4ea4d9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:08.776976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ad1bf327-52e0-4c1d-8691-dbc2c4ea4d9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:08.788509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ad1bf327-52e0-4c1d-8691-dbc2c4ea4d9f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.148006 Apr 11 20:13:08.789273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1437/2916] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:09.659643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5e9ba122-c2d3-44c4-a64a-0876ddf1fabb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:09.660796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5e9ba122-c2d3-44c4-a64a-0876ddf1fabb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:09.671181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e9ba122-c2d3-44c4-a64a-0876ddf1fabb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:09.671913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e9ba122-c2d3-44c4-a64a-0876ddf1fabb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:09.673199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e9ba122-c2d3-44c4-a64a-0876ddf1fabb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:09.673907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e9ba122-c2d3-44c4-a64a-0876ddf1fabb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:09.813150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5e9ba122-c2d3-44c4-a64a-0876ddf1fabb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:09.821223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5e9ba122-c2d3-44c4-a64a-0876ddf1fabb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.168371 Apr 11 20:13:09.821816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1438/2917] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:09 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:09.826163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d26d2b8b-fc32-4bfd-91bd-2f1eb807a422 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:09.826763 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d26d2b8b-fc32-4bfd-91bd-2f1eb807a422 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:09.832474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d26d2b8b-fc32-4bfd-91bd-2f1eb807a422 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:09.832949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d26d2b8b-fc32-4bfd-91bd-2f1eb807a422 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:09.833779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d26d2b8b-fc32-4bfd-91bd-2f1eb807a422 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:09.834339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d26d2b8b-fc32-4bfd-91bd-2f1eb807a422 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:09.968881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d26d2b8b-fc32-4bfd-91bd-2f1eb807a422 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:09.977544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d26d2b8b-fc32-4bfd-91bd-2f1eb807a422 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154760 Apr 11 20:13:09.978109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1439/2918] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:10.842337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a64f594e-0a7d-4294-90ae-784bd186f167 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:10.843435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a64f594e-0a7d-4294-90ae-784bd186f167 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:10.854096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a64f594e-0a7d-4294-90ae-784bd186f167 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:10.854840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a64f594e-0a7d-4294-90ae-784bd186f167 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:10.856149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a64f594e-0a7d-4294-90ae-784bd186f167 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:10.856871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a64f594e-0a7d-4294-90ae-784bd186f167 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:11.001179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a64f594e-0a7d-4294-90ae-784bd186f167 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:11.013073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a64f594e-0a7d-4294-90ae-784bd186f167 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.176874 Apr 11 20:13:11.013936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1440/2919] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:10 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:11.018535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56f4c1ae-0e9e-40c5-8ff1-6462c9eae716 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:11.019146 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56f4c1ae-0e9e-40c5-8ff1-6462c9eae716 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:11.026077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f4c1ae-0e9e-40c5-8ff1-6462c9eae716 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:11.026602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f4c1ae-0e9e-40c5-8ff1-6462c9eae716 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:11.027592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f4c1ae-0e9e-40c5-8ff1-6462c9eae716 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:11.028235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f4c1ae-0e9e-40c5-8ff1-6462c9eae716 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:11.164173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56f4c1ae-0e9e-40c5-8ff1-6462c9eae716 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:11.172454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56f4c1ae-0e9e-40c5-8ff1-6462c9eae716 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.157559 Apr 11 20:13:11.173048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1441/2920] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:12.032255 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-503198a3-912b-436e-91fc-f318b65da498 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:12.033075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-503198a3-912b-436e-91fc-f318b65da498 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:12.039488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-503198a3-912b-436e-91fc-f318b65da498 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:12.039913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-503198a3-912b-436e-91fc-f318b65da498 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:12.040668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-503198a3-912b-436e-91fc-f318b65da498 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:12.041215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-503198a3-912b-436e-91fc-f318b65da498 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:12.169172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-503198a3-912b-436e-91fc-f318b65da498 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:12.178811 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-503198a3-912b-436e-91fc-f318b65da498 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.150422 Apr 11 20:13:12.179627 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1442/2921] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:12 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:12.189032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-131d1603-d074-4fdb-a8b9-d48221aa8711 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:12.189931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-131d1603-d074-4fdb-a8b9-d48221aa8711 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:12.195931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-131d1603-d074-4fdb-a8b9-d48221aa8711 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:12.196380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-131d1603-d074-4fdb-a8b9-d48221aa8711 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:12.197175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-131d1603-d074-4fdb-a8b9-d48221aa8711 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:12.197609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-131d1603-d074-4fdb-a8b9-d48221aa8711 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:12.330677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-131d1603-d074-4fdb-a8b9-d48221aa8711 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:12.341492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-131d1603-d074-4fdb-a8b9-d48221aa8711 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.155926 Apr 11 20:13:12.342362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1443/2922] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:13.197333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6f1d9eb9-97c9-4694-b84d-3db98f0a67df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:13.198034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6f1d9eb9-97c9-4694-b84d-3db98f0a67df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:13.205245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f1d9eb9-97c9-4694-b84d-3db98f0a67df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:13.205686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f1d9eb9-97c9-4694-b84d-3db98f0a67df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:13.206441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f1d9eb9-97c9-4694-b84d-3db98f0a67df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:13.206870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f1d9eb9-97c9-4694-b84d-3db98f0a67df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:13.352344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6f1d9eb9-97c9-4694-b84d-3db98f0a67df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:13.360819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6f1d9eb9-97c9-4694-b84d-3db98f0a67df tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.168087 Apr 11 20:13:13.361457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1444/2923] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:13 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:13.365808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7020e7a1-2dc0-4950-b5f5-8f845a5aaba8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:13.366411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7020e7a1-2dc0-4950-b5f5-8f845a5aaba8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:13.372288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7020e7a1-2dc0-4950-b5f5-8f845a5aaba8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:13.373263 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7020e7a1-2dc0-4950-b5f5-8f845a5aaba8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:13.374028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7020e7a1-2dc0-4950-b5f5-8f845a5aaba8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:13.374465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7020e7a1-2dc0-4950-b5f5-8f845a5aaba8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:13.519692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7020e7a1-2dc0-4950-b5f5-8f845a5aaba8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:13.528213 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7020e7a1-2dc0-4950-b5f5-8f845a5aaba8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.165828 Apr 11 20:13:13.528783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1445/2924] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:14.381613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac9cd709-5e21-45c7-97d0-7b05eca6be1d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:14.382558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac9cd709-5e21-45c7-97d0-7b05eca6be1d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:14.392659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac9cd709-5e21-45c7-97d0-7b05eca6be1d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:14.393414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac9cd709-5e21-45c7-97d0-7b05eca6be1d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:14.394576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac9cd709-5e21-45c7-97d0-7b05eca6be1d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:14.395229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac9cd709-5e21-45c7-97d0-7b05eca6be1d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:14.542132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ac9cd709-5e21-45c7-97d0-7b05eca6be1d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:14.551911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac9cd709-5e21-45c7-97d0-7b05eca6be1d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.176285 Apr 11 20:13:14.552476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1446/2925] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:14 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:14.557021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-01dbb679-18c4-4cac-b34c-151407763067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:14.557626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-01dbb679-18c4-4cac-b34c-151407763067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:14.563511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01dbb679-18c4-4cac-b34c-151407763067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:14.563962 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01dbb679-18c4-4cac-b34c-151407763067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:14.564720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01dbb679-18c4-4cac-b34c-151407763067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:14.565179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01dbb679-18c4-4cac-b34c-151407763067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:14.692258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01dbb679-18c4-4cac-b34c-151407763067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:14.700199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-01dbb679-18c4-4cac-b34c-151407763067 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.146673 Apr 11 20:13:14.700759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1447/2926] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:15.573087 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db433ad2-3fd9-4ba5-93f0-e9e3c8fe0abd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:15.574162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db433ad2-3fd9-4ba5-93f0-e9e3c8fe0abd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:15.584126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db433ad2-3fd9-4ba5-93f0-e9e3c8fe0abd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:15.584857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db433ad2-3fd9-4ba5-93f0-e9e3c8fe0abd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:15.586136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db433ad2-3fd9-4ba5-93f0-e9e3c8fe0abd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:15.586845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db433ad2-3fd9-4ba5-93f0-e9e3c8fe0abd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:15.722936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db433ad2-3fd9-4ba5-93f0-e9e3c8fe0abd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:15.732356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db433ad2-3fd9-4ba5-93f0-e9e3c8fe0abd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.165837 Apr 11 20:13:15.732925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1448/2927] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:15 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:15.737324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5e05ca3a-d2f0-4810-9ae0-68b67c35fd4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:15.737927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5e05ca3a-d2f0-4810-9ae0-68b67c35fd4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:15.744177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e05ca3a-d2f0-4810-9ae0-68b67c35fd4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:15.744684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e05ca3a-d2f0-4810-9ae0-68b67c35fd4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:15.745810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e05ca3a-d2f0-4810-9ae0-68b67c35fd4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:15.746395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e05ca3a-d2f0-4810-9ae0-68b67c35fd4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:15.877264 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5e05ca3a-d2f0-4810-9ae0-68b67c35fd4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:15.889188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5e05ca3a-d2f0-4810-9ae0-68b67c35fd4e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154936 Apr 11 20:13:15.889979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1449/2928] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:16.754433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-28c67010-c6ce-49cd-81de-d8baca384c68 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:16.755528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-28c67010-c6ce-49cd-81de-d8baca384c68 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:16.765327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28c67010-c6ce-49cd-81de-d8baca384c68 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:16.765776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28c67010-c6ce-49cd-81de-d8baca384c68 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:16.766552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28c67010-c6ce-49cd-81de-d8baca384c68 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:16.766961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28c67010-c6ce-49cd-81de-d8baca384c68 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:16.910363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-28c67010-c6ce-49cd-81de-d8baca384c68 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:16.920528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-28c67010-c6ce-49cd-81de-d8baca384c68 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.173162 Apr 11 20:13:16.921140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1450/2929] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:16 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:16.925544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-61834c99-b046-4971-bf49-d90abcba5605 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:16.926135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-61834c99-b046-4971-bf49-d90abcba5605 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:16.931682 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61834c99-b046-4971-bf49-d90abcba5605 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:16.932125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61834c99-b046-4971-bf49-d90abcba5605 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:16.932866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61834c99-b046-4971-bf49-d90abcba5605 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:16.933321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61834c99-b046-4971-bf49-d90abcba5605 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:17.057199 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-61834c99-b046-4971-bf49-d90abcba5605 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:17.065872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-61834c99-b046-4971-bf49-d90abcba5605 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.143769 Apr 11 20:13:17.066444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1451/2930] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:17.942258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba8cb18b-17ee-48d7-a4a9-ceaf303ab9fd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:17.943305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba8cb18b-17ee-48d7-a4a9-ceaf303ab9fd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:17.953866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba8cb18b-17ee-48d7-a4a9-ceaf303ab9fd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:17.954606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba8cb18b-17ee-48d7-a4a9-ceaf303ab9fd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:17.955847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba8cb18b-17ee-48d7-a4a9-ceaf303ab9fd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:17.956561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba8cb18b-17ee-48d7-a4a9-ceaf303ab9fd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:18.103068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba8cb18b-17ee-48d7-a4a9-ceaf303ab9fd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:18.113073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba8cb18b-17ee-48d7-a4a9-ceaf303ab9fd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.177423 Apr 11 20:13:18.113654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1452/2931] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:17 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:18.118156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df589b78-c448-4b30-b740-94e11c6de720 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:18.118757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df589b78-c448-4b30-b740-94e11c6de720 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:18.124819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df589b78-c448-4b30-b740-94e11c6de720 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:18.125299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df589b78-c448-4b30-b740-94e11c6de720 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:18.126155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df589b78-c448-4b30-b740-94e11c6de720 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:18.126616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df589b78-c448-4b30-b740-94e11c6de720 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:18.262636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df589b78-c448-4b30-b740-94e11c6de720 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:18.271224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df589b78-c448-4b30-b740-94e11c6de720 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.156657 Apr 11 20:13:18.271799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1453/2932] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:18.473920 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:13:18.474157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:13:19.134096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-695c13a0-debe-49a8-acde-dda4d09cac7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:19.135168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-695c13a0-debe-49a8-acde-dda4d09cac7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:19.144528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-695c13a0-debe-49a8-acde-dda4d09cac7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:19.145174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-695c13a0-debe-49a8-acde-dda4d09cac7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:19.146179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-695c13a0-debe-49a8-acde-dda4d09cac7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:19.146752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-695c13a0-debe-49a8-acde-dda4d09cac7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:19.278827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-695c13a0-debe-49a8-acde-dda4d09cac7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:19.287125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-695c13a0-debe-49a8-acde-dda4d09cac7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.159557 Apr 11 20:13:19.287701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1454/2933] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:19 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:19.292042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-411ba726-a848-4598-87db-b555dcb552c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:19.292647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-411ba726-a848-4598-87db-b555dcb552c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:19.298831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-411ba726-a848-4598-87db-b555dcb552c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:19.299277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-411ba726-a848-4598-87db-b555dcb552c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:19.300030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-411ba726-a848-4598-87db-b555dcb552c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:19.300457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-411ba726-a848-4598-87db-b555dcb552c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:19.432546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-411ba726-a848-4598-87db-b555dcb552c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:19.441157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-411ba726-a848-4598-87db-b555dcb552c8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.152476 Apr 11 20:13:19.441729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1455/2934] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:20.307641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c687873-6552-427e-958d-3568b3aa7dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:20.308743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c687873-6552-427e-958d-3568b3aa7dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:20.315766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c687873-6552-427e-958d-3568b3aa7dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:20.316205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c687873-6552-427e-958d-3568b3aa7dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:20.316950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c687873-6552-427e-958d-3568b3aa7dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:20.317397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c687873-6552-427e-958d-3568b3aa7dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:20.449782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c687873-6552-427e-958d-3568b3aa7dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:20.458154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c687873-6552-427e-958d-3568b3aa7dc7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.156969 Apr 11 20:13:20.458737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1456/2935] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:20 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:20.463200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-85ad8649-e81a-41da-99a1-6ad0811e7a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:20.463855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-85ad8649-e81a-41da-99a1-6ad0811e7a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:20.469722 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85ad8649-e81a-41da-99a1-6ad0811e7a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:20.470172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85ad8649-e81a-41da-99a1-6ad0811e7a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:20.470933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85ad8649-e81a-41da-99a1-6ad0811e7a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:20.471368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85ad8649-e81a-41da-99a1-6ad0811e7a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:20.603394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85ad8649-e81a-41da-99a1-6ad0811e7a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:20.613047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-85ad8649-e81a-41da-99a1-6ad0811e7a68 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.153251 Apr 11 20:13:20.613623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1457/2936] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:21.479009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dd0a4e48-e85d-4c28-9a54-e5ff21e57ba2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:21.480047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dd0a4e48-e85d-4c28-9a54-e5ff21e57ba2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:21.487648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd0a4e48-e85d-4c28-9a54-e5ff21e57ba2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:21.488088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd0a4e48-e85d-4c28-9a54-e5ff21e57ba2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:21.488836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd0a4e48-e85d-4c28-9a54-e5ff21e57ba2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:21.489296 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd0a4e48-e85d-4c28-9a54-e5ff21e57ba2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:21.619365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dd0a4e48-e85d-4c28-9a54-e5ff21e57ba2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:21.627800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dd0a4e48-e85d-4c28-9a54-e5ff21e57ba2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.155266 Apr 11 20:13:21.628338 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1458/2937] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:21 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:21.632633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c24a71e-f3c9-4855-8f48-6561a25170c9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:21.633256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c24a71e-f3c9-4855-8f48-6561a25170c9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:21.639507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c24a71e-f3c9-4855-8f48-6561a25170c9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:21.639946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c24a71e-f3c9-4855-8f48-6561a25170c9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:21.640689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c24a71e-f3c9-4855-8f48-6561a25170c9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:21.641143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c24a71e-f3c9-4855-8f48-6561a25170c9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:21.766364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3c24a71e-f3c9-4855-8f48-6561a25170c9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:21.778515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c24a71e-f3c9-4855-8f48-6561a25170c9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.148926 Apr 11 20:13:21.779241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1459/2938] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:22.649484 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74288cea-4cd6-42b7-b968-b55ef3c44e98 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:22.650536 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74288cea-4cd6-42b7-b968-b55ef3c44e98 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:22.658587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74288cea-4cd6-42b7-b968-b55ef3c44e98 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:22.659034 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74288cea-4cd6-42b7-b968-b55ef3c44e98 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:22.659790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74288cea-4cd6-42b7-b968-b55ef3c44e98 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:22.660216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74288cea-4cd6-42b7-b968-b55ef3c44e98 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:22.789581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74288cea-4cd6-42b7-b968-b55ef3c44e98 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:22.798041 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74288cea-4cd6-42b7-b968-b55ef3c44e98 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.155148 Apr 11 20:13:22.798595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1460/2939] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:22 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:22.803031 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e63894a9-9e59-433d-99e0-5be595cd56ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:22.803622 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e63894a9-9e59-433d-99e0-5be595cd56ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:22.809463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e63894a9-9e59-433d-99e0-5be595cd56ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:22.809905 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e63894a9-9e59-433d-99e0-5be595cd56ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:22.810653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e63894a9-9e59-433d-99e0-5be595cd56ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:22.811071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e63894a9-9e59-433d-99e0-5be595cd56ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:22.945400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e63894a9-9e59-433d-99e0-5be595cd56ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:22.953732 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e63894a9-9e59-433d-99e0-5be595cd56ad tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154214 Apr 11 20:13:22.954299 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1461/2940] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:23.819695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6b262d6-f7b1-4a2e-aa81-3ee00f3e37c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:23.820764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a6b262d6-f7b1-4a2e-aa81-3ee00f3e37c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:23.831145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6b262d6-f7b1-4a2e-aa81-3ee00f3e37c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:23.831882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6b262d6-f7b1-4a2e-aa81-3ee00f3e37c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:23.833170 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6b262d6-f7b1-4a2e-aa81-3ee00f3e37c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:23.833886 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6b262d6-f7b1-4a2e-aa81-3ee00f3e37c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:24.190529 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a6b262d6-f7b1-4a2e-aa81-3ee00f3e37c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:24.198984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6b262d6-f7b1-4a2e-aa81-3ee00f3e37c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.385985 Apr 11 20:13:24.199554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1462/2941] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:23 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:24.204090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2dc0197-cf72-4fdc-918a-1ddd65573633 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:13:24.204685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2dc0197-cf72-4fdc-918a-1ddd65573633 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:13:24.210539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2dc0197-cf72-4fdc-918a-1ddd65573633 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:24.210984 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2dc0197-cf72-4fdc-918a-1ddd65573633 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:24.211726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2dc0197-cf72-4fdc-918a-1ddd65573633 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:13:24.212152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2dc0197-cf72-4fdc-918a-1ddd65573633 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:13:24.341879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2dc0197-cf72-4fdc-918a-1ddd65573633 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:13:24.350158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2dc0197-cf72-4fdc-918a-1ddd65573633 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.149683 Apr 11 20:13:24.350717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1463/2942] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:13:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:13:24.879064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3956e25e-ebd1-4716-8b94-e53074615ac9 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Calling method '.version_select at 0x7f408fefc790>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:09.127320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-fbf8ad46-9669-4bd1-bf93-30ae4aa17733 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] HTTP exception thrown: Volume 7755d089-5375-428c-8d92-52d9970140ef could not be found. Apr 11 20:14:09.127924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fbf8ad46-9669-4bd1-bf93-30ae4aa17733 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Returning 404 to user: Volume 7755d089-5375-428c-8d92-52d9970140ef could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:14:09.128758 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fbf8ad46-9669-4bd1-bf93-30ae4aa17733 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7755d089-5375-428c-8d92-52d9970140ef" status: 404 len: 109 microversion: 2.1 time: 104.319714 Apr 11 20:14:09.129492 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1480/2943] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:12:24 2022] GET /compute/v2.1/os-volumes/7755d089-5375-428c-8d92-52d9970140ef => generated 109 bytes in 104321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:14:09.134509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2288fc4-0048-489f-a954-42a7aaf043c3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:09.135140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2288fc4-0048-489f-a954-42a7aaf043c3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:09.143011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2288fc4-0048-489f-a954-42a7aaf043c3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:09.143468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2288fc4-0048-489f-a954-42a7aaf043c3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:09.144350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2288fc4-0048-489f-a954-42a7aaf043c3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:09.144781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2288fc4-0048-489f-a954-42a7aaf043c3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:09.274594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2288fc4-0048-489f-a954-42a7aaf043c3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:09.283817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2288fc4-0048-489f-a954-42a7aaf043c3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.153378 Apr 11 20:14:09.284394 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1481/2944] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:09 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:09.289412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f150627c-05e4-451d-bd11-5133cc00fd5b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:09.290016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f150627c-05e4-451d-bd11-5133cc00fd5b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:09.295697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f150627c-05e4-451d-bd11-5133cc00fd5b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:09.296138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f150627c-05e4-451d-bd11-5133cc00fd5b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:09.296943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f150627c-05e4-451d-bd11-5133cc00fd5b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:09.297371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f150627c-05e4-451d-bd11-5133cc00fd5b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:09.426694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f150627c-05e4-451d-bd11-5133cc00fd5b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:09.434397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f150627c-05e4-451d-bd11-5133cc00fd5b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.149071 Apr 11 20:14:09.434966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1482/2945] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:09.439410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e5985fa0-c593-4854-a0be-62e6c79cb0e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:09.439893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e5985fa0-c593-4854-a0be-62e6c79cb0e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:09.445685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5985fa0-c593-4854-a0be-62e6c79cb0e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:09.446125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5985fa0-c593-4854-a0be-62e6c79cb0e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:09.446869 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5985fa0-c593-4854-a0be-62e6c79cb0e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:09.447297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5985fa0-c593-4854-a0be-62e6c79cb0e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:09.470727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e5985fa0-c593-4854-a0be-62e6c79cb0e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:14:09.550407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e5985fa0-c593-4854-a0be-62e6c79cb0e7 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "DELETE /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 204 len: 0 microversion: 2.20 time: 0.114267 Apr 11 20:14:09.550993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1483/2946] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Apr 11 20:14:09 2022] DELETE /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:14:09.560320 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:09.561337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:09.567575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:09.568047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:09.568773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:09.569271 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:09.650702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-3956e25e-ebd1-4716-8b94-e53074615ac9 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] HTTP exception thrown: Volume 7755d089-5375-428c-8d92-52d9970140ef could not be found. Apr 11 20:14:09.651347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3956e25e-ebd1-4716-8b94-e53074615ac9 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] Returning 404 to user: Volume 7755d089-5375-428c-8d92-52d9970140ef could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:14:09.652258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3956e25e-ebd1-4716-8b94-e53074615ac9 tempest-VolumesNegativeTest-1652575398 tempest-VolumesNegativeTest-1652575398-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7755d089-5375-428c-8d92-52d9970140ef" status: 404 len: 109 microversion: 2.1 time: 44.780093 Apr 11 20:14:09.653308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1464/2947] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:13:24 2022] GET /compute/v2.1/os-volumes/7755d089-5375-428c-8d92-52d9970140ef => generated 109 bytes in 44782 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:14:09.732525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:09.739647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:09.741174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:09.742338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7d53b9f8-edc9-4ed5-a9a2-e7425a02070d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1723 microversion: 2.20 time: 0.186646 Apr 11 20:14:09.743093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1484/2948] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:14:09 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:14:10.302092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-58b10037-16b7-4e1c-9393-3610e180c97e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:10.302743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-58b10037-16b7-4e1c-9393-3610e180c97e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:10.311999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58b10037-16b7-4e1c-9393-3610e180c97e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:10.312315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58b10037-16b7-4e1c-9393-3610e180c97e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:10.313113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58b10037-16b7-4e1c-9393-3610e180c97e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:10.313550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58b10037-16b7-4e1c-9393-3610e180c97e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:10.443942 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-58b10037-16b7-4e1c-9393-3610e180c97e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:10.451475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2102ed05-93c6-454c-b48a-f05965458947 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:10.452016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-58b10037-16b7-4e1c-9393-3610e180c97e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.154266 Apr 11 20:14:10.452294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2102ed05-93c6-454c-b48a-f05965458947 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:10.452746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1465/2949] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:10 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:10.462961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2102ed05-93c6-454c-b48a-f05965458947 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:10.463407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2102ed05-93c6-454c-b48a-f05965458947 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:10.464172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2102ed05-93c6-454c-b48a-f05965458947 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:10.464600 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2102ed05-93c6-454c-b48a-f05965458947 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:10.596856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2102ed05-93c6-454c-b48a-f05965458947 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:10.604950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2102ed05-93c6-454c-b48a-f05965458947 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.157309 Apr 11 20:14:10.605521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1485/2950] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:10 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:14:10.760793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:10.761435 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:10.768629 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:10.769024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:10.769783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:10.770209 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:10.898223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:10.908204 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:10.909929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:10.911298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19b6d1d0-40fc-4ca3-9fc8-7584debbcc9b tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1723 microversion: 2.20 time: 0.154374 Apr 11 20:14:10.912276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1466/2951] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:14:10 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 20:14:11.469434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c84ab66a-2ff0-449e-b014-760c957aa116 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:11.470103 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c84ab66a-2ff0-449e-b014-760c957aa116 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:11.476433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c84ab66a-2ff0-449e-b014-760c957aa116 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:11.476882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c84ab66a-2ff0-449e-b014-760c957aa116 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:11.477807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c84ab66a-2ff0-449e-b014-760c957aa116 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:11.478237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c84ab66a-2ff0-449e-b014-760c957aa116 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:11.614891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c84ab66a-2ff0-449e-b014-760c957aa116 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:11.622493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-13ec1b41-5c79-413d-9211-1778deec7f1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:11.623750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-13ec1b41-5c79-413d-9211-1778deec7f1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:11.623909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c84ab66a-2ff0-449e-b014-760c957aa116 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.158317 Apr 11 20:14:11.633694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1486/2952] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:11 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:11.634177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13ec1b41-5c79-413d-9211-1778deec7f1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:11.638592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13ec1b41-5c79-413d-9211-1778deec7f1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:11.639498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13ec1b41-5c79-413d-9211-1778deec7f1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:11.639945 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13ec1b41-5c79-413d-9211-1778deec7f1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:11.698167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-c73f0aff-b68b-4930-b28c-f0758f3647af req-6b805d01-4f72-4d1d-9b10-4198e1e250ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6aea71-8b17-46b8-ab07-b42b41b573a5", "name": "network-vif-deleted", "tag": "043741af-b872-498e-a793-2860d820736a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:14:11.708559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-c73f0aff-b68b-4930-b28c-f0758f3647af req-6b805d01-4f72-4d1d-9b10-4198e1e250ad service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:11.709472 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-c73f0aff-b68b-4930-b28c-f0758f3647af req-6b805d01-4f72-4d1d-9b10-4198e1e250ad service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:11.739018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-c73f0aff-b68b-4930-b28c-f0758f3647af req-6b805d01-4f72-4d1d-9b10-4198e1e250ad service nova] Creating event network-vif-deleted:043741af-b872-498e-a793-2860d820736a for instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 on hv-cinder-83078 Apr 11 20:14:11.744651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-c73f0aff-b68b-4930-b28c-f0758f3647af req-6b805d01-4f72-4d1d-9b10-4198e1e250ad service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050374 Apr 11 20:14:11.745434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1487/2953] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:14:11.791221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-13ec1b41-5c79-413d-9211-1778deec7f1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:11.800295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-13ec1b41-5c79-413d-9211-1778deec7f1d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.181773 Apr 11 20:14:11.809482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1467/2954] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:11.930334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:11.931023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:11.937209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:11.937636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:11.938359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:11.938793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:12.004867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:12.014075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:12.016388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6342f0d42fd04a6abd7d1da1e692de34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697a9ca9d1a403cb1b812db1874dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:12.017615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e57be701-51fa-42f6-8e6a-c4d45ffbed05 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 200 len: 1655 microversion: 2.20 time: 0.091603 Apr 11 20:14:12.018357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1488/2955] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:14:11 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 20:14:12.641215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d08730fa-1331-464a-b34c-7302197efa79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:12.642091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d08730fa-1331-464a-b34c-7302197efa79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:12.648311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d08730fa-1331-464a-b34c-7302197efa79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:12.648759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d08730fa-1331-464a-b34c-7302197efa79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:12.649554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d08730fa-1331-464a-b34c-7302197efa79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:12.650033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d08730fa-1331-464a-b34c-7302197efa79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:12.779414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d08730fa-1331-464a-b34c-7302197efa79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:12.787708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d08730fa-1331-464a-b34c-7302197efa79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.150455 Apr 11 20:14:12.788315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1468/2956] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:12 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:12.817868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd6f6d69-96d6-42b8-a89b-ed35dcbf0d7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:12.818520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd6f6d69-96d6-42b8-a89b-ed35dcbf0d7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:12.826019 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd6f6d69-96d6-42b8-a89b-ed35dcbf0d7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:12.826379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd6f6d69-96d6-42b8-a89b-ed35dcbf0d7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:12.827126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd6f6d69-96d6-42b8-a89b-ed35dcbf0d7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:12.827611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd6f6d69-96d6-42b8-a89b-ed35dcbf0d7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:12.957260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cd6f6d69-96d6-42b8-a89b-ed35dcbf0d7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:12.965584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd6f6d69-96d6-42b8-a89b-ed35dcbf0d7f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.151592 Apr 11 20:14:12.966199 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1489/2957] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:13.036068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:13.036755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:13.043492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.044023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.044850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.045398 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.058976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] HTTP exception thrown: Instance 09e7987e-b5e1-4839-b663-b9edb28e960b could not be found. Apr 11 20:14:13.059570 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Returning 404 to user: Instance 09e7987e-b5e1-4839-b663-b9edb28e960b could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:14:13.060403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa47dc0e-c918-4e2c-9489-c575b852113a tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 404 len: 111 microversion: 2.20 time: 0.028451 Apr 11 20:14:13.061217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1469/2958] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:14:13 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:14:13.069747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-abf852ed-99ac-485a-bec5-29e82109b96d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '.version_select at 0x7f4086d5c280>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:13.090562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-abf852ed-99ac-485a-bec5-29e82109b96d tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825902299" status: 204 len: 0 microversion: 2.20 time: 0.024447 Apr 11 20:14:13.091159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1490/2959] 10.222.0.62 () {60 vars in 1261 bytes} [Mon Apr 11 20:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825902299 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 20:14:13.725179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:13.725683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:13.731876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.732329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.733122 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.733557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.747222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] HTTP exception thrown: Instance 09e7987e-b5e1-4839-b663-b9edb28e960b could not be found. Apr 11 20:14:13.748137 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Returning 404 to user: Instance 09e7987e-b5e1-4839-b663-b9edb28e960b could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:14:13.749025 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae9580f4-cd6b-4685-aa06-19bd19fd797c tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "DELETE /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 404 len: 111 microversion: 2.20 time: 0.028311 Apr 11 20:14:13.749655 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1470/2960] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Apr 11 20:14:13 2022] DELETE /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:14:13.761115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:13.761843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: 09e7987e-b5e1-4839-b663-b9edb28e960b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:13.768202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.768896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.769705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.770133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.772020 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-ed7af184-85c4-4e83-8af6-48e0b3037102 req-f74a1e75-3953-4400-b4ab-0abf211aec36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e7987e-b5e1-4839-b663-b9edb28e960b", "name": "network-vif-deleted", "tag": "0e1a2432-3d2a-438b-9a40-93147e10d312"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:14:13.780145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ed7af184-85c4-4e83-8af6-48e0b3037102 req-f74a1e75-3953-4400-b4ab-0abf211aec36 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.780587 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ed7af184-85c4-4e83-8af6-48e0b3037102 req-f74a1e75-3953-4400-b4ab-0abf211aec36 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.783818 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] HTTP exception thrown: Instance 09e7987e-b5e1-4839-b663-b9edb28e960b could not be found. Apr 11 20:14:13.784429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Returning 404 to user: Instance 09e7987e-b5e1-4839-b663-b9edb28e960b could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:14:13.785296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a6f59ddc-0754-494e-b4e7-e2aee74b5bf4 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b" status: 404 len: 111 microversion: 2.20 time: 0.030598 Apr 11 20:14:13.785825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1491/2961] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:14:13 2022] GET /compute/v2.1/servers/09e7987e-b5e1-4839-b663-b9edb28e960b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:14:13.791734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-ed7af184-85c4-4e83-8af6-48e0b3037102 req-f74a1e75-3953-4400-b4ab-0abf211aec36 service nova] Creating event network-vif-deleted:0e1a2432-3d2a-438b-9a40-93147e10d312 for instance 09e7987e-b5e1-4839-b663-b9edb28e960b on hv-cinder-83078 Apr 11 20:14:13.798274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-ed7af184-85c4-4e83-8af6-48e0b3037102 req-f74a1e75-3953-4400-b4ab-0abf211aec36 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030075 Apr 11 20:14:13.799218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1471/2962] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:14:13.805313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aadec50f-29f4-4503-b9c0-8a53c73822bd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:13.805924 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aadec50f-29f4-4503-b9c0-8a53c73822bd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:13.811995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aadec50f-29f4-4503-b9c0-8a53c73822bd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.812443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aadec50f-29f4-4503-b9c0-8a53c73822bd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.813215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aadec50f-29f4-4503-b9c0-8a53c73822bd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.813639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aadec50f-29f4-4503-b9c0-8a53c73822bd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.949234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aadec50f-29f4-4503-b9c0-8a53c73822bd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:13.957716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aadec50f-29f4-4503-b9c0-8a53c73822bd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.156115 Apr 11 20:14:13.958468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1492/2963] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:13 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:13.983737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a2e3e6b8-977d-4107-85c8-cc8ab9ec1320 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:13.984463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a2e3e6b8-977d-4107-85c8-cc8ab9ec1320 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:13.991057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2e3e6b8-977d-4107-85c8-cc8ab9ec1320 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.991503 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2e3e6b8-977d-4107-85c8-cc8ab9ec1320 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:13.992260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2e3e6b8-977d-4107-85c8-cc8ab9ec1320 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:13.992696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2e3e6b8-977d-4107-85c8-cc8ab9ec1320 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:14.124613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a2e3e6b8-977d-4107-85c8-cc8ab9ec1320 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:14.136568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a2e3e6b8-977d-4107-85c8-cc8ab9ec1320 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.156812 Apr 11 20:14:14.137401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1472/2964] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:14.982817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8c002da-9eda-40cd-8462-18ffd8914084 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:14.983814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8c002da-9eda-40cd-8462-18ffd8914084 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:14.991022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8c002da-9eda-40cd-8462-18ffd8914084 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:14.991496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8c002da-9eda-40cd-8462-18ffd8914084 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:14.992294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8c002da-9eda-40cd-8462-18ffd8914084 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:14.992748 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8c002da-9eda-40cd-8462-18ffd8914084 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:15.133688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8c002da-9eda-40cd-8462-18ffd8914084 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:15.142270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8c002da-9eda-40cd-8462-18ffd8914084 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.165980 Apr 11 20:14:15.142809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1493/2965] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:14 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:15.154431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3a91da08-8baf-4591-b883-0e24e466fd63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:15.155043 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3a91da08-8baf-4591-b883-0e24e466fd63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:15.161400 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a91da08-8baf-4591-b883-0e24e466fd63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:15.161850 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a91da08-8baf-4591-b883-0e24e466fd63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:15.162604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a91da08-8baf-4591-b883-0e24e466fd63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:15.163033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a91da08-8baf-4591-b883-0e24e466fd63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:15.291742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3a91da08-8baf-4591-b883-0e24e466fd63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:15.300417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3a91da08-8baf-4591-b883-0e24e466fd63 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.149994 Apr 11 20:14:15.301101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1473/2966] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:15 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:16.163636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e3d91af9-6197-4f84-8203-faa11e4625bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:16.164569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e3d91af9-6197-4f84-8203-faa11e4625bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:16.175599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3d91af9-6197-4f84-8203-faa11e4625bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:16.176330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3d91af9-6197-4f84-8203-faa11e4625bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:16.177638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3d91af9-6197-4f84-8203-faa11e4625bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:16.178355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3d91af9-6197-4f84-8203-faa11e4625bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:16.312969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e3d91af9-6197-4f84-8203-faa11e4625bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:16.317583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf920374-57bc-4cad-bed2-07260b5615bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:16.318202 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cf920374-57bc-4cad-bed2-07260b5615bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:16.320920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e3d91af9-6197-4f84-8203-faa11e4625bc tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.163767 Apr 11 20:14:16.321483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1494/2967] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:16 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:16.324487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf920374-57bc-4cad-bed2-07260b5615bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:16.324935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf920374-57bc-4cad-bed2-07260b5615bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:16.325723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf920374-57bc-4cad-bed2-07260b5615bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:16.326156 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf920374-57bc-4cad-bed2-07260b5615bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:16.451394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cf920374-57bc-4cad-bed2-07260b5615bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:16.459989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cf920374-57bc-4cad-bed2-07260b5615bf tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.146197 Apr 11 20:14:16.460583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1474/2968] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:17.342235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd42acca-69f9-4e18-abe2-06518dd6b033 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:17.344050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd42acca-69f9-4e18-abe2-06518dd6b033 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:17.354897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd42acca-69f9-4e18-abe2-06518dd6b033 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:17.355647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd42acca-69f9-4e18-abe2-06518dd6b033 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:17.356889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd42acca-69f9-4e18-abe2-06518dd6b033 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:17.357650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd42acca-69f9-4e18-abe2-06518dd6b033 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:17.479348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95422db3-9777-4b7e-8721-1d4a8c47f6df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:17.479880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95422db3-9777-4b7e-8721-1d4a8c47f6df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:17.486288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95422db3-9777-4b7e-8721-1d4a8c47f6df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:17.486819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95422db3-9777-4b7e-8721-1d4a8c47f6df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:17.487634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95422db3-9777-4b7e-8721-1d4a8c47f6df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:17.488070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95422db3-9777-4b7e-8721-1d4a8c47f6df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:17.493802 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd42acca-69f9-4e18-abe2-06518dd6b033 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:17.501971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd42acca-69f9-4e18-abe2-06518dd6b033 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.166223 Apr 11 20:14:17.502756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1495/2969] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:17 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:17.619614 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-95422db3-9777-4b7e-8721-1d4a8c47f6df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:17.629632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95422db3-9777-4b7e-8721-1d4a8c47f6df tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154221 Apr 11 20:14:17.630210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1475/2970] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:18.523354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56c1770d-5819-4f45-a4dc-60a56e3f641c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:18.524207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56c1770d-5819-4f45-a4dc-60a56e3f641c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:18.535209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c1770d-5819-4f45-a4dc-60a56e3f641c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:18.535948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c1770d-5819-4f45-a4dc-60a56e3f641c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:18.537245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c1770d-5819-4f45-a4dc-60a56e3f641c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:18.537958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c1770d-5819-4f45-a4dc-60a56e3f641c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:18.647096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65c0c88b-4f52-446b-9df7-785c693f3314 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:18.647685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65c0c88b-4f52-446b-9df7-785c693f3314 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:18.654308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65c0c88b-4f52-446b-9df7-785c693f3314 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:18.654753 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65c0c88b-4f52-446b-9df7-785c693f3314 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:18.655516 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65c0c88b-4f52-446b-9df7-785c693f3314 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:18.655949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65c0c88b-4f52-446b-9df7-785c693f3314 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:18.671477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56c1770d-5819-4f45-a4dc-60a56e3f641c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:18.679684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56c1770d-5819-4f45-a4dc-60a56e3f641c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.162878 Apr 11 20:14:18.680259 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1496/2971] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:18 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:18.806793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65c0c88b-4f52-446b-9df7-785c693f3314 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:18.816044 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65c0c88b-4f52-446b-9df7-785c693f3314 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.172873 Apr 11 20:14:18.816608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1476/2972] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:19.700742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-447bbac4-d3db-4f3e-9eec-09126446d55e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:19.701766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-447bbac4-d3db-4f3e-9eec-09126446d55e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:19.712614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-447bbac4-d3db-4f3e-9eec-09126446d55e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:19.713411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-447bbac4-d3db-4f3e-9eec-09126446d55e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:19.714677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-447bbac4-d3db-4f3e-9eec-09126446d55e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:19.715394 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-447bbac4-d3db-4f3e-9eec-09126446d55e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:19.833182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fa8db0c8-b9d6-431a-b661-88a600fc346b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:19.833798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fa8db0c8-b9d6-431a-b661-88a600fc346b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:19.840511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa8db0c8-b9d6-431a-b661-88a600fc346b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:19.840951 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa8db0c8-b9d6-431a-b661-88a600fc346b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:19.841717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa8db0c8-b9d6-431a-b661-88a600fc346b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:19.842175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa8db0c8-b9d6-431a-b661-88a600fc346b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:19.852125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-447bbac4-d3db-4f3e-9eec-09126446d55e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:19.860779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-447bbac4-d3db-4f3e-9eec-09126446d55e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.166402 Apr 11 20:14:19.861462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1497/2973] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:19 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:19.975075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fa8db0c8-b9d6-431a-b661-88a600fc346b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:19.983312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fa8db0c8-b9d6-431a-b661-88a600fc346b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.154084 Apr 11 20:14:19.983896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1477/2974] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:14:20.878929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c05d1c1-f5d7-4796-a5e0-f52815c6efd0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:20.879545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c05d1c1-f5d7-4796-a5e0-f52815c6efd0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:20.886175 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c05d1c1-f5d7-4796-a5e0-f52815c6efd0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:20.886617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c05d1c1-f5d7-4796-a5e0-f52815c6efd0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:20.887362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c05d1c1-f5d7-4796-a5e0-f52815c6efd0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:20.887784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c05d1c1-f5d7-4796-a5e0-f52815c6efd0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:20.999985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e4ef190-2a49-426e-83c2-480196f29efd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:21.000601 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9e4ef190-2a49-426e-83c2-480196f29efd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:21.007447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4ef190-2a49-426e-83c2-480196f29efd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:21.007902 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4ef190-2a49-426e-83c2-480196f29efd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:21.008675 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4ef190-2a49-426e-83c2-480196f29efd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:21.009158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e4ef190-2a49-426e-83c2-480196f29efd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:21.033833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4c05d1c1-f5d7-4796-a5e0-f52815c6efd0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:21.042092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c05d1c1-f5d7-4796-a5e0-f52815c6efd0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.167058 Apr 11 20:14:21.042657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1498/2975] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:20 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:21.136015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9e4ef190-2a49-426e-83c2-480196f29efd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:21.148177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e4ef190-2a49-426e-83c2-480196f29efd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.152078 Apr 11 20:14:21.149052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1478/2976] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:22.062385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83e1ebb9-97cf-4051-adcd-fe24dd042d5a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:22.063169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83e1ebb9-97cf-4051-adcd-fe24dd042d5a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:22.069876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e1ebb9-97cf-4051-adcd-fe24dd042d5a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:22.070341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e1ebb9-97cf-4051-adcd-fe24dd042d5a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:22.071097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e1ebb9-97cf-4051-adcd-fe24dd042d5a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:22.071528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e1ebb9-97cf-4051-adcd-fe24dd042d5a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:22.168054 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1a86617a-c66e-4288-b4ac-814d2a0416f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:22.168628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1a86617a-c66e-4288-b4ac-814d2a0416f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:22.175051 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a86617a-c66e-4288-b4ac-814d2a0416f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:22.175492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a86617a-c66e-4288-b4ac-814d2a0416f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:22.176251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a86617a-c66e-4288-b4ac-814d2a0416f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:22.176678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a86617a-c66e-4288-b4ac-814d2a0416f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:22.203468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83e1ebb9-97cf-4051-adcd-fe24dd042d5a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:22.211700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83e1ebb9-97cf-4051-adcd-fe24dd042d5a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.155626 Apr 11 20:14:22.212278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1499/2977] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:22 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:22.306648 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1a86617a-c66e-4288-b4ac-814d2a0416f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:22.319617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1a86617a-c66e-4288-b4ac-814d2a0416f6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.155398 Apr 11 20:14:22.320278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1479/2978] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:23.229248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-36c1dfe6-fd14-4bb1-b367-8c9a82a99c99 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:23.229856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-36c1dfe6-fd14-4bb1-b367-8c9a82a99c99 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:23.236313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c1dfe6-fd14-4bb1-b367-8c9a82a99c99 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:23.236756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c1dfe6-fd14-4bb1-b367-8c9a82a99c99 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:23.237659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c1dfe6-fd14-4bb1-b367-8c9a82a99c99 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:23.238082 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c1dfe6-fd14-4bb1-b367-8c9a82a99c99 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:23.339597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e9401a4-8843-4101-9692-770bb4be2f69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:23.340177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e9401a4-8843-4101-9692-770bb4be2f69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:23.346387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e9401a4-8843-4101-9692-770bb4be2f69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:23.346828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e9401a4-8843-4101-9692-770bb4be2f69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:23.347558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e9401a4-8843-4101-9692-770bb4be2f69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:23.347982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e9401a4-8843-4101-9692-770bb4be2f69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:23.367323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-36c1dfe6-fd14-4bb1-b367-8c9a82a99c99 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:23.375470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-36c1dfe6-fd14-4bb1-b367-8c9a82a99c99 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.150260 Apr 11 20:14:23.376011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1500/2979] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:23 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:23.476479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e9401a4-8843-4101-9692-770bb4be2f69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:23.488547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e9401a4-8843-4101-9692-770bb4be2f69 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.152556 Apr 11 20:14:23.489376 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1480/2980] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:24.397186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aedaf2ea-9cee-41a9-9400-fde798c94b38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:24.398143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aedaf2ea-9cee-41a9-9400-fde798c94b38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:24.407835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aedaf2ea-9cee-41a9-9400-fde798c94b38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:24.408300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aedaf2ea-9cee-41a9-9400-fde798c94b38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:24.409093 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aedaf2ea-9cee-41a9-9400-fde798c94b38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:24.409539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aedaf2ea-9cee-41a9-9400-fde798c94b38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:24.506401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-24cda6f8-4d07-4947-9af5-74f75fe10886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:24.507091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-24cda6f8-4d07-4947-9af5-74f75fe10886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:24.513618 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24cda6f8-4d07-4947-9af5-74f75fe10886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:24.514057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24cda6f8-4d07-4947-9af5-74f75fe10886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:24.514812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24cda6f8-4d07-4947-9af5-74f75fe10886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:24.515289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24cda6f8-4d07-4947-9af5-74f75fe10886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:24.548579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aedaf2ea-9cee-41a9-9400-fde798c94b38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:24.558551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aedaf2ea-9cee-41a9-9400-fde798c94b38 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.167810 Apr 11 20:14:24.559736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1501/2981] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:24 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:24.653091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-24cda6f8-4d07-4947-9af5-74f75fe10886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:24.661053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-24cda6f8-4d07-4947-9af5-74f75fe10886 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.158483 Apr 11 20:14:24.661607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1481/2982] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:14:24.678392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:14:24.678595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:14:25.579218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-43593f18-8578-47ab-b378-4c710340163a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:25.579994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-43593f18-8578-47ab-b378-4c710340163a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:25.587665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43593f18-8578-47ab-b378-4c710340163a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:25.588206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43593f18-8578-47ab-b378-4c710340163a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:25.589130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43593f18-8578-47ab-b378-4c710340163a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:25.589631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43593f18-8578-47ab-b378-4c710340163a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:25.678405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5315273-cb1f-4f0c-b9d2-a4899b75f3ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:25.679145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5315273-cb1f-4f0c-b9d2-a4899b75f3ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:25.685867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5315273-cb1f-4f0c-b9d2-a4899b75f3ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:25.686311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5315273-cb1f-4f0c-b9d2-a4899b75f3ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:25.687133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5315273-cb1f-4f0c-b9d2-a4899b75f3ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:25.687588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5315273-cb1f-4f0c-b9d2-a4899b75f3ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:25.722052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-43593f18-8578-47ab-b378-4c710340163a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:25.730491 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-43593f18-8578-47ab-b378-4c710340163a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.157217 Apr 11 20:14:25.731040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1502/2983] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:25 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:25.820965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5315273-cb1f-4f0c-b9d2-a4899b75f3ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:25.829734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5315273-cb1f-4f0c-b9d2-a4899b75f3ba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.155209 Apr 11 20:14:25.830245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1482/2984] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:26.751657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2076d4ba-6d3f-4a2e-b87e-fd01f044183c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:26.752390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2076d4ba-6d3f-4a2e-b87e-fd01f044183c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:26.760571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2076d4ba-6d3f-4a2e-b87e-fd01f044183c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:26.761179 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2076d4ba-6d3f-4a2e-b87e-fd01f044183c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:26.762108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2076d4ba-6d3f-4a2e-b87e-fd01f044183c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:26.762647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2076d4ba-6d3f-4a2e-b87e-fd01f044183c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:26.847879 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ab70036f-bd4a-4301-ab61-61afda268e89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:26.848519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ab70036f-bd4a-4301-ab61-61afda268e89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:26.855007 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab70036f-bd4a-4301-ab61-61afda268e89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:26.855447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab70036f-bd4a-4301-ab61-61afda268e89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:26.856225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab70036f-bd4a-4301-ab61-61afda268e89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:26.856630 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab70036f-bd4a-4301-ab61-61afda268e89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:26.901364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2076d4ba-6d3f-4a2e-b87e-fd01f044183c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:26.909279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2076d4ba-6d3f-4a2e-b87e-fd01f044183c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.163893 Apr 11 20:14:26.909852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1503/2985] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:26 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:26.991864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ab70036f-bd4a-4301-ab61-61afda268e89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:27.000822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ab70036f-bd4a-4301-ab61-61afda268e89 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.158165 Apr 11 20:14:27.001423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1483/2986] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:26 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:14:27.930566 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fb20411c-c74f-4a8a-a9a5-9f1a7cd95ded tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:27.931537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fb20411c-c74f-4a8a-a9a5-9f1a7cd95ded tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:27.940344 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb20411c-c74f-4a8a-a9a5-9f1a7cd95ded tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:27.940784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb20411c-c74f-4a8a-a9a5-9f1a7cd95ded tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:27.941580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb20411c-c74f-4a8a-a9a5-9f1a7cd95ded tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:27.942006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb20411c-c74f-4a8a-a9a5-9f1a7cd95ded tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:28.017911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ba29586-422d-47ef-9c86-b98f0a9b656a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:28.018633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ba29586-422d-47ef-9c86-b98f0a9b656a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:28.025335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ba29586-422d-47ef-9c86-b98f0a9b656a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:28.025789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ba29586-422d-47ef-9c86-b98f0a9b656a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:28.026549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ba29586-422d-47ef-9c86-b98f0a9b656a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:28.026960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ba29586-422d-47ef-9c86-b98f0a9b656a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:28.080224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fb20411c-c74f-4a8a-a9a5-9f1a7cd95ded tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:28.088533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fb20411c-c74f-4a8a-a9a5-9f1a7cd95ded tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.164453 Apr 11 20:14:28.089132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1504/2987] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:27 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:28.169096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ba29586-422d-47ef-9c86-b98f0a9b656a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:28.179114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ba29586-422d-47ef-9c86-b98f0a9b656a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.164950 Apr 11 20:14:28.180048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1484/2988] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:29.106198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6919fcca-6684-43b4-b583-06737e8b153b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:29.106881 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6919fcca-6684-43b4-b583-06737e8b153b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:29.113577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6919fcca-6684-43b4-b583-06737e8b153b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:29.114033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6919fcca-6684-43b4-b583-06737e8b153b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:29.114788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6919fcca-6684-43b4-b583-06737e8b153b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:29.115220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6919fcca-6684-43b4-b583-06737e8b153b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:29.197827 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fa6761db-479b-4b19-b19b-09e42b6a6ca8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:29.198441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fa6761db-479b-4b19-b19b-09e42b6a6ca8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:29.205257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa6761db-479b-4b19-b19b-09e42b6a6ca8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:29.205522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa6761db-479b-4b19-b19b-09e42b6a6ca8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:29.207067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa6761db-479b-4b19-b19b-09e42b6a6ca8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:29.207510 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa6761db-479b-4b19-b19b-09e42b6a6ca8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:29.281971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6919fcca-6684-43b4-b583-06737e8b153b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:29.290431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6919fcca-6684-43b4-b583-06737e8b153b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.188133 Apr 11 20:14:29.291006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1505/2989] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:29 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:29.352725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fa6761db-479b-4b19-b19b-09e42b6a6ca8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:29.361347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fa6761db-479b-4b19-b19b-09e42b6a6ca8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.167387 Apr 11 20:14:29.361918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1485/2990] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:30.311665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5fa68fcd-55c0-46a8-896b-17b0923b67ae tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:30.312489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5fa68fcd-55c0-46a8-896b-17b0923b67ae tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:30.319149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5fa68fcd-55c0-46a8-896b-17b0923b67ae tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:30.319594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5fa68fcd-55c0-46a8-896b-17b0923b67ae tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:30.320354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5fa68fcd-55c0-46a8-896b-17b0923b67ae tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:30.320784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5fa68fcd-55c0-46a8-896b-17b0923b67ae tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:30.379076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-542e68d7-81f6-4c6d-8e3e-f32afc1ed3ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:30.379649 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-542e68d7-81f6-4c6d-8e3e-f32afc1ed3ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:30.386029 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542e68d7-81f6-4c6d-8e3e-f32afc1ed3ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:30.386474 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542e68d7-81f6-4c6d-8e3e-f32afc1ed3ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:30.387222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542e68d7-81f6-4c6d-8e3e-f32afc1ed3ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:30.387647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-542e68d7-81f6-4c6d-8e3e-f32afc1ed3ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:30.485572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5fa68fcd-55c0-46a8-896b-17b0923b67ae tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:30.494240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5fa68fcd-55c0-46a8-896b-17b0923b67ae tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.189010 Apr 11 20:14:30.494823 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1506/2991] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:30 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:30.530840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-542e68d7-81f6-4c6d-8e3e-f32afc1ed3ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:30.543465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-542e68d7-81f6-4c6d-8e3e-f32afc1ed3ed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.167995 Apr 11 20:14:30.544249 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1486/2992] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:31.516313 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8841116a-69f5-4535-b0d6-63d42e4f4f01 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:31.517071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8841116a-69f5-4535-b0d6-63d42e4f4f01 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:31.525621 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8841116a-69f5-4535-b0d6-63d42e4f4f01 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:31.526220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8841116a-69f5-4535-b0d6-63d42e4f4f01 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:31.527226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8841116a-69f5-4535-b0d6-63d42e4f4f01 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:31.527803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8841116a-69f5-4535-b0d6-63d42e4f4f01 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:31.561590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c437d28e-e64c-48fb-9ed8-fe86ae36a7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:31.562300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c437d28e-e64c-48fb-9ed8-fe86ae36a7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:31.569090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c437d28e-e64c-48fb-9ed8-fe86ae36a7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:31.569553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c437d28e-e64c-48fb-9ed8-fe86ae36a7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:31.570309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c437d28e-e64c-48fb-9ed8-fe86ae36a7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:31.570731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c437d28e-e64c-48fb-9ed8-fe86ae36a7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:31.710035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8841116a-69f5-4535-b0d6-63d42e4f4f01 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:31.718530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8841116a-69f5-4535-b0d6-63d42e4f4f01 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.208817 Apr 11 20:14:31.719107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1507/2993] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:31 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:31.736789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c437d28e-e64c-48fb-9ed8-fe86ae36a7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:31.748465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c437d28e-e64c-48fb-9ed8-fe86ae36a7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.190311 Apr 11 20:14:31.749430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1487/2994] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:31 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:32.737185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d1b0f16-3b92-46d6-ad27-7f6f90586d48 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:32.737952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d1b0f16-3b92-46d6-ad27-7f6f90586d48 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:32.744826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d1b0f16-3b92-46d6-ad27-7f6f90586d48 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:32.745322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d1b0f16-3b92-46d6-ad27-7f6f90586d48 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:32.746109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d1b0f16-3b92-46d6-ad27-7f6f90586d48 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:32.746562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d1b0f16-3b92-46d6-ad27-7f6f90586d48 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:32.766109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5c92298-5f3e-4eeb-b8cc-fcfe27a02e10 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:32.766748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5c92298-5f3e-4eeb-b8cc-fcfe27a02e10 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:32.773347 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5c92298-5f3e-4eeb-b8cc-fcfe27a02e10 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:32.773797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5c92298-5f3e-4eeb-b8cc-fcfe27a02e10 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:32.774558 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5c92298-5f3e-4eeb-b8cc-fcfe27a02e10 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:32.774995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5c92298-5f3e-4eeb-b8cc-fcfe27a02e10 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:32.933681 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d1b0f16-3b92-46d6-ad27-7f6f90586d48 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:32.941755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5c92298-5f3e-4eeb-b8cc-fcfe27a02e10 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:32.943662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d1b0f16-3b92-46d6-ad27-7f6f90586d48 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.210629 Apr 11 20:14:32.944364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1508/2995] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:32 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:32.950857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5c92298-5f3e-4eeb-b8cc-fcfe27a02e10 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.188764 Apr 11 20:14:32.951494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1488/2996] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:33.965279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-21dbd171-f26c-4e90-ae1f-6722aebc80e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:33.966417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-21dbd171-f26c-4e90-ae1f-6722aebc80e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:33.971151 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-161fe862-6698-44ab-9ca0-215cc3f4b2c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:33.971761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-161fe862-6698-44ab-9ca0-215cc3f4b2c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:33.973659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21dbd171-f26c-4e90-ae1f-6722aebc80e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:33.974109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21dbd171-f26c-4e90-ae1f-6722aebc80e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:33.974993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21dbd171-f26c-4e90-ae1f-6722aebc80e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:33.975421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21dbd171-f26c-4e90-ae1f-6722aebc80e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:33.978595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-161fe862-6698-44ab-9ca0-215cc3f4b2c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:33.979048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-161fe862-6698-44ab-9ca0-215cc3f4b2c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:33.979773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-161fe862-6698-44ab-9ca0-215cc3f4b2c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:33.980290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-161fe862-6698-44ab-9ca0-215cc3f4b2c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:34.161494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-21dbd171-f26c-4e90-ae1f-6722aebc80e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:34.164286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-161fe862-6698-44ab-9ca0-215cc3f4b2c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:34.169799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-21dbd171-f26c-4e90-ae1f-6722aebc80e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.211078 Apr 11 20:14:34.170495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1509/2997] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:33 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:34.172635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-161fe862-6698-44ab-9ca0-215cc3f4b2c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.207078 Apr 11 20:14:34.173342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1489/2998] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:35.187484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-144778b2-2800-443f-8e78-0d61a6d50f79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:35.188856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-144778b2-2800-443f-8e78-0d61a6d50f79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:35.191082 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-76f80a93-ca48-48d2-9e3b-89c033ecb2a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:35.191695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-76f80a93-ca48-48d2-9e3b-89c033ecb2a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:35.195835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-144778b2-2800-443f-8e78-0d61a6d50f79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:35.196278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-144778b2-2800-443f-8e78-0d61a6d50f79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:35.197129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-144778b2-2800-443f-8e78-0d61a6d50f79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:35.197556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-144778b2-2800-443f-8e78-0d61a6d50f79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:35.198159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76f80a93-ca48-48d2-9e3b-89c033ecb2a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:35.198607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76f80a93-ca48-48d2-9e3b-89c033ecb2a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:35.199363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76f80a93-ca48-48d2-9e3b-89c033ecb2a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:35.199795 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76f80a93-ca48-48d2-9e3b-89c033ecb2a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:35.385904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-76f80a93-ca48-48d2-9e3b-89c033ecb2a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:35.388794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-144778b2-2800-443f-8e78-0d61a6d50f79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:35.394086 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-76f80a93-ca48-48d2-9e3b-89c033ecb2a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.207010 Apr 11 20:14:35.394789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1490/2999] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:35.397216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-144778b2-2800-443f-8e78-0d61a6d50f79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.213481 Apr 11 20:14:35.397772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1510/3000] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:35 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:36.416602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-41f62c4b-03f2-491a-88f7-f1db25913a99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:36.417659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-41f62c4b-03f2-491a-88f7-f1db25913a99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:36.418144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c821e0b-e38e-41bf-a66d-a7c7b8687377 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:36.419091 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c821e0b-e38e-41bf-a66d-a7c7b8687377 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:36.427831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41f62c4b-03f2-491a-88f7-f1db25913a99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:36.428573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41f62c4b-03f2-491a-88f7-f1db25913a99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:36.429496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c821e0b-e38e-41bf-a66d-a7c7b8687377 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:36.429903 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41f62c4b-03f2-491a-88f7-f1db25913a99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:36.430172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c821e0b-e38e-41bf-a66d-a7c7b8687377 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:36.430615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41f62c4b-03f2-491a-88f7-f1db25913a99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:36.431468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c821e0b-e38e-41bf-a66d-a7c7b8687377 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:36.432181 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c821e0b-e38e-41bf-a66d-a7c7b8687377 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:36.619640 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-41f62c4b-03f2-491a-88f7-f1db25913a99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:36.626953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4c821e0b-e38e-41bf-a66d-a7c7b8687377 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:36.628584 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-41f62c4b-03f2-491a-88f7-f1db25913a99 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.219350 Apr 11 20:14:36.629430 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1491/3001] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:36.634937 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c821e0b-e38e-41bf-a66d-a7c7b8687377 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.223125 Apr 11 20:14:36.635458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1511/3002] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:36 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:37.652065 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2961bd3-7bea-4ab8-a6db-8cf6fda061f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:37.652967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2961bd3-7bea-4ab8-a6db-8cf6fda061f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:37.656840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf3d20e5-04a1-4bfa-94eb-059a2a6101a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:37.657482 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cf3d20e5-04a1-4bfa-94eb-059a2a6101a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:37.660657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2961bd3-7bea-4ab8-a6db-8cf6fda061f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:37.661134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2961bd3-7bea-4ab8-a6db-8cf6fda061f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:37.661888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2961bd3-7bea-4ab8-a6db-8cf6fda061f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:37.662315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2961bd3-7bea-4ab8-a6db-8cf6fda061f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:37.664060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf3d20e5-04a1-4bfa-94eb-059a2a6101a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:37.664535 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf3d20e5-04a1-4bfa-94eb-059a2a6101a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:37.665477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf3d20e5-04a1-4bfa-94eb-059a2a6101a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:37.665905 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf3d20e5-04a1-4bfa-94eb-059a2a6101a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:37.843904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2961bd3-7bea-4ab8-a6db-8cf6fda061f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:37.850588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf3d20e5-04a1-4bfa-94eb-059a2a6101a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:37.852232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2961bd3-7bea-4ab8-a6db-8cf6fda061f5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.206724 Apr 11 20:14:37.852821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1492/3003] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:37 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:37.858609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf3d20e5-04a1-4bfa-94eb-059a2a6101a2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.207512 Apr 11 20:14:37.859273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1512/3004] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:37 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:38.874244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-34604fdc-62ba-4df0-960a-beb06aedd332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:38.875297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-34604fdc-62ba-4df0-960a-beb06aedd332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:38.879925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-abba43ae-bd81-4e64-93d1-7f44e3c824d1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:38.880976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-abba43ae-bd81-4e64-93d1-7f44e3c824d1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:38.886077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34604fdc-62ba-4df0-960a-beb06aedd332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:38.887127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34604fdc-62ba-4df0-960a-beb06aedd332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:38.888571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34604fdc-62ba-4df0-960a-beb06aedd332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:38.889501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34604fdc-62ba-4df0-960a-beb06aedd332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:38.890972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abba43ae-bd81-4e64-93d1-7f44e3c824d1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:38.891417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abba43ae-bd81-4e64-93d1-7f44e3c824d1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:38.892164 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abba43ae-bd81-4e64-93d1-7f44e3c824d1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:38.892592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abba43ae-bd81-4e64-93d1-7f44e3c824d1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:39.073498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-34604fdc-62ba-4df0-960a-beb06aedd332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:39.076813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-abba43ae-bd81-4e64-93d1-7f44e3c824d1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:39.081908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-34604fdc-62ba-4df0-960a-beb06aedd332 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.214492 Apr 11 20:14:39.082511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1493/3005] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:39.085159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-abba43ae-bd81-4e64-93d1-7f44e3c824d1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.211514 Apr 11 20:14:39.085717 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1513/3006] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:38 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:40.103142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f3a6c7be-a38e-4773-9226-400cbd17d39f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:40.104070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f3a6c7be-a38e-4773-9226-400cbd17d39f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:40.107027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c452fa18-12aa-4e86-b775-a7a10ca14b4f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:40.108030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c452fa18-12aa-4e86-b775-a7a10ca14b4f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:40.114809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3a6c7be-a38e-4773-9226-400cbd17d39f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:40.115549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3a6c7be-a38e-4773-9226-400cbd17d39f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:40.116801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3a6c7be-a38e-4773-9226-400cbd17d39f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:40.117571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3a6c7be-a38e-4773-9226-400cbd17d39f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:40.118541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c452fa18-12aa-4e86-b775-a7a10ca14b4f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:40.119277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c452fa18-12aa-4e86-b775-a7a10ca14b4f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:40.120537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c452fa18-12aa-4e86-b775-a7a10ca14b4f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:40.121265 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c452fa18-12aa-4e86-b775-a7a10ca14b4f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:40.306943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f3a6c7be-a38e-4773-9226-400cbd17d39f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:40.310029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c452fa18-12aa-4e86-b775-a7a10ca14b4f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:40.315092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f3a6c7be-a38e-4773-9226-400cbd17d39f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.218430 Apr 11 20:14:40.315899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1494/3007] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:40.318051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c452fa18-12aa-4e86-b775-a7a10ca14b4f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.217657 Apr 11 20:14:40.318597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1514/3008] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:40 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:41.336958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4635b3d8-ecff-4935-b281-00d865384d58 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:41.337941 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4635b3d8-ecff-4935-b281-00d865384d58 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:41.339599 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c1ed98a5-41dd-4034-9038-86b2dc47f7c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:41.340610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c1ed98a5-41dd-4034-9038-86b2dc47f7c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:41.348798 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4635b3d8-ecff-4935-b281-00d865384d58 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:41.349589 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4635b3d8-ecff-4935-b281-00d865384d58 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:41.350835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4635b3d8-ecff-4935-b281-00d865384d58 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:41.351083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1ed98a5-41dd-4034-9038-86b2dc47f7c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:41.351544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4635b3d8-ecff-4935-b281-00d865384d58 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:41.351793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1ed98a5-41dd-4034-9038-86b2dc47f7c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:41.352847 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1ed98a5-41dd-4034-9038-86b2dc47f7c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:41.353610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1ed98a5-41dd-4034-9038-86b2dc47f7c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:41.540923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4635b3d8-ecff-4935-b281-00d865384d58 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:41.545436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c1ed98a5-41dd-4034-9038-86b2dc47f7c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:41.549512 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4635b3d8-ecff-4935-b281-00d865384d58 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.219206 Apr 11 20:14:41.550125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1495/3009] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:41 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:41.553850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c1ed98a5-41dd-4034-9038-86b2dc47f7c9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.221127 Apr 11 20:14:41.554414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1515/3010] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:41 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:42.573790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d66a463-019e-46ad-b1e1-24b7e24be9b7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:42.574666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d66a463-019e-46ad-b1e1-24b7e24be9b7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:42.575114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3b483fa-5f44-4ecc-905b-425edaa28dcf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:42.576108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3b483fa-5f44-4ecc-905b-425edaa28dcf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:42.583493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3b483fa-5f44-4ecc-905b-425edaa28dcf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:42.583933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3b483fa-5f44-4ecc-905b-425edaa28dcf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:42.584691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3b483fa-5f44-4ecc-905b-425edaa28dcf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:42.584843 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d66a463-019e-46ad-b1e1-24b7e24be9b7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:42.585210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d66a463-019e-46ad-b1e1-24b7e24be9b7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:42.585366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3b483fa-5f44-4ecc-905b-425edaa28dcf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:42.585969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d66a463-019e-46ad-b1e1-24b7e24be9b7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:42.586391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d66a463-019e-46ad-b1e1-24b7e24be9b7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:42.783418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d66a463-019e-46ad-b1e1-24b7e24be9b7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:42.786641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3b483fa-5f44-4ecc-905b-425edaa28dcf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:42.791679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d66a463-019e-46ad-b1e1-24b7e24be9b7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.227259 Apr 11 20:14:42.792362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1496/3011] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:42.794438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3b483fa-5f44-4ecc-905b-425edaa28dcf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.225895 Apr 11 20:14:42.794990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1516/3012] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:42 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:43.812823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3445d7f5-d68c-4d58-b7d9-a43e7d98b74a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:43.813429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3445d7f5-d68c-4d58-b7d9-a43e7d98b74a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:43.813875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-23a515a6-6555-4bcf-940c-8d9408c4af59 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:43.814488 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-23a515a6-6555-4bcf-940c-8d9408c4af59 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:43.820111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3445d7f5-d68c-4d58-b7d9-a43e7d98b74a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:43.820560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3445d7f5-d68c-4d58-b7d9-a43e7d98b74a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:43.821053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23a515a6-6555-4bcf-940c-8d9408c4af59 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:43.821361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3445d7f5-d68c-4d58-b7d9-a43e7d98b74a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:43.821508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23a515a6-6555-4bcf-940c-8d9408c4af59 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:43.821793 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3445d7f5-d68c-4d58-b7d9-a43e7d98b74a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:43.822222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23a515a6-6555-4bcf-940c-8d9408c4af59 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:43.822650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23a515a6-6555-4bcf-940c-8d9408c4af59 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:44.006946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3445d7f5-d68c-4d58-b7d9-a43e7d98b74a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:44.010102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-23a515a6-6555-4bcf-940c-8d9408c4af59 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:44.015172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3445d7f5-d68c-4d58-b7d9-a43e7d98b74a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.208422 Apr 11 20:14:44.015824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1497/3013] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:44.018542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-23a515a6-6555-4bcf-940c-8d9408c4af59 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.209821 Apr 11 20:14:44.019109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1517/3014] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:43 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:45.033442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0687d11c-dcaa-47c6-8569-8adba473179f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:45.034181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0687d11c-dcaa-47c6-8569-8adba473179f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:45.036954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b700967-80f9-463d-bc8d-06ec92398275 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:45.037763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7b700967-80f9-463d-bc8d-06ec92398275 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:45.043619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0687d11c-dcaa-47c6-8569-8adba473179f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:45.044205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0687d11c-dcaa-47c6-8569-8adba473179f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:45.045425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0687d11c-dcaa-47c6-8569-8adba473179f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:45.046119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0687d11c-dcaa-47c6-8569-8adba473179f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:45.047233 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b700967-80f9-463d-bc8d-06ec92398275 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:45.047722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b700967-80f9-463d-bc8d-06ec92398275 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:45.048527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b700967-80f9-463d-bc8d-06ec92398275 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:45.048998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b700967-80f9-463d-bc8d-06ec92398275 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:45.232771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0687d11c-dcaa-47c6-8569-8adba473179f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:45.236250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7b700967-80f9-463d-bc8d-06ec92398275 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:45.241442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0687d11c-dcaa-47c6-8569-8adba473179f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.212953 Apr 11 20:14:45.242011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1498/3015] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:45.245715 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7b700967-80f9-463d-bc8d-06ec92398275 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.213542 Apr 11 20:14:45.246295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1518/3016] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:45 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:46.264295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aea73c80-4013-464d-aea5-934d765d5e19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:46.265227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aea73c80-4013-464d-aea5-934d765d5e19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:46.266522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a8950fd3-c307-4bbd-afcd-26f205b4052f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:46.267130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a8950fd3-c307-4bbd-afcd-26f205b4052f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:46.272103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aea73c80-4013-464d-aea5-934d765d5e19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:46.272552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aea73c80-4013-464d-aea5-934d765d5e19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:46.273348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aea73c80-4013-464d-aea5-934d765d5e19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:46.273701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8950fd3-c307-4bbd-afcd-26f205b4052f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:46.273862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aea73c80-4013-464d-aea5-934d765d5e19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:46.274149 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8950fd3-c307-4bbd-afcd-26f205b4052f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:46.274897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8950fd3-c307-4bbd-afcd-26f205b4052f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:46.275325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a8950fd3-c307-4bbd-afcd-26f205b4052f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:46.466923 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a8950fd3-c307-4bbd-afcd-26f205b4052f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:46.475588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aea73c80-4013-464d-aea5-934d765d5e19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:46.478225 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a8950fd3-c307-4bbd-afcd-26f205b4052f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.217457 Apr 11 20:14:46.479139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1519/3017] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:46 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:46.486927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aea73c80-4013-464d-aea5-934d765d5e19 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.229243 Apr 11 20:14:46.487537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1499/3018] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:46 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:47.500604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8000c3bb-b78e-4d90-bcc7-aec0b66dfac2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:47.501256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8000c3bb-b78e-4d90-bcc7-aec0b66dfac2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:47.504851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e38adfb1-8225-4d46-a33e-f897f66e553d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:47.505527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e38adfb1-8225-4d46-a33e-f897f66e553d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:47.507774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8000c3bb-b78e-4d90-bcc7-aec0b66dfac2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:47.508227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8000c3bb-b78e-4d90-bcc7-aec0b66dfac2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:47.508983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8000c3bb-b78e-4d90-bcc7-aec0b66dfac2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:47.509497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8000c3bb-b78e-4d90-bcc7-aec0b66dfac2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:47.512077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e38adfb1-8225-4d46-a33e-f897f66e553d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:47.512525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e38adfb1-8225-4d46-a33e-f897f66e553d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:47.513339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e38adfb1-8225-4d46-a33e-f897f66e553d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:47.513759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e38adfb1-8225-4d46-a33e-f897f66e553d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:47.693638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8000c3bb-b78e-4d90-bcc7-aec0b66dfac2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:47.697621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e38adfb1-8225-4d46-a33e-f897f66e553d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:47.701763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8000c3bb-b78e-4d90-bcc7-aec0b66dfac2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.207168 Apr 11 20:14:47.702303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1520/3019] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:47 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:47.706285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e38adfb1-8225-4d46-a33e-f897f66e553d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.205399 Apr 11 20:14:47.706857 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1500/3020] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:48.724007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-00fa55d1-30fe-4bee-a24d-6d82a4a33e29 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:48.724994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-00fa55d1-30fe-4bee-a24d-6d82a4a33e29 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:48.727432 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1568d80-bcad-4cf0-9f53-d28c9c30afb6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:48.728428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1568d80-bcad-4cf0-9f53-d28c9c30afb6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:48.734875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00fa55d1-30fe-4bee-a24d-6d82a4a33e29 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:48.735322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00fa55d1-30fe-4bee-a24d-6d82a4a33e29 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:48.736076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00fa55d1-30fe-4bee-a24d-6d82a4a33e29 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:48.736478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00fa55d1-30fe-4bee-a24d-6d82a4a33e29 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:48.736680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1568d80-bcad-4cf0-9f53-d28c9c30afb6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:48.737194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1568d80-bcad-4cf0-9f53-d28c9c30afb6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:48.737946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1568d80-bcad-4cf0-9f53-d28c9c30afb6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:48.738375 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1568d80-bcad-4cf0-9f53-d28c9c30afb6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:48.928502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-00fa55d1-30fe-4bee-a24d-6d82a4a33e29 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:48.932192 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1568d80-bcad-4cf0-9f53-d28c9c30afb6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:48.936920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-00fa55d1-30fe-4bee-a24d-6d82a4a33e29 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.219319 Apr 11 20:14:48.937485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1521/3021] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:48 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:48.941224 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1568d80-bcad-4cf0-9f53-d28c9c30afb6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.220251 Apr 11 20:14:48.941930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1501/3022] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:49.958612 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f345dbc-af3e-433e-b31f-378e0e743c9e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:49.959653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f345dbc-af3e-433e-b31f-378e0e743c9e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:49.962707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4a4ab8a7-c12c-4b33-a958-2b82b1808357 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:49.963752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4a4ab8a7-c12c-4b33-a958-2b82b1808357 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:49.969562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f345dbc-af3e-433e-b31f-378e0e743c9e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:49.970011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f345dbc-af3e-433e-b31f-378e0e743c9e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:49.970783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f345dbc-af3e-433e-b31f-378e0e743c9e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:49.971206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f345dbc-af3e-433e-b31f-378e0e743c9e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:49.971808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a4ab8a7-c12c-4b33-a958-2b82b1808357 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:49.972256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a4ab8a7-c12c-4b33-a958-2b82b1808357 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:49.973032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a4ab8a7-c12c-4b33-a958-2b82b1808357 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:49.973459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4a4ab8a7-c12c-4b33-a958-2b82b1808357 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:50.171772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f345dbc-af3e-433e-b31f-378e0e743c9e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:50.176140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4a4ab8a7-c12c-4b33-a958-2b82b1808357 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:50.180740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f345dbc-af3e-433e-b31f-378e0e743c9e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.229012 Apr 11 20:14:50.181601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1522/3023] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:49 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:50.186779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4a4ab8a7-c12c-4b33-a958-2b82b1808357 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.230236 Apr 11 20:14:50.187552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1502/3024] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:51.200015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3455f2f8-97ca-4504-8a41-077ac983f01d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:51.200638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3455f2f8-97ca-4504-8a41-077ac983f01d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:51.205733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb022df9-a8d9-4e44-86f4-db68efb655da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:51.206352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb022df9-a8d9-4e44-86f4-db68efb655da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:51.208644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3455f2f8-97ca-4504-8a41-077ac983f01d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:51.209213 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3455f2f8-97ca-4504-8a41-077ac983f01d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:51.209976 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3455f2f8-97ca-4504-8a41-077ac983f01d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:51.210401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3455f2f8-97ca-4504-8a41-077ac983f01d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:51.214567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb022df9-a8d9-4e44-86f4-db68efb655da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:51.215148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb022df9-a8d9-4e44-86f4-db68efb655da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:51.216083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb022df9-a8d9-4e44-86f4-db68efb655da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:51.216810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb022df9-a8d9-4e44-86f4-db68efb655da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:51.396930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3455f2f8-97ca-4504-8a41-077ac983f01d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:51.401141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eb022df9-a8d9-4e44-86f4-db68efb655da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:51.407884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3455f2f8-97ca-4504-8a41-077ac983f01d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.211911 Apr 11 20:14:51.408462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1523/3025] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:51 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:51.410269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb022df9-a8d9-4e44-86f4-db68efb655da tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.208918 Apr 11 20:14:51.410831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1503/3026] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:52.429325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09735940-ae9b-4be3-bf75-49000db260dd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:52.431016 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c07d5f17-39e4-4dd3-a791-0e3448a4247d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:52.431740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09735940-ae9b-4be3-bf75-49000db260dd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:52.431983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c07d5f17-39e4-4dd3-a791-0e3448a4247d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:52.442234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09735940-ae9b-4be3-bf75-49000db260dd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:52.442526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c07d5f17-39e4-4dd3-a791-0e3448a4247d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:52.442903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09735940-ae9b-4be3-bf75-49000db260dd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:52.443177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c07d5f17-39e4-4dd3-a791-0e3448a4247d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:52.444165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09735940-ae9b-4be3-bf75-49000db260dd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:52.444405 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c07d5f17-39e4-4dd3-a791-0e3448a4247d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:52.444960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09735940-ae9b-4be3-bf75-49000db260dd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:52.445269 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c07d5f17-39e4-4dd3-a791-0e3448a4247d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:52.631583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c07d5f17-39e4-4dd3-a791-0e3448a4247d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:52.634643 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09735940-ae9b-4be3-bf75-49000db260dd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:52.639559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c07d5f17-39e4-4dd3-a791-0e3448a4247d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.214844 Apr 11 20:14:52.640196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1504/3027] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:52 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:52.642458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09735940-ae9b-4be3-bf75-49000db260dd tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.219665 Apr 11 20:14:52.643045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1524/3028] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:52 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:53.658686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20b5c4fa-e686-48e3-8070-7682adbc4c93 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:53.659289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-20b5c4fa-e686-48e3-8070-7682adbc4c93 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:53.660549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26f0d970-f5a1-49dc-8750-c1b0bbb9c7b8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:53.661187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-26f0d970-f5a1-49dc-8750-c1b0bbb9c7b8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:53.667242 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20b5c4fa-e686-48e3-8070-7682adbc4c93 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:53.667668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26f0d970-f5a1-49dc-8750-c1b0bbb9c7b8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:53.667841 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20b5c4fa-e686-48e3-8070-7682adbc4c93 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:53.668097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26f0d970-f5a1-49dc-8750-c1b0bbb9c7b8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:53.668607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20b5c4fa-e686-48e3-8070-7682adbc4c93 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:53.668945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26f0d970-f5a1-49dc-8750-c1b0bbb9c7b8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:53.669096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20b5c4fa-e686-48e3-8070-7682adbc4c93 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:53.669403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26f0d970-f5a1-49dc-8750-c1b0bbb9c7b8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:53.856030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20b5c4fa-e686-48e3-8070-7682adbc4c93 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:53.859784 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-26f0d970-f5a1-49dc-8750-c1b0bbb9c7b8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:53.865245 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20b5c4fa-e686-48e3-8070-7682adbc4c93 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.211372 Apr 11 20:14:53.865871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1505/3029] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:53.867950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26f0d970-f5a1-49dc-8750-c1b0bbb9c7b8 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.211500 Apr 11 20:14:53.868512 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1525/3030] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:53 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:54.887526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dd9f07f2-faca-4d64-be80-756b09426cba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:54.888476 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dd9f07f2-faca-4d64-be80-756b09426cba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:54.889372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fead7631-9a80-4fc2-94ad-9fd407c160c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:54.890477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fead7631-9a80-4fc2-94ad-9fd407c160c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:54.898702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd9f07f2-faca-4d64-be80-756b09426cba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:54.899448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd9f07f2-faca-4d64-be80-756b09426cba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:54.900708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd9f07f2-faca-4d64-be80-756b09426cba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:54.901479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd9f07f2-faca-4d64-be80-756b09426cba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:54.901724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fead7631-9a80-4fc2-94ad-9fd407c160c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:54.902216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fead7631-9a80-4fc2-94ad-9fd407c160c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:54.903454 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fead7631-9a80-4fc2-94ad-9fd407c160c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:54.904163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fead7631-9a80-4fc2-94ad-9fd407c160c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:55.316557 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dd9f07f2-faca-4d64-be80-756b09426cba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:55.319790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fead7631-9a80-4fc2-94ad-9fd407c160c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:55.324567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dd9f07f2-faca-4d64-be80-756b09426cba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.443964 Apr 11 20:14:55.325168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1506/3031] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:55.328198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fead7631-9a80-4fc2-94ad-9fd407c160c7 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.445463 Apr 11 20:14:55.328764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1526/3032] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:54 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:56.348006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-26c847a1-b595-4de8-900f-7dab107e3d74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:56.348862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-26c847a1-b595-4de8-900f-7dab107e3d74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:56.349100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-46888d00-0d5f-4a55-bef7-3005450ad23c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:56.350119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-46888d00-0d5f-4a55-bef7-3005450ad23c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:56.359108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26c847a1-b595-4de8-900f-7dab107e3d74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:56.359552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26c847a1-b595-4de8-900f-7dab107e3d74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:56.359714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46888d00-0d5f-4a55-bef7-3005450ad23c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:56.360147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46888d00-0d5f-4a55-bef7-3005450ad23c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:56.360305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26c847a1-b595-4de8-900f-7dab107e3d74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:56.360713 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26c847a1-b595-4de8-900f-7dab107e3d74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:56.360876 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46888d00-0d5f-4a55-bef7-3005450ad23c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:56.361357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46888d00-0d5f-4a55-bef7-3005450ad23c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:56.552685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-26c847a1-b595-4de8-900f-7dab107e3d74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:56.555794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-46888d00-0d5f-4a55-bef7-3005450ad23c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:56.561327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-26c847a1-b595-4de8-900f-7dab107e3d74 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.220002 Apr 11 20:14:56.561922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1507/3033] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:56.563714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-46888d00-0d5f-4a55-bef7-3005450ad23c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.221141 Apr 11 20:14:56.564269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1527/3034] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:56 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:57.582746 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8200a37c-0e9b-477d-b83c-78841da7d6c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:57.583709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8200a37c-0e9b-477d-b83c-78841da7d6c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:57.584263 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bee3c853-63cf-4710-9676-4ac469c9bfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:57.585316 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bee3c853-63cf-4710-9676-4ac469c9bfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:57.594724 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8200a37c-0e9b-477d-b83c-78841da7d6c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:57.595464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8200a37c-0e9b-477d-b83c-78841da7d6c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:57.595836 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bee3c853-63cf-4710-9676-4ac469c9bfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:57.596596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bee3c853-63cf-4710-9676-4ac469c9bfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:57.596881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8200a37c-0e9b-477d-b83c-78841da7d6c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:57.597526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8200a37c-0e9b-477d-b83c-78841da7d6c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:57.597916 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bee3c853-63cf-4710-9676-4ac469c9bfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:57.598647 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bee3c853-63cf-4710-9676-4ac469c9bfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:57.790243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8200a37c-0e9b-477d-b83c-78841da7d6c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:57.793421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bee3c853-63cf-4710-9676-4ac469c9bfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:57.798289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8200a37c-0e9b-477d-b83c-78841da7d6c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.222090 Apr 11 20:14:57.798871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1508/3035] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:57.801406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bee3c853-63cf-4710-9676-4ac469c9bfcb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.223564 Apr 11 20:14:57.801996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1528/3036] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:57 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:58.819723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7aac16fc-0317-4979-9792-87a176e012a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:58.820690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7aac16fc-0317-4979-9792-87a176e012a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:58.823206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2ae44b18-08e7-4c39-8d04-a3f1c26e8af3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:14:58.824250 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2ae44b18-08e7-4c39-8d04-a3f1c26e8af3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:14:58.831554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7aac16fc-0317-4979-9792-87a176e012a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:58.832268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7aac16fc-0317-4979-9792-87a176e012a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:58.833607 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7aac16fc-0317-4979-9792-87a176e012a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:58.834305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ae44b18-08e7-4c39-8d04-a3f1c26e8af3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:58.834592 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7aac16fc-0317-4979-9792-87a176e012a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:58.835039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ae44b18-08e7-4c39-8d04-a3f1c26e8af3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:58.836278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ae44b18-08e7-4c39-8d04-a3f1c26e8af3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:14:58.836990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2ae44b18-08e7-4c39-8d04-a3f1c26e8af3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:14:59.023217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7aac16fc-0317-4979-9792-87a176e012a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:59.026372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2ae44b18-08e7-4c39-8d04-a3f1c26e8af3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:14:59.033845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7aac16fc-0317-4979-9792-87a176e012a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.220568 Apr 11 20:14:59.034246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2ae44b18-08e7-4c39-8d04-a3f1c26e8af3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.217349 Apr 11 20:14:59.043689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1509/3037] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:14:59.047997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1529/3038] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:14:58 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:00.055238 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e3cdc019-63fb-446e-88a4-14db8b0b9c49 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:00.056197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e3cdc019-63fb-446e-88a4-14db8b0b9c49 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:00.066887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3cdc019-63fb-446e-88a4-14db8b0b9c49 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:00.067624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3cdc019-63fb-446e-88a4-14db8b0b9c49 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:00.068853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3cdc019-63fb-446e-88a4-14db8b0b9c49 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:00.069612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3cdc019-63fb-446e-88a4-14db8b0b9c49 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:00.103607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a3090656-0e41-4640-9a60-e336bef6f04c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:00.104211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a3090656-0e41-4640-9a60-e336bef6f04c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:00.111262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3090656-0e41-4640-9a60-e336bef6f04c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:00.111705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3090656-0e41-4640-9a60-e336bef6f04c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:00.112467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3090656-0e41-4640-9a60-e336bef6f04c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:00.112861 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3090656-0e41-4640-9a60-e336bef6f04c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:00.236569 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e3cdc019-63fb-446e-88a4-14db8b0b9c49 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:00.245050 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e3cdc019-63fb-446e-88a4-14db8b0b9c49 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.196389 Apr 11 20:15:00.245657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1510/3039] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:00.274731 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3090656-0e41-4640-9a60-e336bef6f04c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:00.283324 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a3090656-0e41-4640-9a60-e336bef6f04c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.183480 Apr 11 20:15:00.283943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1530/3040] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:00 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:01.265785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81c0a777-02b1-4e1f-857b-9b6b0f4c24c5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:01.266356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81c0a777-02b1-4e1f-857b-9b6b0f4c24c5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:01.273670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81c0a777-02b1-4e1f-857b-9b6b0f4c24c5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:01.274115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81c0a777-02b1-4e1f-857b-9b6b0f4c24c5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:01.274855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81c0a777-02b1-4e1f-857b-9b6b0f4c24c5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:01.275285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81c0a777-02b1-4e1f-857b-9b6b0f4c24c5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:01.301405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4461bbc2-5469-40d8-9858-d4d8887abe28 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:01.301996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4461bbc2-5469-40d8-9858-d4d8887abe28 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:01.308627 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4461bbc2-5469-40d8-9858-d4d8887abe28 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:01.309173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4461bbc2-5469-40d8-9858-d4d8887abe28 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:01.309931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4461bbc2-5469-40d8-9858-d4d8887abe28 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:01.310353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4461bbc2-5469-40d8-9858-d4d8887abe28 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:01.467084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-81c0a777-02b1-4e1f-857b-9b6b0f4c24c5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:01.473362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4461bbc2-5469-40d8-9858-d4d8887abe28 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:01.475574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81c0a777-02b1-4e1f-857b-9b6b0f4c24c5 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.215625 Apr 11 20:15:01.476190 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1511/3041] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:01.481982 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4461bbc2-5469-40d8-9858-d4d8887abe28 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.184421 Apr 11 20:15:01.482542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1531/3042] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:01 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:02.498058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02656f85-11cf-45df-a0ed-e2c3957798a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:02.498896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02656f85-11cf-45df-a0ed-e2c3957798a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:02.501620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1fec40be-66a0-4217-868c-6b7cdffda82b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:02.502221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1fec40be-66a0-4217-868c-6b7cdffda82b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:02.505625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02656f85-11cf-45df-a0ed-e2c3957798a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:02.506067 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02656f85-11cf-45df-a0ed-e2c3957798a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:02.506812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02656f85-11cf-45df-a0ed-e2c3957798a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:02.507259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02656f85-11cf-45df-a0ed-e2c3957798a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:02.508724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fec40be-66a0-4217-868c-6b7cdffda82b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:02.509214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fec40be-66a0-4217-868c-6b7cdffda82b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:02.509968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fec40be-66a0-4217-868c-6b7cdffda82b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:02.510392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fec40be-66a0-4217-868c-6b7cdffda82b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:02.691363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02656f85-11cf-45df-a0ed-e2c3957798a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:02.694476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1fec40be-66a0-4217-868c-6b7cdffda82b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:02.700353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02656f85-11cf-45df-a0ed-e2c3957798a6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.209272 Apr 11 20:15:02.700929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1512/3043] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:02.702894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1fec40be-66a0-4217-868c-6b7cdffda82b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.206418 Apr 11 20:15:02.703468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1532/3044] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:02 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:03.718452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54035e8f-7f1e-495f-8e89-70dd7d837b4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:03.719085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54035e8f-7f1e-495f-8e89-70dd7d837b4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:03.720298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d04005c-6074-4ffe-abd9-3faf0ccc7c4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:03.720992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d04005c-6074-4ffe-abd9-3faf0ccc7c4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:03.725367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54035e8f-7f1e-495f-8e89-70dd7d837b4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:03.725840 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54035e8f-7f1e-495f-8e89-70dd7d837b4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:03.726605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54035e8f-7f1e-495f-8e89-70dd7d837b4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:03.727017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54035e8f-7f1e-495f-8e89-70dd7d837b4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:03.728301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d04005c-6074-4ffe-abd9-3faf0ccc7c4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:03.728741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d04005c-6074-4ffe-abd9-3faf0ccc7c4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:03.729503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d04005c-6074-4ffe-abd9-3faf0ccc7c4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:03.730121 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d04005c-6074-4ffe-abd9-3faf0ccc7c4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:03.913022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54035e8f-7f1e-495f-8e89-70dd7d837b4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:03.919685 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d04005c-6074-4ffe-abd9-3faf0ccc7c4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:03.921461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54035e8f-7f1e-495f-8e89-70dd7d837b4d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.207060 Apr 11 20:15:03.922049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1513/3045] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:03.928034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d04005c-6074-4ffe-abd9-3faf0ccc7c4b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.211528 Apr 11 20:15:03.928632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1533/3046] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:03 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:04.942452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e5ecf83e-9c18-4cb7-8ef3-11be57a04578 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:04.943397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e5ecf83e-9c18-4cb7-8ef3-11be57a04578 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:04.948875 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-882faf20-25f7-4ffb-bead-7490ebe8a885 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:04.949931 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-882faf20-25f7-4ffb-bead-7490ebe8a885 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:04.954459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5ecf83e-9c18-4cb7-8ef3-11be57a04578 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:04.955256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5ecf83e-9c18-4cb7-8ef3-11be57a04578 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:04.956517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5ecf83e-9c18-4cb7-8ef3-11be57a04578 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:04.957327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5ecf83e-9c18-4cb7-8ef3-11be57a04578 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:04.960322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-882faf20-25f7-4ffb-bead-7490ebe8a885 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:04.961126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-882faf20-25f7-4ffb-bead-7490ebe8a885 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:04.962382 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-882faf20-25f7-4ffb-bead-7490ebe8a885 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:04.963101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-882faf20-25f7-4ffb-bead-7490ebe8a885 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:05.149684 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5ecf83e-9c18-4cb7-8ef3-11be57a04578 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:05.153693 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-882faf20-25f7-4ffb-bead-7490ebe8a885 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:05.158420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e5ecf83e-9c18-4cb7-8ef3-11be57a04578 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.222739 Apr 11 20:15:05.158967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1514/3047] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:05.162110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-882faf20-25f7-4ffb-bead-7490ebe8a885 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.219572 Apr 11 20:15:05.162762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1534/3048] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:04 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:15:06.182933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8509f793-67b6-4829-a76d-c4d462071551 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:06.184125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8509f793-67b6-4829-a76d-c4d462071551 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:06.187890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6d97ae70-85e0-4872-9753-81eab4573223 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:06.188477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6d97ae70-85e0-4872-9753-81eab4573223 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:06.192158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8509f793-67b6-4829-a76d-c4d462071551 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:06.192609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8509f793-67b6-4829-a76d-c4d462071551 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:06.193389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8509f793-67b6-4829-a76d-c4d462071551 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:06.193857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8509f793-67b6-4829-a76d-c4d462071551 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:06.195131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d97ae70-85e0-4872-9753-81eab4573223 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:06.195581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d97ae70-85e0-4872-9753-81eab4573223 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:06.196342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d97ae70-85e0-4872-9753-81eab4573223 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:06.196772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d97ae70-85e0-4872-9753-81eab4573223 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:06.378198 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8509f793-67b6-4829-a76d-c4d462071551 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:06.385647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6d97ae70-85e0-4872-9753-81eab4573223 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:06.386394 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8509f793-67b6-4829-a76d-c4d462071551 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.209939 Apr 11 20:15:06.386960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1535/3049] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:06 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:06.393908 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6d97ae70-85e0-4872-9753-81eab4573223 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.211988 Apr 11 20:15:06.394514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1515/3050] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:07.408522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fbb3677b-964c-4dbb-aae1-6da522220452 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:07.409564 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fbb3677b-964c-4dbb-aae1-6da522220452 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:07.414967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bd5e2f02-b8e7-4627-b00a-25b4d9b0e117 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:07.415991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bd5e2f02-b8e7-4627-b00a-25b4d9b0e117 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:07.420129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbb3677b-964c-4dbb-aae1-6da522220452 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:07.420753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbb3677b-964c-4dbb-aae1-6da522220452 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:07.421525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbb3677b-964c-4dbb-aae1-6da522220452 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:07.421974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbb3677b-964c-4dbb-aae1-6da522220452 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:07.424088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd5e2f02-b8e7-4627-b00a-25b4d9b0e117 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:07.424531 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd5e2f02-b8e7-4627-b00a-25b4d9b0e117 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:07.425320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd5e2f02-b8e7-4627-b00a-25b4d9b0e117 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:07.425750 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd5e2f02-b8e7-4627-b00a-25b4d9b0e117 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:07.632102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fbb3677b-964c-4dbb-aae1-6da522220452 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:07.636254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bd5e2f02-b8e7-4627-b00a-25b4d9b0e117 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:07.643167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fbb3677b-964c-4dbb-aae1-6da522220452 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.240818 Apr 11 20:15:07.643941 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1536/3051] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:07 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:07.646179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bd5e2f02-b8e7-4627-b00a-25b4d9b0e117 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.237699 Apr 11 20:15:07.646774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1516/3052] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:08.663739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2338f6e3-9663-44a3-a6f0-b5351346ab30 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:08.664840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2338f6e3-9663-44a3-a6f0-b5351346ab30 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:08.667297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-423ba968-14a5-4bd7-8aa0-b501659fc18a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:08.668321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-423ba968-14a5-4bd7-8aa0-b501659fc18a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:08.675551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2338f6e3-9663-44a3-a6f0-b5351346ab30 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:08.676297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2338f6e3-9663-44a3-a6f0-b5351346ab30 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:08.677601 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2338f6e3-9663-44a3-a6f0-b5351346ab30 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:08.678315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2338f6e3-9663-44a3-a6f0-b5351346ab30 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:08.678993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-423ba968-14a5-4bd7-8aa0-b501659fc18a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:08.679943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-423ba968-14a5-4bd7-8aa0-b501659fc18a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:08.681298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-423ba968-14a5-4bd7-8aa0-b501659fc18a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:08.682002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-423ba968-14a5-4bd7-8aa0-b501659fc18a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:08.868641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2338f6e3-9663-44a3-a6f0-b5351346ab30 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:08.876066 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-423ba968-14a5-4bd7-8aa0-b501659fc18a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:08.877515 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2338f6e3-9663-44a3-a6f0-b5351346ab30 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.220476 Apr 11 20:15:08.878097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1537/3053] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:08 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:08.886997 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-423ba968-14a5-4bd7-8aa0-b501659fc18a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.225910 Apr 11 20:15:08.887762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1517/3054] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:09.903230 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-726d79a7-da14-48fc-9d51-8265af86b258 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:09.904294 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-726d79a7-da14-48fc-9d51-8265af86b258 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:09.906526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84354e81-8e1c-4c2e-b8c0-1d4894261d7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:09.907141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-84354e81-8e1c-4c2e-b8c0-1d4894261d7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:09.911113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-726d79a7-da14-48fc-9d51-8265af86b258 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:09.911556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-726d79a7-da14-48fc-9d51-8265af86b258 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:09.912416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-726d79a7-da14-48fc-9d51-8265af86b258 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:09.912842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-726d79a7-da14-48fc-9d51-8265af86b258 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:09.913781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84354e81-8e1c-4c2e-b8c0-1d4894261d7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:09.914232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84354e81-8e1c-4c2e-b8c0-1d4894261d7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:09.914982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84354e81-8e1c-4c2e-b8c0-1d4894261d7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:09.915415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84354e81-8e1c-4c2e-b8c0-1d4894261d7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:10.098768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-726d79a7-da14-48fc-9d51-8265af86b258 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:10.102738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84354e81-8e1c-4c2e-b8c0-1d4894261d7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:10.107101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-726d79a7-da14-48fc-9d51-8265af86b258 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.210397 Apr 11 20:15:10.107697 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1538/3055] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:09 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:10.110783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-84354e81-8e1c-4c2e-b8c0-1d4894261d7b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.209696 Apr 11 20:15:10.111342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1518/3056] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:11.128752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-626b6a63-8104-4268-81e5-9f55e7a2a5ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:11.129761 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-626b6a63-8104-4268-81e5-9f55e7a2a5ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:11.132736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-893bf322-b0b5-467b-aaf5-54a07e7c3df2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:11.133794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-893bf322-b0b5-467b-aaf5-54a07e7c3df2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:11.140414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-626b6a63-8104-4268-81e5-9f55e7a2a5ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:11.140873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-626b6a63-8104-4268-81e5-9f55e7a2a5ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:11.141678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-626b6a63-8104-4268-81e5-9f55e7a2a5ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:11.142110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-626b6a63-8104-4268-81e5-9f55e7a2a5ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:11.142555 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-893bf322-b0b5-467b-aaf5-54a07e7c3df2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:11.143023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-893bf322-b0b5-467b-aaf5-54a07e7c3df2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:11.143771 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-893bf322-b0b5-467b-aaf5-54a07e7c3df2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:11.144194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-893bf322-b0b5-467b-aaf5-54a07e7c3df2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:11.329729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-626b6a63-8104-4268-81e5-9f55e7a2a5ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:11.332659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-893bf322-b0b5-467b-aaf5-54a07e7c3df2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:11.338043 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-626b6a63-8104-4268-81e5-9f55e7a2a5ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.216309 Apr 11 20:15:11.338657 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1539/3057] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:11 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:11.340624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-893bf322-b0b5-467b-aaf5-54a07e7c3df2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.215250 Apr 11 20:15:11.341212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1519/3058] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:12.359346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8bd65a56-bef2-4031-8adf-32920d0dbe90 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:12.360278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8bd65a56-bef2-4031-8adf-32920d0dbe90 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:12.361852 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-21aa5235-d027-4514-b95e-347f017051f0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:12.362855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-21aa5235-d027-4514-b95e-347f017051f0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:12.371039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8bd65a56-bef2-4031-8adf-32920d0dbe90 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:12.371787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8bd65a56-bef2-4031-8adf-32920d0dbe90 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:12.373478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8bd65a56-bef2-4031-8adf-32920d0dbe90 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:12.374130 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21aa5235-d027-4514-b95e-347f017051f0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:12.374402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8bd65a56-bef2-4031-8adf-32920d0dbe90 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:12.375070 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21aa5235-d027-4514-b95e-347f017051f0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:12.375893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21aa5235-d027-4514-b95e-347f017051f0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:12.376342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21aa5235-d027-4514-b95e-347f017051f0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:12.559684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8bd65a56-bef2-4031-8adf-32920d0dbe90 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:12.568167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8bd65a56-bef2-4031-8adf-32920d0dbe90 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.215563 Apr 11 20:15:12.568626 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1540/3059] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:12 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:12.570828 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21aa5235-d027-4514-b95e-347f017051f0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:12.579368 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-21aa5235-d027-4514-b95e-347f017051f0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.224371 Apr 11 20:15:12.579949 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1520/3060] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:13.588776 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90436611-0f5c-40d3-b93d-d2a7012115ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:13.589678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90436611-0f5c-40d3-b93d-d2a7012115ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:13.598115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a18cf453-f8ca-4f61-bce3-9439e0d40d2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:13.598615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90436611-0f5c-40d3-b93d-d2a7012115ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:13.598615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90436611-0f5c-40d3-b93d-d2a7012115ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:13.598805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a18cf453-f8ca-4f61-bce3-9439e0d40d2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:13.599386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90436611-0f5c-40d3-b93d-d2a7012115ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:13.599819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90436611-0f5c-40d3-b93d-d2a7012115ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:13.605374 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18cf453-f8ca-4f61-bce3-9439e0d40d2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:13.605822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18cf453-f8ca-4f61-bce3-9439e0d40d2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:13.606583 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18cf453-f8ca-4f61-bce3-9439e0d40d2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:13.607019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18cf453-f8ca-4f61-bce3-9439e0d40d2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:13.797918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90436611-0f5c-40d3-b93d-d2a7012115ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:13.801386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a18cf453-f8ca-4f61-bce3-9439e0d40d2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:13.806618 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90436611-0f5c-40d3-b93d-d2a7012115ec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.224460 Apr 11 20:15:13.807405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1541/3061] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:13 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:13.809454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a18cf453-f8ca-4f61-bce3-9439e0d40d2c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.215474 Apr 11 20:15:13.810200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1521/3062] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:14.829372 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3abde1ed-9ca9-42d1-99e5-b5500fc9b7e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:14.830020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3abde1ed-9ca9-42d1-99e5-b5500fc9b7e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:14.830123 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce2a7601-8d80-470c-b975-0e431b9e80ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:14.830734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce2a7601-8d80-470c-b975-0e431b9e80ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:14.836688 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3abde1ed-9ca9-42d1-99e5-b5500fc9b7e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:14.837159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3abde1ed-9ca9-42d1-99e5-b5500fc9b7e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:14.837295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce2a7601-8d80-470c-b975-0e431b9e80ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:14.837717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce2a7601-8d80-470c-b975-0e431b9e80ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:14.837919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3abde1ed-9ca9-42d1-99e5-b5500fc9b7e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:14.838354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3abde1ed-9ca9-42d1-99e5-b5500fc9b7e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:14.838464 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce2a7601-8d80-470c-b975-0e431b9e80ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:14.838897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce2a7601-8d80-470c-b975-0e431b9e80ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:15.024023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3abde1ed-9ca9-42d1-99e5-b5500fc9b7e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:15.030073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce2a7601-8d80-470c-b975-0e431b9e80ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:15.032568 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3abde1ed-9ca9-42d1-99e5-b5500fc9b7e5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.209363 Apr 11 20:15:15.033304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1542/3063] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:14 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:15.037974 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce2a7601-8d80-470c-b975-0e431b9e80ac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.213270 Apr 11 20:15:15.038506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1522/3064] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:16.052339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-070df932-02f2-4e0f-b612-4e6771ceed86 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:16.053207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-070df932-02f2-4e0f-b612-4e6771ceed86 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:16.058279 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66989879-2d24-40d4-9127-dea3d6db0021 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:16.058957 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-66989879-2d24-40d4-9127-dea3d6db0021 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:16.059733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-070df932-02f2-4e0f-b612-4e6771ceed86 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:16.060159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-070df932-02f2-4e0f-b612-4e6771ceed86 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:16.060934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-070df932-02f2-4e0f-b612-4e6771ceed86 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:16.061386 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-070df932-02f2-4e0f-b612-4e6771ceed86 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:16.065362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66989879-2d24-40d4-9127-dea3d6db0021 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:16.065804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66989879-2d24-40d4-9127-dea3d6db0021 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:16.066556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66989879-2d24-40d4-9127-dea3d6db0021 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:16.066983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66989879-2d24-40d4-9127-dea3d6db0021 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:16.250036 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-070df932-02f2-4e0f-b612-4e6771ceed86 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:16.253335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-66989879-2d24-40d4-9127-dea3d6db0021 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:16.258257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-070df932-02f2-4e0f-b612-4e6771ceed86 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.209836 Apr 11 20:15:16.259060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1543/3065] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:16 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:16.261668 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-66989879-2d24-40d4-9127-dea3d6db0021 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.207253 Apr 11 20:15:16.262217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1523/3066] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:17.279833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab49e6ec-4d76-4ea2-ae7b-1fd8e16f587e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:17.280673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab49e6ec-4d76-4ea2-ae7b-1fd8e16f587e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:17.283030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56218bc7-f9ae-4ab4-833f-1f80d63b409a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:17.283683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56218bc7-f9ae-4ab4-833f-1f80d63b409a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:17.288293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab49e6ec-4d76-4ea2-ae7b-1fd8e16f587e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:17.288763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab49e6ec-4d76-4ea2-ae7b-1fd8e16f587e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:17.289840 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab49e6ec-4d76-4ea2-ae7b-1fd8e16f587e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:17.290259 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56218bc7-f9ae-4ab4-833f-1f80d63b409a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:17.290428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab49e6ec-4d76-4ea2-ae7b-1fd8e16f587e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:17.290700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56218bc7-f9ae-4ab4-833f-1f80d63b409a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:17.291459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56218bc7-f9ae-4ab4-833f-1f80d63b409a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:17.291897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56218bc7-f9ae-4ab4-833f-1f80d63b409a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:17.481148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab49e6ec-4d76-4ea2-ae7b-1fd8e16f587e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:17.485074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56218bc7-f9ae-4ab4-833f-1f80d63b409a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:17.490435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab49e6ec-4d76-4ea2-ae7b-1fd8e16f587e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.217276 Apr 11 20:15:17.491279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1544/3067] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:17 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:17.493427 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56218bc7-f9ae-4ab4-833f-1f80d63b409a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.217255 Apr 11 20:15:17.493993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1524/3068] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:18.511933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-55442919-f5d6-4f9c-94e5-641e06e7daf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:18.512801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-55442919-f5d6-4f9c-94e5-641e06e7daf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:18.515005 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6bbc1114-1ce3-4908-97dc-4fa8d2cd6c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:18.516015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6bbc1114-1ce3-4908-97dc-4fa8d2cd6c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:18.521270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55442919-f5d6-4f9c-94e5-641e06e7daf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:18.521712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55442919-f5d6-4f9c-94e5-641e06e7daf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:18.522471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55442919-f5d6-4f9c-94e5-641e06e7daf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:18.522892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55442919-f5d6-4f9c-94e5-641e06e7daf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:18.523144 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bbc1114-1ce3-4908-97dc-4fa8d2cd6c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:18.523593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bbc1114-1ce3-4908-97dc-4fa8d2cd6c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:18.524340 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bbc1114-1ce3-4908-97dc-4fa8d2cd6c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:18.524767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6bbc1114-1ce3-4908-97dc-4fa8d2cd6c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:18.707414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-55442919-f5d6-4f9c-94e5-641e06e7daf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:18.710596 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6bbc1114-1ce3-4908-97dc-4fa8d2cd6c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:18.715309 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-55442919-f5d6-4f9c-94e5-641e06e7daf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.210074 Apr 11 20:15:18.715856 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1545/3069] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:18 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:18.718480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6bbc1114-1ce3-4908-97dc-4fa8d2cd6c0c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.210159 Apr 11 20:15:18.719075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1525/3070] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:19.733007 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-65ff3c11-9deb-4fce-9a47-6027f0ef06af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:19.733668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-65ff3c11-9deb-4fce-9a47-6027f0ef06af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:19.735463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1a052f7e-25d2-4f2f-9725-b76f1e8a30c7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:19.736069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1a052f7e-25d2-4f2f-9725-b76f1e8a30c7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:19.740304 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65ff3c11-9deb-4fce-9a47-6027f0ef06af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:19.740751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65ff3c11-9deb-4fce-9a47-6027f0ef06af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:19.741539 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65ff3c11-9deb-4fce-9a47-6027f0ef06af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:19.741963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65ff3c11-9deb-4fce-9a47-6027f0ef06af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:19.742602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a052f7e-25d2-4f2f-9725-b76f1e8a30c7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:19.743047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a052f7e-25d2-4f2f-9725-b76f1e8a30c7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:19.743799 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a052f7e-25d2-4f2f-9725-b76f1e8a30c7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:19.744236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a052f7e-25d2-4f2f-9725-b76f1e8a30c7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:19.925874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-65ff3c11-9deb-4fce-9a47-6027f0ef06af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:19.932695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1a052f7e-25d2-4f2f-9725-b76f1e8a30c7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:19.934220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-65ff3c11-9deb-4fce-9a47-6027f0ef06af tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.205187 Apr 11 20:15:19.934807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1546/3071] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:19 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:19.940689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1a052f7e-25d2-4f2f-9725-b76f1e8a30c7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.209040 Apr 11 20:15:19.941276 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1526/3072] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:20.955503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da376f20-57b8-44aa-a9d5-f5248e5947d2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:20.956211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da376f20-57b8-44aa-a9d5-f5248e5947d2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:20.962518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39f744cb-fc1f-44ba-8292-eb7e13ce830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:20.963303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-39f744cb-fc1f-44ba-8292-eb7e13ce830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:20.963972 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da376f20-57b8-44aa-a9d5-f5248e5947d2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:20.964502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da376f20-57b8-44aa-a9d5-f5248e5947d2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:20.965434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da376f20-57b8-44aa-a9d5-f5248e5947d2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:20.965938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da376f20-57b8-44aa-a9d5-f5248e5947d2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:20.970504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39f744cb-fc1f-44ba-8292-eb7e13ce830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:20.971024 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39f744cb-fc1f-44ba-8292-eb7e13ce830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:20.971898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39f744cb-fc1f-44ba-8292-eb7e13ce830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:20.972394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39f744cb-fc1f-44ba-8292-eb7e13ce830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:21.161853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da376f20-57b8-44aa-a9d5-f5248e5947d2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:21.165112 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-39f744cb-fc1f-44ba-8292-eb7e13ce830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:21.170089 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da376f20-57b8-44aa-a9d5-f5248e5947d2 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.220973 Apr 11 20:15:21.170674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1547/3073] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:20 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:21.175244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39f744cb-fc1f-44ba-8292-eb7e13ce830e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.217266 Apr 11 20:15:21.175853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1527/3074] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:20 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:22.188779 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-47fda1bf-11ce-4cd8-9f3d-8132e95147de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:22.189397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-47fda1bf-11ce-4cd8-9f3d-8132e95147de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:22.193728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1a6188d9-2af7-453e-93bf-2d606054c9c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:22.194488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1a6188d9-2af7-453e-93bf-2d606054c9c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:22.196678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47fda1bf-11ce-4cd8-9f3d-8132e95147de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:22.197172 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47fda1bf-11ce-4cd8-9f3d-8132e95147de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:22.197932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47fda1bf-11ce-4cd8-9f3d-8132e95147de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:22.198364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47fda1bf-11ce-4cd8-9f3d-8132e95147de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:22.201078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a6188d9-2af7-453e-93bf-2d606054c9c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:22.201519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a6188d9-2af7-453e-93bf-2d606054c9c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:22.202272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a6188d9-2af7-453e-93bf-2d606054c9c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:22.202695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a6188d9-2af7-453e-93bf-2d606054c9c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:22.387188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47fda1bf-11ce-4cd8-9f3d-8132e95147de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:22.389993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1a6188d9-2af7-453e-93bf-2d606054c9c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:22.395421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-47fda1bf-11ce-4cd8-9f3d-8132e95147de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.211043 Apr 11 20:15:22.396034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1548/3075] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:22 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:22.398319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1a6188d9-2af7-453e-93bf-2d606054c9c6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.208364 Apr 11 20:15:22.398887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1528/3076] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:23.417752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7d8964c-9b0e-42cd-87be-14ce0b477660 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:23.418763 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7d8964c-9b0e-42cd-87be-14ce0b477660 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:23.419661 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-27977f9d-0de8-4e31-ab72-6a99d3a6043a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:23.420725 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-27977f9d-0de8-4e31-ab72-6a99d3a6043a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:23.428878 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7d8964c-9b0e-42cd-87be-14ce0b477660 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:23.429709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7d8964c-9b0e-42cd-87be-14ce0b477660 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:23.430955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7d8964c-9b0e-42cd-87be-14ce0b477660 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:23.431344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27977f9d-0de8-4e31-ab72-6a99d3a6043a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:23.431675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7d8964c-9b0e-42cd-87be-14ce0b477660 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:23.432117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27977f9d-0de8-4e31-ab72-6a99d3a6043a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:23.433401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27977f9d-0de8-4e31-ab72-6a99d3a6043a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:23.434162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27977f9d-0de8-4e31-ab72-6a99d3a6043a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:23.622483 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a7d8964c-9b0e-42cd-87be-14ce0b477660 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:23.629788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-27977f9d-0de8-4e31-ab72-6a99d3a6043a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:23.631409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7d8964c-9b0e-42cd-87be-14ce0b477660 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.220219 Apr 11 20:15:23.631999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1549/3077] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:23 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:23.637994 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-27977f9d-0de8-4e31-ab72-6a99d3a6043a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.224780 Apr 11 20:15:23.638526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1529/3078] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:24.653804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48fb0fb8-37b3-4c1a-94bc-0debe51bd776 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:24.654683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-48fb0fb8-37b3-4c1a-94bc-0debe51bd776 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:24.659158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a24688a0-8667-4e9d-8e3d-666f54aaa01c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:24.660487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a24688a0-8667-4e9d-8e3d-666f54aaa01c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:24.665272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48fb0fb8-37b3-4c1a-94bc-0debe51bd776 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:24.666064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48fb0fb8-37b3-4c1a-94bc-0debe51bd776 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:24.667319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48fb0fb8-37b3-4c1a-94bc-0debe51bd776 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:24.668090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48fb0fb8-37b3-4c1a-94bc-0debe51bd776 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:24.670999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a24688a0-8667-4e9d-8e3d-666f54aaa01c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:24.671741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a24688a0-8667-4e9d-8e3d-666f54aaa01c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:24.673048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a24688a0-8667-4e9d-8e3d-666f54aaa01c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:24.673777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a24688a0-8667-4e9d-8e3d-666f54aaa01c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:24.860152 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-48fb0fb8-37b3-4c1a-94bc-0debe51bd776 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:24.863256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a24688a0-8667-4e9d-8e3d-666f54aaa01c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:24.868496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-48fb0fb8-37b3-4c1a-94bc-0debe51bd776 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.221769 Apr 11 20:15:24.869113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1550/3079] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:24 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:24.871611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a24688a0-8667-4e9d-8e3d-666f54aaa01c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.218973 Apr 11 20:15:24.872153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1530/3080] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:15:25.738600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:15:25.739399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:15:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:15:25.887901 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eefd776b-671c-4eec-932c-b5b780f583f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:25.888519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eefd776b-671c-4eec-932c-b5b780f583f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:25.889234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a7954b7c-0ab8-4d1e-919f-35396fc7bf43 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:25.889875 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a7954b7c-0ab8-4d1e-919f-35396fc7bf43 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:25.895126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eefd776b-671c-4eec-932c-b5b780f583f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:25.895572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eefd776b-671c-4eec-932c-b5b780f583f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:25.896334 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eefd776b-671c-4eec-932c-b5b780f583f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:25.896764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eefd776b-671c-4eec-932c-b5b780f583f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:25.896947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7954b7c-0ab8-4d1e-919f-35396fc7bf43 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:25.897252 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7954b7c-0ab8-4d1e-919f-35396fc7bf43 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:25.898002 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7954b7c-0ab8-4d1e-919f-35396fc7bf43 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:25.898425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7954b7c-0ab8-4d1e-919f-35396fc7bf43 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:26.082061 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eefd776b-671c-4eec-932c-b5b780f583f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:26.085125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a7954b7c-0ab8-4d1e-919f-35396fc7bf43 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:26.090420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eefd776b-671c-4eec-932c-b5b780f583f3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.207022 Apr 11 20:15:26.091125 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1551/3081] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:25 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:26.092935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a7954b7c-0ab8-4d1e-919f-35396fc7bf43 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.207700 Apr 11 20:15:26.093524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1531/3082] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:25 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:27.111964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-12069193-80e4-4baf-a5b1-369962de664f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:27.112939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-12069193-80e4-4baf-a5b1-369962de664f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:27.115397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-93627ff0-d6be-437e-a8a4-1e4a1ca483fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:27.116466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-93627ff0-d6be-437e-a8a4-1e4a1ca483fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:27.123807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12069193-80e4-4baf-a5b1-369962de664f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:27.124551 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12069193-80e4-4baf-a5b1-369962de664f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:27.125852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12069193-80e4-4baf-a5b1-369962de664f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:27.126571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12069193-80e4-4baf-a5b1-369962de664f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:27.129402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93627ff0-d6be-437e-a8a4-1e4a1ca483fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:27.129621 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93627ff0-d6be-437e-a8a4-1e4a1ca483fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:27.130359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93627ff0-d6be-437e-a8a4-1e4a1ca483fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:27.130797 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93627ff0-d6be-437e-a8a4-1e4a1ca483fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:27.318963 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-12069193-80e4-4baf-a5b1-369962de664f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:27.322599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-93627ff0-d6be-437e-a8a4-1e4a1ca483fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:27.326975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-12069193-80e4-4baf-a5b1-369962de664f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.221908 Apr 11 20:15:27.327553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1552/3083] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:27 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:27.330626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-93627ff0-d6be-437e-a8a4-1e4a1ca483fb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.221738 Apr 11 20:15:27.331178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1532/3084] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:27 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:28.348405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99af0414-a188-43b5-a5e4-171c5f106751 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:28.349430 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99af0414-a188-43b5-a5e4-171c5f106751 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:28.351893 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b309ec19-ce78-4ea6-bd2b-80316ba5c4cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:28.352890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b309ec19-ce78-4ea6-bd2b-80316ba5c4cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:28.360117 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99af0414-a188-43b5-a5e4-171c5f106751 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:28.360867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99af0414-a188-43b5-a5e4-171c5f106751 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:28.362211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99af0414-a188-43b5-a5e4-171c5f106751 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:28.362897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99af0414-a188-43b5-a5e4-171c5f106751 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:28.363494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b309ec19-ce78-4ea6-bd2b-80316ba5c4cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:28.363937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b309ec19-ce78-4ea6-bd2b-80316ba5c4cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:28.364691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b309ec19-ce78-4ea6-bd2b-80316ba5c4cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:28.365149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b309ec19-ce78-4ea6-bd2b-80316ba5c4cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:28.550709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99af0414-a188-43b5-a5e4-171c5f106751 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:28.555423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b309ec19-ce78-4ea6-bd2b-80316ba5c4cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:28.560969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99af0414-a188-43b5-a5e4-171c5f106751 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.218576 Apr 11 20:15:28.561738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1553/3085] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:28 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:28.567126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b309ec19-ce78-4ea6-bd2b-80316ba5c4cd tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.221564 Apr 11 20:15:28.567658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1533/3086] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:28 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:29.584183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09bf307b-7efd-40b9-9c11-82ff7c1948de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:29.585218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09bf307b-7efd-40b9-9c11-82ff7c1948de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:29.588821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77e658d0-93d4-4fe2-96a6-88ccfec86fed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:29.589844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77e658d0-93d4-4fe2-96a6-88ccfec86fed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:29.596078 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09bf307b-7efd-40b9-9c11-82ff7c1948de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:29.596809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09bf307b-7efd-40b9-9c11-82ff7c1948de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:29.597988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09bf307b-7efd-40b9-9c11-82ff7c1948de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:29.598412 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09bf307b-7efd-40b9-9c11-82ff7c1948de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:29.599437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77e658d0-93d4-4fe2-96a6-88ccfec86fed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:29.599881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77e658d0-93d4-4fe2-96a6-88ccfec86fed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:29.600650 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77e658d0-93d4-4fe2-96a6-88ccfec86fed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:29.601115 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77e658d0-93d4-4fe2-96a6-88ccfec86fed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:29.789137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09bf307b-7efd-40b9-9c11-82ff7c1948de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:29.796174 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77e658d0-93d4-4fe2-96a6-88ccfec86fed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:29.797605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09bf307b-7efd-40b9-9c11-82ff7c1948de tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.220001 Apr 11 20:15:29.798189 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1554/3087] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:29 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:29.804232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77e658d0-93d4-4fe2-96a6-88ccfec86fed tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.222981 Apr 11 20:15:29.804785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1534/3088] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:29 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:30.818742 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-071dfe82-2f75-458b-b327-39225006a67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:30.819478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-071dfe82-2f75-458b-b327-39225006a67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:30.826283 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3fa8c247-f4e9-4494-bafc-4110c990f91f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:30.826907 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-071dfe82-2f75-458b-b327-39225006a67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:30.827446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-071dfe82-2f75-458b-b327-39225006a67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:30.827895 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3fa8c247-f4e9-4494-bafc-4110c990f91f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:30.828296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-071dfe82-2f75-458b-b327-39225006a67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:30.828783 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-071dfe82-2f75-458b-b327-39225006a67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:30.835645 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fa8c247-f4e9-4494-bafc-4110c990f91f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:30.836166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fa8c247-f4e9-4494-bafc-4110c990f91f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:30.837048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fa8c247-f4e9-4494-bafc-4110c990f91f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:30.837595 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fa8c247-f4e9-4494-bafc-4110c990f91f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:31.016104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-071dfe82-2f75-458b-b327-39225006a67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:31.019330 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3fa8c247-f4e9-4494-bafc-4110c990f91f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:31.024095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-071dfe82-2f75-458b-b327-39225006a67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.211096 Apr 11 20:15:31.024787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1555/3089] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:30 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:31.027871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3fa8c247-f4e9-4494-bafc-4110c990f91f tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.206334 Apr 11 20:15:31.028399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1535/3090] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:30 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:32.045935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e687b41f-0770-48c2-84b1-9afcf71f5515 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:32.046985 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e687b41f-0770-48c2-84b1-9afcf71f5515 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:32.048611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0faefce3-5a38-49b8-949c-46b2d186ca6a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:32.049659 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0faefce3-5a38-49b8-949c-46b2d186ca6a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:32.055470 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e687b41f-0770-48c2-84b1-9afcf71f5515 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:32.055914 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e687b41f-0770-48c2-84b1-9afcf71f5515 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:32.056670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e687b41f-0770-48c2-84b1-9afcf71f5515 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:32.056939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0faefce3-5a38-49b8-949c-46b2d186ca6a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:32.057100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e687b41f-0770-48c2-84b1-9afcf71f5515 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:32.057429 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0faefce3-5a38-49b8-949c-46b2d186ca6a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:32.058185 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0faefce3-5a38-49b8-949c-46b2d186ca6a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:32.058586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0faefce3-5a38-49b8-949c-46b2d186ca6a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:32.243131 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e687b41f-0770-48c2-84b1-9afcf71f5515 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:32.247197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0faefce3-5a38-49b8-949c-46b2d186ca6a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:32.251862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e687b41f-0770-48c2-84b1-9afcf71f5515 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.212534 Apr 11 20:15:32.252449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1556/3091] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:32 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:32.256153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0faefce3-5a38-49b8-949c-46b2d186ca6a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.213841 Apr 11 20:15:32.256715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1536/3092] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:32 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:15:33.269547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f72f7a4c-dd72-4f32-b435-63abb8d23d17 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:33.270210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f72f7a4c-dd72-4f32-b435-63abb8d23d17 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:33.274033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2572fa52-ea28-4208-9582-86db22abc250 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:33.274706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2572fa52-ea28-4208-9582-86db22abc250 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:33.277829 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f72f7a4c-dd72-4f32-b435-63abb8d23d17 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:33.278321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f72f7a4c-dd72-4f32-b435-63abb8d23d17 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:33.279197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f72f7a4c-dd72-4f32-b435-63abb8d23d17 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:33.279702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f72f7a4c-dd72-4f32-b435-63abb8d23d17 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:33.281888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2572fa52-ea28-4208-9582-86db22abc250 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:33.282384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2572fa52-ea28-4208-9582-86db22abc250 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:33.283243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2572fa52-ea28-4208-9582-86db22abc250 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:33.283717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2572fa52-ea28-4208-9582-86db22abc250 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:33.465049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f72f7a4c-dd72-4f32-b435-63abb8d23d17 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:33.471736 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2572fa52-ea28-4208-9582-86db22abc250 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:33.474424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f72f7a4c-dd72-4f32-b435-63abb8d23d17 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.208932 Apr 11 20:15:33.475426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1557/3093] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:33 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:33.485537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2572fa52-ea28-4208-9582-86db22abc250 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.215728 Apr 11 20:15:33.486121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1537/3094] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:33 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:34.495995 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bad57b68-069b-4649-9d12-6bfcfc70301a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:34.497017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bad57b68-069b-4649-9d12-6bfcfc70301a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:34.505832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2f104ee-be07-4cd3-9744-44c5f6fb9b4c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:34.506540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2f104ee-be07-4cd3-9744-44c5f6fb9b4c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:34.506714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bad57b68-069b-4649-9d12-6bfcfc70301a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:34.506989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bad57b68-069b-4649-9d12-6bfcfc70301a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:34.507790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bad57b68-069b-4649-9d12-6bfcfc70301a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:34.508222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bad57b68-069b-4649-9d12-6bfcfc70301a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:34.512742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2f104ee-be07-4cd3-9744-44c5f6fb9b4c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:34.513222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2f104ee-be07-4cd3-9744-44c5f6fb9b4c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:34.513991 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2f104ee-be07-4cd3-9744-44c5f6fb9b4c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:34.514420 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2f104ee-be07-4cd3-9744-44c5f6fb9b4c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:34.696550 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2f104ee-be07-4cd3-9744-44c5f6fb9b4c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:34.699530 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bad57b68-069b-4649-9d12-6bfcfc70301a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:34.705623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2f104ee-be07-4cd3-9744-44c5f6fb9b4c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.205079 Apr 11 20:15:34.706290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1538/3095] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:34 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:15:34.707710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bad57b68-069b-4649-9d12-6bfcfc70301a tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.218328 Apr 11 20:15:34.708269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1558/3096] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:34 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:35.724294 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d00785b3-3de3-4f36-84d2-d3c9109d6543 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:35.725072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d00785b3-3de3-4f36-84d2-d3c9109d6543 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:35.725958 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b1f1bbf-5b3c-4828-b95f-36e8d58cacf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:35.726684 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b1f1bbf-5b3c-4828-b95f-36e8d58cacf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:35.732749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d00785b3-3de3-4f36-84d2-d3c9109d6543 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:35.733315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d00785b3-3de3-4f36-84d2-d3c9109d6543 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:35.734186 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d00785b3-3de3-4f36-84d2-d3c9109d6543 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:35.734360 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b1f1bbf-5b3c-4828-b95f-36e8d58cacf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:35.734683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d00785b3-3de3-4f36-84d2-d3c9109d6543 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:35.734858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b1f1bbf-5b3c-4828-b95f-36e8d58cacf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:35.735641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b1f1bbf-5b3c-4828-b95f-36e8d58cacf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:35.736144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b1f1bbf-5b3c-4828-b95f-36e8d58cacf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:35.924009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d00785b3-3de3-4f36-84d2-d3c9109d6543 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:35.927144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b1f1bbf-5b3c-4828-b95f-36e8d58cacf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:35.932104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d00785b3-3de3-4f36-84d2-d3c9109d6543 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.212462 Apr 11 20:15:35.933012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1539/3097] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:35 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:35.935030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b1f1bbf-5b3c-4828-b95f-36e8d58cacf6 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.213786 Apr 11 20:15:35.935555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1559/3098] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:35 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:36.954307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-80d319d1-bba8-421d-a282-704c1037e71c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:36.955258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-80d319d1-bba8-421d-a282-704c1037e71c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:36.955766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b55f8de2-92e3-4b9a-9dd1-85988bc77e7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:36.956807 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b55f8de2-92e3-4b9a-9dd1-85988bc77e7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:36.966053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80d319d1-bba8-421d-a282-704c1037e71c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:36.966998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80d319d1-bba8-421d-a282-704c1037e71c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:36.967276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b55f8de2-92e3-4b9a-9dd1-85988bc77e7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:36.967920 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b55f8de2-92e3-4b9a-9dd1-85988bc77e7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:36.968270 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80d319d1-bba8-421d-a282-704c1037e71c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:36.968990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80d319d1-bba8-421d-a282-704c1037e71c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:36.969231 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b55f8de2-92e3-4b9a-9dd1-85988bc77e7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:36.969910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b55f8de2-92e3-4b9a-9dd1-85988bc77e7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:37.378794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-80d319d1-bba8-421d-a282-704c1037e71c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:37.382092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b55f8de2-92e3-4b9a-9dd1-85988bc77e7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:37.387810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-80d319d1-bba8-421d-a282-704c1037e71c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.440319 Apr 11 20:15:37.388423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1540/3099] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:36 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:37.389927 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b55f8de2-92e3-4b9a-9dd1-85988bc77e7f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.440372 Apr 11 20:15:37.390461 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1560/3100] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:36 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:38.409459 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f13ae07e-9352-43e4-b8cd-dc33fc62b8e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:38.410314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f13ae07e-9352-43e4-b8cd-dc33fc62b8e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:38.410867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-827d4bb0-b4dc-4353-a93d-69563f092678 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:38.411477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-827d4bb0-b4dc-4353-a93d-69563f092678 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:38.416624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f13ae07e-9352-43e4-b8cd-dc33fc62b8e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:38.417119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f13ae07e-9352-43e4-b8cd-dc33fc62b8e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:38.417872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f13ae07e-9352-43e4-b8cd-dc33fc62b8e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:38.418034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827d4bb0-b4dc-4353-a93d-69563f092678 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:38.418298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f13ae07e-9352-43e4-b8cd-dc33fc62b8e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:38.418457 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827d4bb0-b4dc-4353-a93d-69563f092678 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:38.419232 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827d4bb0-b4dc-4353-a93d-69563f092678 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:38.419659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827d4bb0-b4dc-4353-a93d-69563f092678 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:38.617048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f13ae07e-9352-43e4-b8cd-dc33fc62b8e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:38.626236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-827d4bb0-b4dc-4353-a93d-69563f092678 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:38.632129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f13ae07e-9352-43e4-b8cd-dc33fc62b8e9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.228903 Apr 11 20:15:38.632975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1541/3101] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:38 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:38.637560 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-827d4bb0-b4dc-4353-a93d-69563f092678 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.232472 Apr 11 20:15:38.638356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1561/3102] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:38 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:39.657468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2fccc570-05e4-49c8-838e-8febef875291 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:39.658582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2fccc570-05e4-49c8-838e-8febef875291 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:39.661143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1fd05248-2b39-4648-af6f-5a962b3fc198 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:39.662077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1fd05248-2b39-4648-af6f-5a962b3fc198 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:39.669362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fccc570-05e4-49c8-838e-8febef875291 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:39.670105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fccc570-05e4-49c8-838e-8febef875291 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:39.671344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fccc570-05e4-49c8-838e-8febef875291 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:39.672052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fccc570-05e4-49c8-838e-8febef875291 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:39.672322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fd05248-2b39-4648-af6f-5a962b3fc198 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:39.673135 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fd05248-2b39-4648-af6f-5a962b3fc198 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:39.674292 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fd05248-2b39-4648-af6f-5a962b3fc198 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:39.675024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fd05248-2b39-4648-af6f-5a962b3fc198 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:39.860608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2fccc570-05e4-49c8-838e-8febef875291 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:39.863966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1fd05248-2b39-4648-af6f-5a962b3fc198 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:39.869179 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2fccc570-05e4-49c8-838e-8febef875291 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.218160 Apr 11 20:15:39.869915 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1542/3103] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:39 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:39.872285 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1fd05248-2b39-4648-af6f-5a962b3fc198 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.217796 Apr 11 20:15:39.873210 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1562/3104] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:39 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:40.887632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8d68c07d-7b8e-48ba-9623-3538eb01f37c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:40.888260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8d68c07d-7b8e-48ba-9623-3538eb01f37c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:40.889978 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-22123872-0729-4bca-809b-5e6a7ed87e79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:40.890586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-22123872-0729-4bca-809b-5e6a7ed87e79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:40.895011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d68c07d-7b8e-48ba-9623-3538eb01f37c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:40.895461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d68c07d-7b8e-48ba-9623-3538eb01f37c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:40.896273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d68c07d-7b8e-48ba-9623-3538eb01f37c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:40.896701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d68c07d-7b8e-48ba-9623-3538eb01f37c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:40.897136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22123872-0729-4bca-809b-5e6a7ed87e79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:40.897578 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22123872-0729-4bca-809b-5e6a7ed87e79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:40.898325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22123872-0729-4bca-809b-5e6a7ed87e79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:40.898746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22123872-0729-4bca-809b-5e6a7ed87e79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:41.084756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8d68c07d-7b8e-48ba-9623-3538eb01f37c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:41.087896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-22123872-0729-4bca-809b-5e6a7ed87e79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:41.093406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8d68c07d-7b8e-48ba-9623-3538eb01f37c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.209772 Apr 11 20:15:41.094487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1543/3105] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:40 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:41.096828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-22123872-0729-4bca-809b-5e6a7ed87e79 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.210682 Apr 11 20:15:41.097563 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1563/3106] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:40 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:42.118646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-549a1326-307d-4598-b81c-bbb83460640b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:42.119499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-549a1326-307d-4598-b81c-bbb83460640b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:42.120658 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e148c2a3-f1fb-45e8-a1d9-e64408356b19 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:42.121493 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e148c2a3-f1fb-45e8-a1d9-e64408356b19 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:42.128492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-549a1326-307d-4598-b81c-bbb83460640b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:42.129128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-549a1326-307d-4598-b81c-bbb83460640b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:42.130220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-549a1326-307d-4598-b81c-bbb83460640b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:42.130707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-549a1326-307d-4598-b81c-bbb83460640b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:42.130903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e148c2a3-f1fb-45e8-a1d9-e64408356b19 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:42.131495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e148c2a3-f1fb-45e8-a1d9-e64408356b19 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:42.132524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e148c2a3-f1fb-45e8-a1d9-e64408356b19 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:42.133267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e148c2a3-f1fb-45e8-a1d9-e64408356b19 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:42.320709 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-549a1326-307d-4598-b81c-bbb83460640b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:42.323904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e148c2a3-f1fb-45e8-a1d9-e64408356b19 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:42.329284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-549a1326-307d-4598-b81c-bbb83460640b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.216880 Apr 11 20:15:42.329871 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1544/3107] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:42 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:42.333276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e148c2a3-f1fb-45e8-a1d9-e64408356b19 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.217371 Apr 11 20:15:42.333934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1564/3108] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:42 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:43.351386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f55be5a7-4690-44ff-aad2-5601a6070bfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:43.352102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f55be5a7-4690-44ff-aad2-5601a6070bfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:43.353035 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ddf1e9d9-261a-429f-a68f-833589c0eab3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:43.353749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ddf1e9d9-261a-429f-a68f-833589c0eab3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:43.360023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f55be5a7-4690-44ff-aad2-5601a6070bfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:43.360543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f55be5a7-4690-44ff-aad2-5601a6070bfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:43.361347 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddf1e9d9-261a-429f-a68f-833589c0eab3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:43.361549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f55be5a7-4690-44ff-aad2-5601a6070bfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:43.361867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddf1e9d9-261a-429f-a68f-833589c0eab3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:43.362012 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f55be5a7-4690-44ff-aad2-5601a6070bfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:43.362746 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddf1e9d9-261a-429f-a68f-833589c0eab3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:43.363251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddf1e9d9-261a-429f-a68f-833589c0eab3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:43.551099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f55be5a7-4690-44ff-aad2-5601a6070bfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:43.555180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ddf1e9d9-261a-429f-a68f-833589c0eab3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:43.559143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f55be5a7-4690-44ff-aad2-5601a6070bfa tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.213382 Apr 11 20:15:43.559692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1545/3109] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:43 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:43.563087 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ddf1e9d9-261a-429f-a68f-833589c0eab3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.215031 Apr 11 20:15:43.563646 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1565/3110] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:43 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:44.577084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7018d550-d0ec-4f07-a85b-a27a260aee8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:44.577665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7018d550-d0ec-4f07-a85b-a27a260aee8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:44.582238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b273b8fb-459a-4267-8fc1-ed9202c2ac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:44.582850 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b273b8fb-459a-4267-8fc1-ed9202c2ac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:44.584460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7018d550-d0ec-4f07-a85b-a27a260aee8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:44.584918 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7018d550-d0ec-4f07-a85b-a27a260aee8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:44.586057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7018d550-d0ec-4f07-a85b-a27a260aee8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:44.586194 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7018d550-d0ec-4f07-a85b-a27a260aee8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:44.589298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b273b8fb-459a-4267-8fc1-ed9202c2ac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:44.589750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b273b8fb-459a-4267-8fc1-ed9202c2ac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:44.590502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b273b8fb-459a-4267-8fc1-ed9202c2ac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:44.590935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b273b8fb-459a-4267-8fc1-ed9202c2ac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:44.773983 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7018d550-d0ec-4f07-a85b-a27a260aee8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:44.779137 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b273b8fb-459a-4267-8fc1-ed9202c2ac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:44.785829 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7018d550-d0ec-4f07-a85b-a27a260aee8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.212396 Apr 11 20:15:44.786877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1546/3111] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:44 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:44.789942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b273b8fb-459a-4267-8fc1-ed9202c2ac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.211515 Apr 11 20:15:44.790549 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1566/3112] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:44 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:45.806215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c74efe1-a792-417d-ad1a-89535f691dba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:45.806836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c74efe1-a792-417d-ad1a-89535f691dba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:45.808221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1571ecdd-06cc-4066-93ec-b07f69669c87 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:45.808828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1571ecdd-06cc-4066-93ec-b07f69669c87 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:45.813326 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c74efe1-a792-417d-ad1a-89535f691dba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:45.813781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c74efe1-a792-417d-ad1a-89535f691dba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:45.814552 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c74efe1-a792-417d-ad1a-89535f691dba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:45.814982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c74efe1-a792-417d-ad1a-89535f691dba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:45.815478 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1571ecdd-06cc-4066-93ec-b07f69669c87 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:45.816176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1571ecdd-06cc-4066-93ec-b07f69669c87 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:45.816933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1571ecdd-06cc-4066-93ec-b07f69669c87 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:45.817374 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1571ecdd-06cc-4066-93ec-b07f69669c87 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:46.011412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7c74efe1-a792-417d-ad1a-89535f691dba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:46.015615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1571ecdd-06cc-4066-93ec-b07f69669c87 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:46.019922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c74efe1-a792-417d-ad1a-89535f691dba tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.218384 Apr 11 20:15:46.020490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1547/3113] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:45 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:46.024161 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1571ecdd-06cc-4066-93ec-b07f69669c87 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.220125 Apr 11 20:15:46.024863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1567/3114] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:45 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:47.042603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eaa4a134-e397-41db-93b8-322042a9ea8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:47.043597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eaa4a134-e397-41db-93b8-322042a9ea8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:47.045561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aca269de-7b18-4fc2-8950-d6bc9522a309 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:47.046559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aca269de-7b18-4fc2-8950-d6bc9522a309 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:47.054543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eaa4a134-e397-41db-93b8-322042a9ea8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:47.056105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eaa4a134-e397-41db-93b8-322042a9ea8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:47.057391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eaa4a134-e397-41db-93b8-322042a9ea8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:47.057639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aca269de-7b18-4fc2-8950-d6bc9522a309 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:47.058113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eaa4a134-e397-41db-93b8-322042a9ea8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:47.058346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aca269de-7b18-4fc2-8950-d6bc9522a309 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:47.059391 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aca269de-7b18-4fc2-8950-d6bc9522a309 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:47.060105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aca269de-7b18-4fc2-8950-d6bc9522a309 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:47.248436 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eaa4a134-e397-41db-93b8-322042a9ea8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:47.251596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aca269de-7b18-4fc2-8950-d6bc9522a309 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:47.256674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eaa4a134-e397-41db-93b8-322042a9ea8d tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.220698 Apr 11 20:15:47.257284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1548/3115] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:47 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:47.259581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aca269de-7b18-4fc2-8950-d6bc9522a309 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.220419 Apr 11 20:15:47.260173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1568/3116] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:47 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:48.278755 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9aeefafa-2e95-450d-a9f2-5b225430fbc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:48.279821 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9aeefafa-2e95-450d-a9f2-5b225430fbc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:48.280542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6845a87-bb45-441e-a83a-68ae8dace7a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:48.281580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6845a87-bb45-441e-a83a-68ae8dace7a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:48.290028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aeefafa-2e95-450d-a9f2-5b225430fbc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:48.290762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aeefafa-2e95-450d-a9f2-5b225430fbc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:48.291308 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6845a87-bb45-441e-a83a-68ae8dace7a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:48.292086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6845a87-bb45-441e-a83a-68ae8dace7a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:48.292337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aeefafa-2e95-450d-a9f2-5b225430fbc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:48.292770 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aeefafa-2e95-450d-a9f2-5b225430fbc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:48.293350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6845a87-bb45-441e-a83a-68ae8dace7a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:48.294062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6845a87-bb45-441e-a83a-68ae8dace7a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:48.491990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9aeefafa-2e95-450d-a9f2-5b225430fbc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:48.495009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6845a87-bb45-441e-a83a-68ae8dace7a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:48.500363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9aeefafa-2e95-450d-a9f2-5b225430fbc1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.228949 Apr 11 20:15:48.500930 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1549/3117] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:48 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:48.503519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6845a87-bb45-441e-a83a-68ae8dace7a1 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.229326 Apr 11 20:15:48.504083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1569/3118] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:48 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:49.521423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-70d088b9-e03a-4d99-b84f-e292fbe589a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:49.521996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-70d088b9-e03a-4d99-b84f-e292fbe589a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:49.523226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e47e9dd9-3a0d-4c9e-b0f1-56afc4f4c316 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:49.523828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e47e9dd9-3a0d-4c9e-b0f1-56afc4f4c316 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:49.528111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70d088b9-e03a-4d99-b84f-e292fbe589a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:49.528562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70d088b9-e03a-4d99-b84f-e292fbe589a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:49.529359 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70d088b9-e03a-4d99-b84f-e292fbe589a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:49.529783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70d088b9-e03a-4d99-b84f-e292fbe589a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:49.530256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e47e9dd9-3a0d-4c9e-b0f1-56afc4f4c316 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:49.530700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e47e9dd9-3a0d-4c9e-b0f1-56afc4f4c316 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:49.531446 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e47e9dd9-3a0d-4c9e-b0f1-56afc4f4c316 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:49.531868 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e47e9dd9-3a0d-4c9e-b0f1-56afc4f4c316 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:49.723779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-70d088b9-e03a-4d99-b84f-e292fbe589a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:49.726860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e47e9dd9-3a0d-4c9e-b0f1-56afc4f4c316 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:49.732835 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-70d088b9-e03a-4d99-b84f-e292fbe589a8 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.218108 Apr 11 20:15:49.733450 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1550/3119] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:49 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:49.734702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e47e9dd9-3a0d-4c9e-b0f1-56afc4f4c316 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.216767 Apr 11 20:15:49.735327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1570/3120] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:49 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:50.754586 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1acecb1-4e28-4c27-820a-e9c8c9218924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:50.755706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1acecb1-4e28-4c27-820a-e9c8c9218924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:50.756039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-34fd16b6-0c11-4123-b45d-d5145aa3efdb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:50.756669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-34fd16b6-0c11-4123-b45d-d5145aa3efdb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:50.762353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1acecb1-4e28-4c27-820a-e9c8c9218924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:50.762801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1acecb1-4e28-4c27-820a-e9c8c9218924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:50.763321 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34fd16b6-0c11-4123-b45d-d5145aa3efdb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:50.763520 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1acecb1-4e28-4c27-820a-e9c8c9218924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:50.763736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34fd16b6-0c11-4123-b45d-d5145aa3efdb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:50.763947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1acecb1-4e28-4c27-820a-e9c8c9218924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:50.764494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34fd16b6-0c11-4123-b45d-d5145aa3efdb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:50.765146 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34fd16b6-0c11-4123-b45d-d5145aa3efdb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:50.903096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1acecb1-4e28-4c27-820a-e9c8c9218924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:50.912095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1acecb1-4e28-4c27-820a-e9c8c9218924 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.164663 Apr 11 20:15:50.912701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1551/3121] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:50 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:51.074957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-34fd16b6-0c11-4123-b45d-d5145aa3efdb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:51.083587 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-34fd16b6-0c11-4123-b45d-d5145aa3efdb tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.334002 Apr 11 20:15:51.084151 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1571/3122] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:50 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:51.931047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d0ee7f10-ef12-43d2-9b2f-1800ea214cc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:51.931679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d0ee7f10-ef12-43d2-9b2f-1800ea214cc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:51.938428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0ee7f10-ef12-43d2-9b2f-1800ea214cc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:51.938881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0ee7f10-ef12-43d2-9b2f-1800ea214cc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:51.939637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0ee7f10-ef12-43d2-9b2f-1800ea214cc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:51.940062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0ee7f10-ef12-43d2-9b2f-1800ea214cc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:52.068154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d0ee7f10-ef12-43d2-9b2f-1800ea214cc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:52.076039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d0ee7f10-ef12-43d2-9b2f-1800ea214cc4 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.149579 Apr 11 20:15:52.076613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1552/3123] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:51 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:52.102604 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9cf82a0c-509b-4e65-b41e-1c4ec649e14b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:52.103191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9cf82a0c-509b-4e65-b41e-1c4ec649e14b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:52.109853 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9cf82a0c-509b-4e65-b41e-1c4ec649e14b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:52.110299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9cf82a0c-509b-4e65-b41e-1c4ec649e14b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:52.111053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9cf82a0c-509b-4e65-b41e-1c4ec649e14b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:52.111481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9cf82a0c-509b-4e65-b41e-1c4ec649e14b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:52.245239 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9cf82a0c-509b-4e65-b41e-1c4ec649e14b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:52.253421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9cf82a0c-509b-4e65-b41e-1c4ec649e14b tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.155266 Apr 11 20:15:52.253970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1572/3124] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:52 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:53.097434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-954a4249-4fc9-4a1c-93fd-033220d9cb4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:53.098371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-954a4249-4fc9-4a1c-93fd-033220d9cb4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:53.105483 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-954a4249-4fc9-4a1c-93fd-033220d9cb4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:53.105936 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-954a4249-4fc9-4a1c-93fd-033220d9cb4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:53.106701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-954a4249-4fc9-4a1c-93fd-033220d9cb4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:53.107121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-954a4249-4fc9-4a1c-93fd-033220d9cb4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:53.245971 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-954a4249-4fc9-4a1c-93fd-033220d9cb4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:53.256847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-954a4249-4fc9-4a1c-93fd-033220d9cb4b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.165956 Apr 11 20:15:53.257421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1553/3125] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:53 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:53.274120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1355526-587a-4b30-adac-307e2963e6d5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:53.274722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1355526-587a-4b30-adac-307e2963e6d5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:53.280874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1355526-587a-4b30-adac-307e2963e6d5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:53.282008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1355526-587a-4b30-adac-307e2963e6d5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:53.282764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1355526-587a-4b30-adac-307e2963e6d5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:53.283196 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1355526-587a-4b30-adac-307e2963e6d5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:53.412345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1355526-587a-4b30-adac-307e2963e6d5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:53.420291 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1355526-587a-4b30-adac-307e2963e6d5 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.150143 Apr 11 20:15:53.420819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1573/3126] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:53 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:54.278585 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2eb2113a-4b56-4559-b18a-b038dc3520c1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:54.279620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2eb2113a-4b56-4559-b18a-b038dc3520c1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:54.290382 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb2113a-4b56-4559-b18a-b038dc3520c1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:54.291151 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb2113a-4b56-4559-b18a-b038dc3520c1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:54.292378 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb2113a-4b56-4559-b18a-b038dc3520c1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:54.293131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eb2113a-4b56-4559-b18a-b038dc3520c1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:54.434501 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2eb2113a-4b56-4559-b18a-b038dc3520c1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:54.437912 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8116ca1a-8187-407a-af22-5a1f3c7f41d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:54.438559 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8116ca1a-8187-407a-af22-5a1f3c7f41d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:54.442914 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2eb2113a-4b56-4559-b18a-b038dc3520c1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.170821 Apr 11 20:15:54.443448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1554/3127] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:54 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:54.444933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8116ca1a-8187-407a-af22-5a1f3c7f41d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:54.445410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8116ca1a-8187-407a-af22-5a1f3c7f41d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:54.446162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8116ca1a-8187-407a-af22-5a1f3c7f41d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:54.446581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8116ca1a-8187-407a-af22-5a1f3c7f41d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:54.582971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8116ca1a-8187-407a-af22-5a1f3c7f41d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:54.590955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8116ca1a-8187-407a-af22-5a1f3c7f41d9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.156858 Apr 11 20:15:54.591497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1574/3128] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:54 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:55.463471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6d09a23f-d531-45e8-a8e2-ffbbb9cc63e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:55.464287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6d09a23f-d531-45e8-a8e2-ffbbb9cc63e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:55.472958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d09a23f-d531-45e8-a8e2-ffbbb9cc63e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:55.473574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d09a23f-d531-45e8-a8e2-ffbbb9cc63e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:55.474582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d09a23f-d531-45e8-a8e2-ffbbb9cc63e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:55.475155 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d09a23f-d531-45e8-a8e2-ffbbb9cc63e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:55.608029 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fbe7b9cf-a4bb-4a94-a16b-47458d089b32 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:55.608607 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fbe7b9cf-a4bb-4a94-a16b-47458d089b32 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:55.609809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6d09a23f-d531-45e8-a8e2-ffbbb9cc63e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:55.615434 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbe7b9cf-a4bb-4a94-a16b-47458d089b32 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:55.615877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbe7b9cf-a4bb-4a94-a16b-47458d089b32 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:55.616629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbe7b9cf-a4bb-4a94-a16b-47458d089b32 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:55.617080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbe7b9cf-a4bb-4a94-a16b-47458d089b32 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:55.618097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6d09a23f-d531-45e8-a8e2-ffbbb9cc63e3 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.160255 Apr 11 20:15:55.618697 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1555/3129] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:55 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:55.756401 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fbe7b9cf-a4bb-4a94-a16b-47458d089b32 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:55.764736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fbe7b9cf-a4bb-4a94-a16b-47458d089b32 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.160587 Apr 11 20:15:55.765466 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1575/3130] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:55 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:56.636402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cc5b9ae9-46dc-4357-8ada-1af45ccf188a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:56.637000 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc5b9ae9-46dc-4357-8ada-1af45ccf188a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:56.645990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc5b9ae9-46dc-4357-8ada-1af45ccf188a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:56.646704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc5b9ae9-46dc-4357-8ada-1af45ccf188a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:56.647921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc5b9ae9-46dc-4357-8ada-1af45ccf188a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:56.648604 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc5b9ae9-46dc-4357-8ada-1af45ccf188a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:56.782437 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d010025b-9a52-4a0a-a681-2c1eb46e94d3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:56.783034 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d010025b-9a52-4a0a-a681-2c1eb46e94d3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:56.789722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d010025b-9a52-4a0a-a681-2c1eb46e94d3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:56.790176 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d010025b-9a52-4a0a-a681-2c1eb46e94d3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:56.790928 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d010025b-9a52-4a0a-a681-2c1eb46e94d3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:56.791381 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d010025b-9a52-4a0a-a681-2c1eb46e94d3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:56.791554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc5b9ae9-46dc-4357-8ada-1af45ccf188a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:56.799543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cc5b9ae9-46dc-4357-8ada-1af45ccf188a tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.167195 Apr 11 20:15:56.800193 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1556/3131] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:56 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:56.926656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d010025b-9a52-4a0a-a681-2c1eb46e94d3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:56.934768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d010025b-9a52-4a0a-a681-2c1eb46e94d3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.156193 Apr 11 20:15:56.935507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1576/3132] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:56 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:57.820258 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-36b8b32e-1970-4337-a03d-de9273e28060 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:57.821142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-36b8b32e-1970-4337-a03d-de9273e28060 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:57.830511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36b8b32e-1970-4337-a03d-de9273e28060 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:57.831145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36b8b32e-1970-4337-a03d-de9273e28060 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:57.832254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36b8b32e-1970-4337-a03d-de9273e28060 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:57.832861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36b8b32e-1970-4337-a03d-de9273e28060 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:57.953326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b0194e45-0808-4225-959c-b82c47b16d4e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:57.954221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b0194e45-0808-4225-959c-b82c47b16d4e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:57.961009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0194e45-0808-4225-959c-b82c47b16d4e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:57.961458 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0194e45-0808-4225-959c-b82c47b16d4e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:57.962235 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0194e45-0808-4225-959c-b82c47b16d4e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:57.962669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0194e45-0808-4225-959c-b82c47b16d4e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:57.971988 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-36b8b32e-1970-4337-a03d-de9273e28060 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:57.980467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-36b8b32e-1970-4337-a03d-de9273e28060 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.165870 Apr 11 20:15:57.981166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1557/3133] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:57 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:58.093644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b0194e45-0808-4225-959c-b82c47b16d4e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:58.101872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b0194e45-0808-4225-959c-b82c47b16d4e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.152986 Apr 11 20:15:58.102400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1577/3134] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:57 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:59.001810 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20c2d98e-aec7-44ab-ac63-de94ccf6e024 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:59.002778 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-20c2d98e-aec7-44ab-ac63-de94ccf6e024 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:59.010634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20c2d98e-aec7-44ab-ac63-de94ccf6e024 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:59.011053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20c2d98e-aec7-44ab-ac63-de94ccf6e024 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:59.011808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20c2d98e-aec7-44ab-ac63-de94ccf6e024 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:59.012237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20c2d98e-aec7-44ab-ac63-de94ccf6e024 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:59.119127 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d15959d-1328-4fee-ade0-1a63882a8438 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:15:59.119825 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d15959d-1328-4fee-ade0-1a63882a8438 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:15:59.126497 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d15959d-1328-4fee-ade0-1a63882a8438 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:59.126939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d15959d-1328-4fee-ade0-1a63882a8438 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:59.127694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d15959d-1328-4fee-ade0-1a63882a8438 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:15:59.128120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d15959d-1328-4fee-ade0-1a63882a8438 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:15:59.144131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20c2d98e-aec7-44ab-ac63-de94ccf6e024 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:59.153530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20c2d98e-aec7-44ab-ac63-de94ccf6e024 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.158613 Apr 11 20:15:59.154103 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1558/3135] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:58 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:15:59.256133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d15959d-1328-4fee-ade0-1a63882a8438 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:15:59.264464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d15959d-1328-4fee-ade0-1a63882a8438 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.149161 Apr 11 20:15:59.265060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1578/3136] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:15:59 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:16:00.175092 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe573111-1d4c-400d-af00-9272e83c1aac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:00.176037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe573111-1d4c-400d-af00-9272e83c1aac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:00.183438 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe573111-1d4c-400d-af00-9272e83c1aac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:00.183890 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe573111-1d4c-400d-af00-9272e83c1aac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:00.184652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe573111-1d4c-400d-af00-9272e83c1aac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:00.185147 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe573111-1d4c-400d-af00-9272e83c1aac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:00.282992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-42aaecb3-08ae-498f-a576-03ddef681120 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:00.283774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-42aaecb3-08ae-498f-a576-03ddef681120 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:00.290435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42aaecb3-08ae-498f-a576-03ddef681120 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:00.291169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42aaecb3-08ae-498f-a576-03ddef681120 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:00.291915 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42aaecb3-08ae-498f-a576-03ddef681120 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:00.292503 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42aaecb3-08ae-498f-a576-03ddef681120 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:00.337611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe573111-1d4c-400d-af00-9272e83c1aac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:00.345846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe573111-1d4c-400d-af00-9272e83c1aac tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.177285 Apr 11 20:16:00.346417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1559/3137] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:00 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:00.425194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-42aaecb3-08ae-498f-a576-03ddef681120 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:00.437556 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-42aaecb3-08ae-498f-a576-03ddef681120 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.158419 Apr 11 20:16:00.438350 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1579/3138] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:00 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:16:01.367143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3848191d-8a26-4005-a7d5-7dfc624b73bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:01.368138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3848191d-8a26-4005-a7d5-7dfc624b73bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:01.379047 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3848191d-8a26-4005-a7d5-7dfc624b73bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:01.379783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3848191d-8a26-4005-a7d5-7dfc624b73bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:01.381036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3848191d-8a26-4005-a7d5-7dfc624b73bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:01.381468 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3848191d-8a26-4005-a7d5-7dfc624b73bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:01.456328 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27a37fd0-b07c-4a62-9ccd-49a1727ff3b0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:01.456714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27a37fd0-b07c-4a62-9ccd-49a1727ff3b0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:01.463740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27a37fd0-b07c-4a62-9ccd-49a1727ff3b0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:01.464188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27a37fd0-b07c-4a62-9ccd-49a1727ff3b0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:01.464943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27a37fd0-b07c-4a62-9ccd-49a1727ff3b0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:01.465411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27a37fd0-b07c-4a62-9ccd-49a1727ff3b0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:01.522616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3848191d-8a26-4005-a7d5-7dfc624b73bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:01.530591 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3848191d-8a26-4005-a7d5-7dfc624b73bc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.169947 Apr 11 20:16:01.531159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1560/3139] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:01 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:01.611392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27a37fd0-b07c-4a62-9ccd-49a1727ff3b0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:01.620719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27a37fd0-b07c-4a62-9ccd-49a1727ff3b0 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.168710 Apr 11 20:16:01.621327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1580/3140] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:01 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:02.552101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5bdf7c74-e686-4da8-ab4c-06dfea052cf7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:02.553140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5bdf7c74-e686-4da8-ab4c-06dfea052cf7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:02.561731 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bdf7c74-e686-4da8-ab4c-06dfea052cf7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:02.562291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bdf7c74-e686-4da8-ab4c-06dfea052cf7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:02.563235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bdf7c74-e686-4da8-ab4c-06dfea052cf7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:02.563805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bdf7c74-e686-4da8-ab4c-06dfea052cf7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:02.639186 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0c1f338e-1112-41a2-91fd-852098b4c1a3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:02.639764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0c1f338e-1112-41a2-91fd-852098b4c1a3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:02.646567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c1f338e-1112-41a2-91fd-852098b4c1a3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:02.647024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c1f338e-1112-41a2-91fd-852098b4c1a3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:02.647788 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c1f338e-1112-41a2-91fd-852098b4c1a3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:02.648214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c1f338e-1112-41a2-91fd-852098b4c1a3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:02.699254 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5bdf7c74-e686-4da8-ab4c-06dfea052cf7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:02.707214 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5bdf7c74-e686-4da8-ab4c-06dfea052cf7 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.161756 Apr 11 20:16:02.707785 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1561/3141] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:02 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:02.782951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0c1f338e-1112-41a2-91fd-852098b4c1a3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:02.790983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0c1f338e-1112-41a2-91fd-852098b4c1a3 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.155779 Apr 11 20:16:02.791550 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1581/3142] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:02 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:03.723723 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-184dd95a-7b97-41ca-bb8d-521836c245c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:03.724386 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-184dd95a-7b97-41ca-bb8d-521836c245c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:03.731310 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184dd95a-7b97-41ca-bb8d-521836c245c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:03.731757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184dd95a-7b97-41ca-bb8d-521836c245c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:03.732526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184dd95a-7b97-41ca-bb8d-521836c245c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:03.732960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184dd95a-7b97-41ca-bb8d-521836c245c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:03.813395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cff7963b-b501-48bc-ae93-2be842923ad9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:03.814085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cff7963b-b501-48bc-ae93-2be842923ad9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:03.820611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cff7963b-b501-48bc-ae93-2be842923ad9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:03.821182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cff7963b-b501-48bc-ae93-2be842923ad9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:03.822041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cff7963b-b501-48bc-ae93-2be842923ad9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:03.822537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cff7963b-b501-48bc-ae93-2be842923ad9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:03.875518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-184dd95a-7b97-41ca-bb8d-521836c245c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:03.883544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-184dd95a-7b97-41ca-bb8d-521836c245c0 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.163716 Apr 11 20:16:03.884098 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1562/3143] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:03 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:03.961542 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cff7963b-b501-48bc-ae93-2be842923ad9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:03.969445 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cff7963b-b501-48bc-ae93-2be842923ad9 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.160288 Apr 11 20:16:03.970009 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1582/3144] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:03 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:16:04.902796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f6b44901-8958-460b-9af6-3c452e21069c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:04.903702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f6b44901-8958-460b-9af6-3c452e21069c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:04.913021 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6b44901-8958-460b-9af6-3c452e21069c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:04.913466 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6b44901-8958-460b-9af6-3c452e21069c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:04.914212 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6b44901-8958-460b-9af6-3c452e21069c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:04.914636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6b44901-8958-460b-9af6-3c452e21069c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:04.986317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b03f858-ee3e-4689-a134-6e4251ba724d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:04.986969 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b03f858-ee3e-4689-a134-6e4251ba724d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:04.993832 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b03f858-ee3e-4689-a134-6e4251ba724d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:04.994276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b03f858-ee3e-4689-a134-6e4251ba724d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:04.995037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b03f858-ee3e-4689-a134-6e4251ba724d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:04.995480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b03f858-ee3e-4689-a134-6e4251ba724d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:05.085833 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6b44901-8958-460b-9af6-3c452e21069c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:05.094277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f6b44901-8958-460b-9af6-3c452e21069c tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.197139 Apr 11 20:16:05.099040 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1563/3145] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:04 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:05.154547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b03f858-ee3e-4689-a134-6e4251ba724d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:05.164822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b03f858-ee3e-4689-a134-6e4251ba724d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.182521 Apr 11 20:16:05.165523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1583/3146] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:04 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:06.123573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-101624ae-2d62-4229-869c-197abff29f66 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:06.124524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-101624ae-2d62-4229-869c-197abff29f66 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:06.133808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-101624ae-2d62-4229-869c-197abff29f66 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:06.134499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-101624ae-2d62-4229-869c-197abff29f66 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:06.135651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-101624ae-2d62-4229-869c-197abff29f66 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:06.136315 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-101624ae-2d62-4229-869c-197abff29f66 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:06.182403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3663e281-b01e-4fba-bb92-a88c3009d763 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:06.183020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3663e281-b01e-4fba-bb92-a88c3009d763 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:06.190252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3663e281-b01e-4fba-bb92-a88c3009d763 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:06.190611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3663e281-b01e-4fba-bb92-a88c3009d763 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:06.191453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3663e281-b01e-4fba-bb92-a88c3009d763 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:06.191900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3663e281-b01e-4fba-bb92-a88c3009d763 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:06.319451 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-101624ae-2d62-4229-869c-197abff29f66 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:06.327773 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-101624ae-2d62-4229-869c-197abff29f66 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.210401 Apr 11 20:16:06.328421 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1564/3147] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:06 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:06.345625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3663e281-b01e-4fba-bb92-a88c3009d763 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:06.354140 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3663e281-b01e-4fba-bb92-a88c3009d763 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.175680 Apr 11 20:16:06.354702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1584/3148] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:06 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:07.349286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5b69df81-f012-466c-bf31-2ee4b0ec615e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:07.350331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5b69df81-f012-466c-bf31-2ee4b0ec615e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:07.357407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b69df81-f012-466c-bf31-2ee4b0ec615e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:07.357882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b69df81-f012-466c-bf31-2ee4b0ec615e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:07.358678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b69df81-f012-466c-bf31-2ee4b0ec615e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:07.359129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b69df81-f012-466c-bf31-2ee4b0ec615e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:07.370862 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e0b7d5c6-12b1-4ea1-9233-81b38ea8df04 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:07.371506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e0b7d5c6-12b1-4ea1-9233-81b38ea8df04 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:07.378814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0b7d5c6-12b1-4ea1-9233-81b38ea8df04 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:07.379252 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0b7d5c6-12b1-4ea1-9233-81b38ea8df04 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:07.380047 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0b7d5c6-12b1-4ea1-9233-81b38ea8df04 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:07.380498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0b7d5c6-12b1-4ea1-9233-81b38ea8df04 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:07.548932 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b69df81-f012-466c-bf31-2ee4b0ec615e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:07.556059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e0b7d5c6-12b1-4ea1-9233-81b38ea8df04 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:07.557163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5b69df81-f012-466c-bf31-2ee4b0ec615e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.214374 Apr 11 20:16:07.557720 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1565/3149] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:07 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:07.564441 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e0b7d5c6-12b1-4ea1-9233-81b38ea8df04 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.197578 Apr 11 20:16:07.565027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1585/3150] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:07 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:08.776017 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b050d390-d3e5-43ff-8a63-07e0aef92911 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:08.776540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7c5cdba4-f78d-4191-8f8a-f5ea43dad080 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:08.776940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b050d390-d3e5-43ff-8a63-07e0aef92911 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:08.777054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7c5cdba4-f78d-4191-8f8a-f5ea43dad080 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:08.783679 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b050d390-d3e5-43ff-8a63-07e0aef92911 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:08.784195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b050d390-d3e5-43ff-8a63-07e0aef92911 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:08.784985 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b050d390-d3e5-43ff-8a63-07e0aef92911 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:08.785414 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b050d390-d3e5-43ff-8a63-07e0aef92911 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:08.785541 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c5cdba4-f78d-4191-8f8a-f5ea43dad080 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:08.786018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c5cdba4-f78d-4191-8f8a-f5ea43dad080 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:08.786857 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c5cdba4-f78d-4191-8f8a-f5ea43dad080 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:08.787352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c5cdba4-f78d-4191-8f8a-f5ea43dad080 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:08.969334 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b050d390-d3e5-43ff-8a63-07e0aef92911 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:08.976132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7c5cdba4-f78d-4191-8f8a-f5ea43dad080 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:08.977594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b050d390-d3e5-43ff-8a63-07e0aef92911 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.405466 Apr 11 20:16:08.978235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1566/3151] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:08 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:08.984846 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7c5cdba4-f78d-4191-8f8a-f5ea43dad080 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.400994 Apr 11 20:16:08.985428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1586/3152] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:08 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:09.995240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dd996149-36e0-49ec-bc9d-c65976373a47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:09.995801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dd996149-36e0-49ec-bc9d-c65976373a47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:10.002133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-64f7c01c-0290-43f5-8fb3-9cadc531f67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:10.002677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd996149-36e0-49ec-bc9d-c65976373a47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:10.002803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-64f7c01c-0290-43f5-8fb3-9cadc531f67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:10.003126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd996149-36e0-49ec-bc9d-c65976373a47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:10.003887 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd996149-36e0-49ec-bc9d-c65976373a47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:10.004341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd996149-36e0-49ec-bc9d-c65976373a47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:10.008892 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64f7c01c-0290-43f5-8fb3-9cadc531f67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:10.009353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64f7c01c-0290-43f5-8fb3-9cadc531f67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:10.010102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64f7c01c-0290-43f5-8fb3-9cadc531f67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:10.010525 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64f7c01c-0290-43f5-8fb3-9cadc531f67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:10.190681 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dd996149-36e0-49ec-bc9d-c65976373a47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:10.195094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-64f7c01c-0290-43f5-8fb3-9cadc531f67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:10.199662 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dd996149-36e0-49ec-bc9d-c65976373a47 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.208344 Apr 11 20:16:10.200219 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1567/3153] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:09 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:10.204030 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-64f7c01c-0290-43f5-8fb3-9cadc531f67d tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.205629 Apr 11 20:16:10.204616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1587/3154] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:09 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:16:11.217803 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c45deb04-0a4a-4718-9ca7-7b9f554b1490 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:11.218401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c45deb04-0a4a-4718-9ca7-7b9f554b1490 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:11.221407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e7b3672b-d3d7-4293-9fa8-de11fab137ba tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:11.222138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e7b3672b-d3d7-4293-9fa8-de11fab137ba tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:11.225954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c45deb04-0a4a-4718-9ca7-7b9f554b1490 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:11.226426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c45deb04-0a4a-4718-9ca7-7b9f554b1490 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:11.227227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c45deb04-0a4a-4718-9ca7-7b9f554b1490 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:11.227683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c45deb04-0a4a-4718-9ca7-7b9f554b1490 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:11.229628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b3672b-d3d7-4293-9fa8-de11fab137ba tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:11.230136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b3672b-d3d7-4293-9fa8-de11fab137ba tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:11.230948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b3672b-d3d7-4293-9fa8-de11fab137ba tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:11.231544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b3672b-d3d7-4293-9fa8-de11fab137ba tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:11.416667 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c45deb04-0a4a-4718-9ca7-7b9f554b1490 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:11.419673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7b3672b-d3d7-4293-9fa8-de11fab137ba tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:11.424931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c45deb04-0a4a-4718-9ca7-7b9f554b1490 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.211215 Apr 11 20:16:11.425560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1568/3155] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:11 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:11.427608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e7b3672b-d3d7-4293-9fa8-de11fab137ba tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.210258 Apr 11 20:16:11.428162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1588/3156] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:11 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:12.445989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-40aa6eb9-d003-4bc4-b46d-7b2c1f0aea34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:12.446574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-40aa6eb9-d003-4bc4-b46d-7b2c1f0aea34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:12.446993 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a93a3c70-634c-4c6f-bf29-c3d88f33ddec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:12.447637 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a93a3c70-634c-4c6f-bf29-c3d88f33ddec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:12.453465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-40aa6eb9-d003-4bc4-b46d-7b2c1f0aea34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:12.453910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-40aa6eb9-d003-4bc4-b46d-7b2c1f0aea34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:12.454187 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a93a3c70-634c-4c6f-bf29-c3d88f33ddec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:12.454631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a93a3c70-634c-4c6f-bf29-c3d88f33ddec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:12.454788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-40aa6eb9-d003-4bc4-b46d-7b2c1f0aea34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:12.455072 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-40aa6eb9-d003-4bc4-b46d-7b2c1f0aea34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:12.455395 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a93a3c70-634c-4c6f-bf29-c3d88f33ddec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:12.455821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a93a3c70-634c-4c6f-bf29-c3d88f33ddec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:12.638606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a93a3c70-634c-4c6f-bf29-c3d88f33ddec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:12.645309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-40aa6eb9-d003-4bc4-b46d-7b2c1f0aea34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:12.646889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a93a3c70-634c-4c6f-bf29-c3d88f33ddec tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.204758 Apr 11 20:16:12.647502 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1589/3157] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:12 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:16:12.653497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-40aa6eb9-d003-4bc4-b46d-7b2c1f0aea34 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.213438 Apr 11 20:16:12.654091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1569/3158] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:12 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:13.668490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-86d9f0ce-4d63-4bc5-af0a-b5ac0d730c34 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:13.669428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-86d9f0ce-4d63-4bc5-af0a-b5ac0d730c34 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:13.674346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-be0affd1-b36f-476a-a81f-8e527b42e078 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:13.675357 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-be0affd1-b36f-476a-a81f-8e527b42e078 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:13.679526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86d9f0ce-4d63-4bc5-af0a-b5ac0d730c34 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:13.679984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86d9f0ce-4d63-4bc5-af0a-b5ac0d730c34 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:13.680747 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86d9f0ce-4d63-4bc5-af0a-b5ac0d730c34 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:13.681224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86d9f0ce-4d63-4bc5-af0a-b5ac0d730c34 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:13.683125 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be0affd1-b36f-476a-a81f-8e527b42e078 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:13.683611 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be0affd1-b36f-476a-a81f-8e527b42e078 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:13.684380 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be0affd1-b36f-476a-a81f-8e527b42e078 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:13.684814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be0affd1-b36f-476a-a81f-8e527b42e078 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:13.867955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-86d9f0ce-4d63-4bc5-af0a-b5ac0d730c34 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:13.870990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-be0affd1-b36f-476a-a81f-8e527b42e078 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:13.876504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-86d9f0ce-4d63-4bc5-af0a-b5ac0d730c34 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.214647 Apr 11 20:16:13.877223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1590/3159] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:13 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:13.879140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-be0affd1-b36f-476a-a81f-8e527b42e078 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.211304 Apr 11 20:16:13.879676 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1570/3160] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:13 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:14.897831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f0237b13-0c44-4056-a149-e3db94df583f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:14.898448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f0237b13-0c44-4056-a149-e3db94df583f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:14.899049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0533fd5-3e9d-4385-ae7b-987e851cb28b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:14.899658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0533fd5-3e9d-4385-ae7b-987e851cb28b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:14.904944 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0237b13-0c44-4056-a149-e3db94df583f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:14.905420 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0237b13-0c44-4056-a149-e3db94df583f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:14.906169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0237b13-0c44-4056-a149-e3db94df583f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:14.906317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0533fd5-3e9d-4385-ae7b-987e851cb28b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:14.906590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0237b13-0c44-4056-a149-e3db94df583f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:14.906783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0533fd5-3e9d-4385-ae7b-987e851cb28b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:14.907388 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0533fd5-3e9d-4385-ae7b-987e851cb28b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:14.907818 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0533fd5-3e9d-4385-ae7b-987e851cb28b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:15.089248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f0237b13-0c44-4056-a149-e3db94df583f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:15.096234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0533fd5-3e9d-4385-ae7b-987e851cb28b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:15.097669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f0237b13-0c44-4056-a149-e3db94df583f tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.206161 Apr 11 20:16:15.098403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1591/3161] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:14 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:15.104535 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0533fd5-3e9d-4385-ae7b-987e851cb28b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.210933 Apr 11 20:16:15.105119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1571/3162] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:14 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:16.117769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-88dbf2d0-c96a-4026-af6d-e0d89c230ddf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:16.118651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-88dbf2d0-c96a-4026-af6d-e0d89c230ddf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:16.128032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dabc2b2f-0eae-453e-91aa-10cf9a4d5be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:16.128700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88dbf2d0-c96a-4026-af6d-e0d89c230ddf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:16.128700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88dbf2d0-c96a-4026-af6d-e0d89c230ddf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:16.129019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dabc2b2f-0eae-453e-91aa-10cf9a4d5be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:16.129676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88dbf2d0-c96a-4026-af6d-e0d89c230ddf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:16.130238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88dbf2d0-c96a-4026-af6d-e0d89c230ddf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:16.136157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dabc2b2f-0eae-453e-91aa-10cf9a4d5be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:16.136593 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dabc2b2f-0eae-453e-91aa-10cf9a4d5be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:16.137379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dabc2b2f-0eae-453e-91aa-10cf9a4d5be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:16.137831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dabc2b2f-0eae-453e-91aa-10cf9a4d5be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:16.317256 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-88dbf2d0-c96a-4026-af6d-e0d89c230ddf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:16.320105 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dabc2b2f-0eae-453e-91aa-10cf9a4d5be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:16.325490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-88dbf2d0-c96a-4026-af6d-e0d89c230ddf tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.213425 Apr 11 20:16:16.326126 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1592/3163] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:16 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:16.328211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dabc2b2f-0eae-453e-91aa-10cf9a4d5be6 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.205986 Apr 11 20:16:16.328783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1572/3164] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:16 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:17.348313 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09de3998-5bd7-46ec-b7b2-56a58cd725f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:17.349418 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4d06d025-c51d-43cc-adf6-a4e351134000 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:17.350026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09de3998-5bd7-46ec-b7b2-56a58cd725f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:17.350218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4d06d025-c51d-43cc-adf6-a4e351134000 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:17.359981 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d06d025-c51d-43cc-adf6-a4e351134000 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:17.360289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09de3998-5bd7-46ec-b7b2-56a58cd725f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:17.360732 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d06d025-c51d-43cc-adf6-a4e351134000 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:17.361075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09de3998-5bd7-46ec-b7b2-56a58cd725f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:17.362040 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d06d025-c51d-43cc-adf6-a4e351134000 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:17.362307 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09de3998-5bd7-46ec-b7b2-56a58cd725f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:17.362714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09de3998-5bd7-46ec-b7b2-56a58cd725f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:17.362933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d06d025-c51d-43cc-adf6-a4e351134000 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:17.549801 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09de3998-5bd7-46ec-b7b2-56a58cd725f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:17.552797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4d06d025-c51d-43cc-adf6-a4e351134000 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:17.559580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09de3998-5bd7-46ec-b7b2-56a58cd725f9 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.217340 Apr 11 20:16:17.560460 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1573/3165] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:17 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:17.562426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4d06d025-c51d-43cc-adf6-a4e351134000 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.220657 Apr 11 20:16:17.562992 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1593/3166] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:17 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:18.581822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02549070-0663-41a6-b626-92fa3283135b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:18.582688 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02549070-0663-41a6-b626-92fa3283135b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:18.583222 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91d8a121-4b25-4c68-923c-d7d1b7c96744 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:18.584234 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91d8a121-4b25-4c68-923c-d7d1b7c96744 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:18.593233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02549070-0663-41a6-b626-92fa3283135b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:18.593968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02549070-0663-41a6-b626-92fa3283135b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:18.594989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d8a121-4b25-4c68-923c-d7d1b7c96744 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:18.595257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02549070-0663-41a6-b626-92fa3283135b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:18.595736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d8a121-4b25-4c68-923c-d7d1b7c96744 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:18.596018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02549070-0663-41a6-b626-92fa3283135b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:18.597006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d8a121-4b25-4c68-923c-d7d1b7c96744 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:18.597741 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91d8a121-4b25-4c68-923c-d7d1b7c96744 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:18.782498 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02549070-0663-41a6-b626-92fa3283135b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:18.785660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91d8a121-4b25-4c68-923c-d7d1b7c96744 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:18.790964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02549070-0663-41a6-b626-92fa3283135b tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.216003 Apr 11 20:16:18.791562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1574/3167] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:18 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:18.794066 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91d8a121-4b25-4c68-923c-d7d1b7c96744 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.217128 Apr 11 20:16:18.794666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1594/3168] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:18 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:19.812132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c2c0edc0-4043-4b33-82f2-4b57ac9a33b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:19.813132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c2c0edc0-4043-4b33-82f2-4b57ac9a33b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:19.815414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3e6bb556-2f12-4b99-90c9-b89e2cd9802e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:19.816397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3e6bb556-2f12-4b99-90c9-b89e2cd9802e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:19.822048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2c0edc0-4043-4b33-82f2-4b57ac9a33b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:19.822504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2c0edc0-4043-4b33-82f2-4b57ac9a33b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:19.823274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2c0edc0-4043-4b33-82f2-4b57ac9a33b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:19.823711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2c0edc0-4043-4b33-82f2-4b57ac9a33b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:19.824112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e6bb556-2f12-4b99-90c9-b89e2cd9802e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:19.824561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e6bb556-2f12-4b99-90c9-b89e2cd9802e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:19.825330 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e6bb556-2f12-4b99-90c9-b89e2cd9802e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:19.825753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e6bb556-2f12-4b99-90c9-b89e2cd9802e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:20.010165 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c2c0edc0-4043-4b33-82f2-4b57ac9a33b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:20.013514 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3e6bb556-2f12-4b99-90c9-b89e2cd9802e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:20.018540 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c2c0edc0-4043-4b33-82f2-4b57ac9a33b1 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.213224 Apr 11 20:16:20.019159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1575/3169] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:19 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:20.021383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3e6bb556-2f12-4b99-90c9-b89e2cd9802e tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.212659 Apr 11 20:16:20.021903 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1595/3170] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:19 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:21.040680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf41c974-ebdc-41eb-a4c2-ed484144d7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:21.041733 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf41c974-ebdc-41eb-a4c2-ed484144d7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:21.042026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b2e47fe-f064-46e1-9f7e-67548e028306 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:21.042775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b2e47fe-f064-46e1-9f7e-67548e028306 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:21.052393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf41c974-ebdc-41eb-a4c2-ed484144d7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:21.053195 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf41c974-ebdc-41eb-a4c2-ed484144d7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:21.053406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b2e47fe-f064-46e1-9f7e-67548e028306 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:21.053997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b2e47fe-f064-46e1-9f7e-67548e028306 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:21.054461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf41c974-ebdc-41eb-a4c2-ed484144d7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:21.055178 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf41c974-ebdc-41eb-a4c2-ed484144d7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:21.055384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b2e47fe-f064-46e1-9f7e-67548e028306 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:21.055988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b2e47fe-f064-46e1-9f7e-67548e028306 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:21.238917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf41c974-ebdc-41eb-a4c2-ed484144d7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:21.242050 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b2e47fe-f064-46e1-9f7e-67548e028306 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:21.246929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf41c974-ebdc-41eb-a4c2-ed484144d7c2 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.213269 Apr 11 20:16:21.248143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1576/3171] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:21 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:21.250786 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b2e47fe-f064-46e1-9f7e-67548e028306 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.215368 Apr 11 20:16:21.251318 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1596/3172] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:21 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:22.269205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02d51d9a-92b5-49da-8b82-d7bd78bc3d7e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:22.270205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02d51d9a-92b5-49da-8b82-d7bd78bc3d7e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:22.272973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4623b72e-7699-4927-a878-068c13cdac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:22.274080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4623b72e-7699-4927-a878-068c13cdac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:22.281327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02d51d9a-92b5-49da-8b82-d7bd78bc3d7e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:22.282085 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02d51d9a-92b5-49da-8b82-d7bd78bc3d7e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:22.283325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02d51d9a-92b5-49da-8b82-d7bd78bc3d7e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:22.284032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02d51d9a-92b5-49da-8b82-d7bd78bc3d7e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:22.285740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4623b72e-7699-4927-a878-068c13cdac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:22.286504 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4623b72e-7699-4927-a878-068c13cdac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:22.287727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4623b72e-7699-4927-a878-068c13cdac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:22.288450 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4623b72e-7699-4927-a878-068c13cdac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:22.468148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02d51d9a-92b5-49da-8b82-d7bd78bc3d7e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:22.472262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4623b72e-7699-4927-a878-068c13cdac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:22.476394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02d51d9a-92b5-49da-8b82-d7bd78bc3d7e tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.213672 Apr 11 20:16:22.476965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1577/3173] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:22 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:22.480866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4623b72e-7699-4927-a878-068c13cdac23 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.214193 Apr 11 20:16:22.481547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1597/3174] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:22 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:23.500554 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-71279e62-63f2-4fb4-9028-0a625a990338 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:23.501473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-71279e62-63f2-4fb4-9028-0a625a990338 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:23.504797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-30281a1b-0f97-4c30-af31-313cad26ad1c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:23.506174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-30281a1b-0f97-4c30-af31-313cad26ad1c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:23.510691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71279e62-63f2-4fb4-9028-0a625a990338 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:23.511159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71279e62-63f2-4fb4-9028-0a625a990338 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:23.512298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71279e62-63f2-4fb4-9028-0a625a990338 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:23.512298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71279e62-63f2-4fb4-9028-0a625a990338 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:23.513939 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30281a1b-0f97-4c30-af31-313cad26ad1c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:23.514407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30281a1b-0f97-4c30-af31-313cad26ad1c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:23.515159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30281a1b-0f97-4c30-af31-313cad26ad1c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:23.515593 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30281a1b-0f97-4c30-af31-313cad26ad1c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:23.529239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:16:23.531651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:16:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 (ip 10.222.0.62) !!! Apr 11 20:16:23.703471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-30281a1b-0f97-4c30-af31-313cad26ad1c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:23.706954 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-71279e62-63f2-4fb4-9028-0a625a990338 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:23.711766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-30281a1b-0f97-4c30-af31-313cad26ad1c tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.214246 Apr 11 20:16:23.712357 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1598/3175] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:23 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:23.714924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-71279e62-63f2-4fb4-9028-0a625a990338 tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.223099 Apr 11 20:16:23.715489 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1578/3176] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:23 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:24.733246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-11414df2-095c-45ef-b665-efc924064a78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:24.735356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-11414df2-095c-45ef-b665-efc924064a78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] [instance: c9ab5394-5558-4afd-b34d-c75fc0dfd907] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:24.741094 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a3b62547-78a4-4566-b7ca-c6ca0099adbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:24.744234 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a3b62547-78a4-4566-b7ca-c6ca0099adbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] [instance: 4f85f237-46f1-47d2-badc-2e3cffe85c90] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:16:24.745874 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11414df2-095c-45ef-b665-efc924064a78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:24.746188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11414df2-095c-45ef-b665-efc924064a78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:24.746951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11414df2-095c-45ef-b665-efc924064a78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:24.747722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11414df2-095c-45ef-b665-efc924064a78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:24.751502 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3b62547-78a4-4566-b7ca-c6ca0099adbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:24.751950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3b62547-78a4-4566-b7ca-c6ca0099adbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:24.752741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3b62547-78a4-4566-b7ca-c6ca0099adbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:16:24.753319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3b62547-78a4-4566-b7ca-c6ca0099adbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:16:25.163319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-11414df2-095c-45ef-b665-efc924064a78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27238068e724556bf6f5b3d6ee5e721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4efeb8e17b4f9daa20a62fad70daa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:25.172095 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a3b62547-78a4-4566-b7ca-c6ca0099adbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01dbdcd378e4b8096cb2f6daba96ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc47acc2b2ec444eb55b1d32e5d9d97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:16:25.172735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-11414df2-095c-45ef-b665-efc924064a78 tempest-VolumesSnapshotTestJSON-894131778 tempest-VolumesSnapshotTestJSON-894131778-project] 10.222.0.62 "GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907" status: 200 len: 1559 microversion: 2.1 time: 0.446150 Apr 11 20:16:25.173629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1599/3177] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:24 2022] GET /compute/v2.1/servers/c9ab5394-5558-4afd-b34d-c75fc0dfd907 => generated 1559 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:25.181078 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a3b62547-78a4-4566-b7ca-c6ca0099adbb tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90" status: 200 len: 1602 microversion: 2.1 time: 0.450906 Apr 11 20:16:25.181647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1579/3178] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:16:24 2022] GET /compute/v2.1/servers/4f85f237-46f1-47d2-badc-2e3cffe85c90 => generated 1602 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:16:25.198996 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7d926a55-43cf-40cc-8c9b-ee70a59171dc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] Calling method '.version_select at 0x7f4086e2d700>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:16:25.217165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7d926a55-43cf-40cc-8c9b-ee70a59171dc tempest-TestMinimumBasicScenario-469064882 tempest-TestMinimumBasicScenario-469064882-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1002203304" status: 202 len: 0 microversion: 2.1 time: 0.022022 Apr 11 20:16:25.217710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1600/3179] 10.222.0.62 () {58 vars in 1271 bytes} [Mon Apr 11 20:16:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1002203304 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:16:38.485948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:16:38.486877 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:16:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:17:44.689129 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:17:44.690147 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:18:25.343493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fde1b018-f90f-4fa8-bc70-01220df95481] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 20:18:25.347401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8459b00c-aac7-4bf9-bcd9-bd54a5b368c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:25.347919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8459b00c-aac7-4bf9-bcd9-bd54a5b368c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:25.354512 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8459b00c-aac7-4bf9-bcd9-bd54a5b368c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:25.354961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8459b00c-aac7-4bf9-bcd9-bd54a5b368c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:25.355817 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8459b00c-aac7-4bf9-bcd9-bd54a5b368c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:25.356284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8459b00c-aac7-4bf9-bcd9-bd54a5b368c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:25.381665 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8459b00c-aac7-4bf9-bcd9-bd54a5b368c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:18:25.469993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8459b00c-aac7-4bf9-bcd9-bd54a5b368c5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 204 len: 0 microversion: 2.1 time: 0.128437 Apr 11 20:18:25.470597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1580/3180] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:18:25 2022] DELETE /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:18:25.476849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc154637-dfd0-4bb8-b7b4-ed3cef196334] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 20:18:25.480762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97cdcd0d-20db-4372-9841-edcd369b10b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:25.481527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97cdcd0d-20db-4372-9841-edcd369b10b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:25.488094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97cdcd0d-20db-4372-9841-edcd369b10b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:25.488533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97cdcd0d-20db-4372-9841-edcd369b10b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:25.489319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97cdcd0d-20db-4372-9841-edcd369b10b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:25.489755 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97cdcd0d-20db-4372-9841-edcd369b10b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:25.625102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97cdcd0d-20db-4372-9841-edcd369b10b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:25.633059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97cdcd0d-20db-4372-9841-edcd369b10b8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1682 microversion: 2.1 time: 0.157837 Apr 11 20:18:25.633610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1601/3181] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:25 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:26.651995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2cbcb06a-9f2f-4194-89ac-3917610fdd4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:26.652792 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2cbcb06a-9f2f-4194-89ac-3917610fdd4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:26.660288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cbcb06a-9f2f-4194-89ac-3917610fdd4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:26.660707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cbcb06a-9f2f-4194-89ac-3917610fdd4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:26.661539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cbcb06a-9f2f-4194-89ac-3917610fdd4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:26.661968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cbcb06a-9f2f-4194-89ac-3917610fdd4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:26.667953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] [fde1b018-f90f-4fa8-bc70-01220df95481] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38230. Apr 11 20:18:26.731950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2cbcb06a-9f2f-4194-89ac-3917610fdd4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:26.740013 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2cbcb06a-9f2f-4194-89ac-3917610fdd4c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 200 len: 1614 microversion: 2.1 time: 0.092336 Apr 11 20:18:26.740548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1581/3182] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:26 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:27.002555 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc154637-dfd0-4bb8-b7b4-ed3cef196334] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38236. Apr 11 20:18:27.056306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-52e69208-3434-4e48-874e-7ed921ad5c52 req-be58185b-ddba-45bc-9a52-3572bb55b83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382b367c-812d-487b-8506-d246e8eb9a42", "name": "network-vif-deleted", "tag": "1a0dc4a3-e7aa-4e5e-b8e5-05d88837ea90"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:18:27.072363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-52e69208-3434-4e48-874e-7ed921ad5c52 req-be58185b-ddba-45bc-9a52-3572bb55b83e service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:27.072719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-52e69208-3434-4e48-874e-7ed921ad5c52 req-be58185b-ddba-45bc-9a52-3572bb55b83e service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:27.086008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-52e69208-3434-4e48-874e-7ed921ad5c52 req-be58185b-ddba-45bc-9a52-3572bb55b83e service nova] Creating event network-vif-deleted:1a0dc4a3-e7aa-4e5e-b8e5-05d88837ea90 for instance 382b367c-812d-487b-8506-d246e8eb9a42 on hv-cinder-83078 Apr 11 20:18:27.089797 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: ERROR oslo.messaging._drivers.impl_rabbit [req-52e69208-3434-4e48-874e-7ed921ad5c52 req-be58185b-ddba-45bc-9a52-3572bb55b83e service nova] [c7a12c81-ef87-493b-8488-17a424001478] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 20:18:27.757695 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:27.758339 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:27.765022 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:27.765467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:27.766218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:27.766644 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:27.780612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 382b367c-812d-487b-8506-d246e8eb9a42 could not be found. Apr 11 20:18:27.781251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 382b367c-812d-487b-8506-d246e8eb9a42 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:18:27.782090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94cc8cc4-f944-4813-9025-27f2495925bd tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 404 len: 111 microversion: 2.1 time: 0.028316 Apr 11 20:18:27.782779 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1582/3183] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:27 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:18:27.791471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2ba84b29-2809-4bdc-9156-c098ec4de78e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '.version_select at 0x7f408fe8ea60>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:27.794600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ba84b29-2809-4bdc-9156-c098ec4de78e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [56d9edc1-c44f-4312-9a31-297a4cf21913] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 20:18:28.098842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [req-52e69208-3434-4e48-874e-7ed921ad5c52 req-be58185b-ddba-45bc-9a52-3572bb55b83e service nova] [c7a12c81-ef87-493b-8488-17a424001478] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38244. Apr 11 20:18:28.102962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-52e69208-3434-4e48-874e-7ed921ad5c52 req-be58185b-ddba-45bc-9a52-3572bb55b83e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.117847 Apr 11 20:18:28.103561 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1602/3184] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:18:28.806752 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ba84b29-2809-4bdc-9156-c098ec4de78e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [56d9edc1-c44f-4312-9a31-297a4cf21913] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38246. Apr 11 20:18:28.830032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2ba84b29-2809-4bdc-9156-c098ec4de78e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281121509" status: 202 len: 0 microversion: 2.1 time: 1.042341 Apr 11 20:18:28.830608 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1583/3185] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Apr 11 20:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281121509 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:18:29.457145 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-caa6c53c-ac31-443a-a8e6-dd7bd2c7895d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: .version_select at 0x7f4086dc90d0>, body: {"keypair": {"name": "tempest-keypair-890293720"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:18:29.472406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-caa6c53c-ac31-443a-a8e6-dd7bd2c7895d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:18:29.476075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-caa6c53c-ac31-443a-a8e6-dd7bd2c7895d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:18:29.617052 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-caa6c53c-ac31-443a-a8e6-dd7bd2c7895d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:18:29.623073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-caa6c53c-ac31-443a-a8e6-dd7bd2c7895d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:18:29.636938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-caa6c53c-ac31-443a-a8e6-dd7bd2c7895d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.184623 Apr 11 20:18:29.637674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1603/3186] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 20:18:29 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:30.998707 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2955844", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31fd0e52-1286-4398-91da-eeb66b072c42"}], "security_groups": [{"name": "tempest-securitygroup--792391076"}], "key_name": "tempest-keypair-890293720", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:18:31.103203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] validate_networks() for [('31fd0e52-1286-4398-91da-eeb66b072c42', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 20:18:31.520573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:18:31.521062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:18:31.521533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:18:31.521937 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:18:31.523173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:18:31.532867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:31.533344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:31.534139 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:31.534573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:31.552104 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for project fbe82b6eff194e23a753d5d884d547c0. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:18:31.556314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Getting quotas for user d2815037a8d04498a5335d360a4476d4 and project fbe82b6eff194e23a753d5d884d547c0. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:18:31.568277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 20:18:31.570628 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 20:18:31.627291 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cd645e6a-d02c-4fce-9c8e-d3b3770cb0fc tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.634052 Apr 11 20:18:31.628422 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1584/3187] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 20:18:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 20:18:31.638749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f683c03e-99b6-46cb-a038-d3f6bc3afaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:31.639705 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f683c03e-99b6-46cb-a038-d3f6bc3afaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:31.702193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f683c03e-99b6-46cb-a038-d3f6bc3afaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:31.709345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f683c03e-99b6-46cb-a038-d3f6bc3afaef tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1238 microversion: 2.1 time: 0.074622 Apr 11 20:18:31.709971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1604/3188] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:31 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:32.727465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8b17ca22-bfe8-40bd-9572-d7262d6b29df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:32.728539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8b17ca22-bfe8-40bd-9572-d7262d6b29df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:32.735073 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b17ca22-bfe8-40bd-9572-d7262d6b29df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:32.735633 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b17ca22-bfe8-40bd-9572-d7262d6b29df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:32.736470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b17ca22-bfe8-40bd-9572-d7262d6b29df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:32.736995 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b17ca22-bfe8-40bd-9572-d7262d6b29df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:32.799980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8b17ca22-bfe8-40bd-9572-d7262d6b29df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:32.807331 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8b17ca22-bfe8-40bd-9572-d7262d6b29df tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1296 microversion: 2.1 time: 0.084349 Apr 11 20:18:32.807896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1585/3189] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:32 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:33.823908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b9db6fb-902f-44c0-8f31-67d2ce87049a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:33.824803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7b9db6fb-902f-44c0-8f31-67d2ce87049a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:33.831760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b9db6fb-902f-44c0-8f31-67d2ce87049a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:33.832297 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b9db6fb-902f-44c0-8f31-67d2ce87049a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:33.833224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b9db6fb-902f-44c0-8f31-67d2ce87049a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:33.833942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b9db6fb-902f-44c0-8f31-67d2ce87049a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:33.960809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-d083793f-e653-4472-9fc4-149609d02378 req-6e17b73c-7864-4207-93a8-0005b3e7137b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a0b0a5-9d53-42f2-a0de-d4f5fd785776", "tag": "35985253-e588-4afd-bca5-de144022177e"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:18:33.972748 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d083793f-e653-4472-9fc4-149609d02378 req-6e17b73c-7864-4207-93a8-0005b3e7137b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:33.973634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d083793f-e653-4472-9fc4-149609d02378 req-6e17b73c-7864-4207-93a8-0005b3e7137b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:33.985364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7b9db6fb-902f-44c0-8f31-67d2ce87049a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:33.990804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-d083793f-e653-4472-9fc4-149609d02378 req-6e17b73c-7864-4207-93a8-0005b3e7137b service nova] Creating event network-changed:35985253-e588-4afd-bca5-de144022177e for instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 on hv-cinder-83078 Apr 11 20:18:33.996449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-d083793f-e653-4472-9fc4-149609d02378 req-6e17b73c-7864-4207-93a8-0005b3e7137b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040754 Apr 11 20:18:34.000768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1586/3190] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:18:34.016677 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7b9db6fb-902f-44c0-8f31-67d2ce87049a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1363 microversion: 2.1 time: 0.196700 Apr 11 20:18:34.017299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1605/3191] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:33 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:35.038969 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a963f1e5-b6b3-47a3-947d-b7fb26653c08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:35.040107 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a963f1e5-b6b3-47a3-947d-b7fb26653c08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:35.048573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a963f1e5-b6b3-47a3-947d-b7fb26653c08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:35.049064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a963f1e5-b6b3-47a3-947d-b7fb26653c08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:35.049861 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a963f1e5-b6b3-47a3-947d-b7fb26653c08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:35.050289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a963f1e5-b6b3-47a3-947d-b7fb26653c08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:35.185316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a963f1e5-b6b3-47a3-947d-b7fb26653c08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:35.192883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a963f1e5-b6b3-47a3-947d-b7fb26653c08 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1363 microversion: 2.1 time: 0.161637 Apr 11 20:18:35.193568 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1587/3192] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:35 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:36.210053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c1ff7eb-abe9-46c3-af4c-5487e1ccced8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:36.210660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c1ff7eb-abe9-46c3-af4c-5487e1ccced8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:36.217894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c1ff7eb-abe9-46c3-af4c-5487e1ccced8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:36.218331 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c1ff7eb-abe9-46c3-af4c-5487e1ccced8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:36.219081 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c1ff7eb-abe9-46c3-af4c-5487e1ccced8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:36.219507 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c1ff7eb-abe9-46c3-af4c-5487e1ccced8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:36.371977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1c1ff7eb-abe9-46c3-af4c-5487e1ccced8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:36.380274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c1ff7eb-abe9-46c3-af4c-5487e1ccced8 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1363 microversion: 2.1 time: 0.174147 Apr 11 20:18:36.380839 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1606/3193] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:36 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:37.397448 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6aa1be81-6003-4ff9-81be-3cf121d23a55 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:37.398049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6aa1be81-6003-4ff9-81be-3cf121d23a55 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:37.404658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6aa1be81-6003-4ff9-81be-3cf121d23a55 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:37.405145 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6aa1be81-6003-4ff9-81be-3cf121d23a55 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:37.405899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6aa1be81-6003-4ff9-81be-3cf121d23a55 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:37.406332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6aa1be81-6003-4ff9-81be-3cf121d23a55 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:37.538472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6aa1be81-6003-4ff9-81be-3cf121d23a55 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:37.546236 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6aa1be81-6003-4ff9-81be-3cf121d23a55 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1363 microversion: 2.1 time: 0.152671 Apr 11 20:18:37.546802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1588/3194] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:37 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:37.815655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-b6062e9b-686d-4745-8051-e6e64ebcfdc0 req-b379881c-fa61-4431-a5e4-2fce671e94c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a0b0a5-9d53-42f2-a0de-d4f5fd785776", "name": "network-vif-plugged", "status": "completed", "tag": "35985253-e588-4afd-bca5-de144022177e"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:18:37.823464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-b6062e9b-686d-4745-8051-e6e64ebcfdc0 req-b379881c-fa61-4431-a5e4-2fce671e94c8 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:37.823909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-b6062e9b-686d-4745-8051-e6e64ebcfdc0 req-b379881c-fa61-4431-a5e4-2fce671e94c8 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:37.834973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-b6062e9b-686d-4745-8051-e6e64ebcfdc0 req-b379881c-fa61-4431-a5e4-2fce671e94c8 service nova] Creating event network-vif-plugged:35985253-e588-4afd-bca5-de144022177e for instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 on hv-cinder-83078 Apr 11 20:18:37.840055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-b6062e9b-686d-4745-8051-e6e64ebcfdc0 req-b379881c-fa61-4431-a5e4-2fce671e94c8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086276 Apr 11 20:18:37.840645 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1607/3195] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:18:38.565295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3c1ad87-9abe-42e5-8583-412f4a91bd95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:38.566383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3c1ad87-9abe-42e5-8583-412f4a91bd95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:38.576959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3c1ad87-9abe-42e5-8583-412f4a91bd95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:38.577704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3c1ad87-9abe-42e5-8583-412f4a91bd95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:38.578944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3c1ad87-9abe-42e5-8583-412f4a91bd95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:38.579654 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3c1ad87-9abe-42e5-8583-412f4a91bd95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:38.714218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3c1ad87-9abe-42e5-8583-412f4a91bd95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:38.722006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3c1ad87-9abe-42e5-8583-412f4a91bd95 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1363 microversion: 2.1 time: 0.162416 Apr 11 20:18:38.722578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1589/3196] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:38 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:39.744625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1afaa8c4-bd3e-4071-8518-593691daa3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:39.745808 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1afaa8c4-bd3e-4071-8518-593691daa3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:39.757115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1afaa8c4-bd3e-4071-8518-593691daa3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:39.757864 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1afaa8c4-bd3e-4071-8518-593691daa3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:39.759118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1afaa8c4-bd3e-4071-8518-593691daa3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:39.759833 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1afaa8c4-bd3e-4071-8518-593691daa3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:39.889660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1afaa8c4-bd3e-4071-8518-593691daa3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:18:39.897085 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1afaa8c4-bd3e-4071-8518-593691daa3ca tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1554 microversion: 2.1 time: 0.160351 Apr 11 20:18:39.897673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1608/3197] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:18:39 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:18:39.915888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a6addab-2474-44eb-ae80-1bec2b5f6cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:18:39.916433 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a6addab-2474-44eb-ae80-1bec2b5f6cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:18:39.925735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a6addab-2474-44eb-ae80-1bec2b5f6cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:39.926337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a6addab-2474-44eb-ae80-1bec2b5f6cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:39.927455 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a6addab-2474-44eb-ae80-1bec2b5f6cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:39.928052 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a6addab-2474-44eb-ae80-1bec2b5f6cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:40.009514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a6addab-2474-44eb-ae80-1bec2b5f6cbb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099380 Apr 11 20:18:40.010116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1590/3198] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Apr 11 20:18:39 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:18:41.339714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-1663bf00-6f1a-4c58-baed-138a0a2ecd06 req-562abd85-abfe-4092-a2d8-10e4ba449184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a0b0a5-9d53-42f2-a0de-d4f5fd785776", "tag": "35985253-e588-4afd-bca5-de144022177e"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:18:41.347582 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-1663bf00-6f1a-4c58-baed-138a0a2ecd06 req-562abd85-abfe-4092-a2d8-10e4ba449184 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:18:41.348013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-1663bf00-6f1a-4c58-baed-138a0a2ecd06 req-562abd85-abfe-4092-a2d8-10e4ba449184 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:18:41.358596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-1663bf00-6f1a-4c58-baed-138a0a2ecd06 req-562abd85-abfe-4092-a2d8-10e4ba449184 service nova] Creating event network-changed:35985253-e588-4afd-bca5-de144022177e for instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 on hv-cinder-83078 Apr 11 20:18:41.364043 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-1663bf00-6f1a-4c58-baed-138a0a2ecd06 req-562abd85-abfe-4092-a2d8-10e4ba449184 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080126 Apr 11 20:18:41.364619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1609/3199] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:19:17.287416 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b66939eb-e82e-4c7b-bb9c-463487d8a33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:19:17.287972 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b66939eb-e82e-4c7b-bb9c-463487d8a33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:19:17.294513 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b66939eb-e82e-4c7b-bb9c-463487d8a33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:19:17.294966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b66939eb-e82e-4c7b-bb9c-463487d8a33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:19:17.295721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b66939eb-e82e-4c7b-bb9c-463487d8a33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:19:17.296150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b66939eb-e82e-4c7b-bb9c-463487d8a33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:19:17.319462 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b66939eb-e82e-4c7b-bb9c-463487d8a33d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/ips" status: 200 len: 151 microversion: 2.1 time: 0.111453 Apr 11 20:19:17.320009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1591/3200] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 20:19:17 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/ips => generated 151 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:21:04.701983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:21:04.702987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:21:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:21:23.551018 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:21:23.551533 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:21:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:21:38.502917 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:21:38.503864 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:21:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:22:03.795694 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc154637-dfd0-4bb8-b7b4-ed3cef196334] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 20:22:03.802613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59b3170b-a1ad-4c50-bd59-e7a1042e73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23896911-eba1-4010-8fbb-f8223886e3c9"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:03.804896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59b3170b-a1ad-4c50-bd59-e7a1042e73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:03.813777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59b3170b-a1ad-4c50-bd59-e7a1042e73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:03.814479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59b3170b-a1ad-4c50-bd59-e7a1042e73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:03.815290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59b3170b-a1ad-4c50-bd59-e7a1042e73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:03.815730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59b3170b-a1ad-4c50-bd59-e7a1042e73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:04.804498 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc154637-dfd0-4bb8-b7b4-ed3cef196334] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38458. Apr 11 20:22:04.935831 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59b3170b-a1ad-4c50-bd59-e7a1042e73c2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "POST /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.142376 Apr 11 20:22:04.936592 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1610/3201] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 20:22:03 2022] POST /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-volume_attachments => generated 194 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:22:08.066419 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fde1b018-f90f-4fa8-bc70-01220df95481] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 20:22:08.070068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-33e8615c-b210-4848-a549-33c07cad3c79 req-81c3be57-e46b-4861-b828-a37d8dda0a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f85f237-46f1-47d2-badc-2e3cffe85c90", "name": "network-vif-deleted", "tag": "6932f8ee-b8ec-4779-99f0-59715534dce0"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:08.078643 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-33e8615c-b210-4848-a549-33c07cad3c79 req-81c3be57-e46b-4861-b828-a37d8dda0a79 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:08.079079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-33e8615c-b210-4848-a549-33c07cad3c79 req-81c3be57-e46b-4861-b828-a37d8dda0a79 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:08.089342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-33e8615c-b210-4848-a549-33c07cad3c79 req-81c3be57-e46b-4861-b828-a37d8dda0a79 service nova] Creating event network-vif-deleted:6932f8ee-b8ec-4779-99f0-59715534dce0 for instance 4f85f237-46f1-47d2-badc-2e3cffe85c90 on hv-cinder-83078 Apr 11 20:22:08.095642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-33e8615c-b210-4848-a549-33c07cad3c79 req-81c3be57-e46b-4861-b828-a37d8dda0a79 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030996 Apr 11 20:22:08.096226 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1592/3202] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:22:09.113287 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:09.114042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:09.120718 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:09.121218 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:09.122579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:09.123024 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:09.139796 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] HTTP exception thrown: Instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 could not be found. Apr 11 20:22:09.140392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Returning 404 to user: Instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:09.141567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4864396c-f5d5-450a-9652-c6616bfa0b78 tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 404 len: 111 microversion: 2.20 time: 0.032690 Apr 11 20:22:09.142119 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1611/3203] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Apr 11 20:22:09 2022] DELETE /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:22:09.152332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:09.153133 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] [instance: fb6aea71-8b17-46b8-ab07-b42b41b573a5] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:09.161559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:09.162010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:09.162784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:09.163265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:09.178027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] [fde1b018-f90f-4fa8-bc70-01220df95481] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38628. Apr 11 20:22:09.179191 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] HTTP exception thrown: Instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 could not be found. Apr 11 20:22:09.179757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] Returning 404 to user: Instance fb6aea71-8b17-46b8-ab07-b42b41b573a5 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:09.180849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e74acb1c-7732-45b8-87e5-f0940504b6de tempest-AttachVolumeShelveTestJSON-1506881030 tempest-AttachVolumeShelveTestJSON-1506881030-project] 10.222.0.62 "GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5" status: 404 len: 111 microversion: 2.20 time: 0.033922 Apr 11 20:22:09.186978 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1593/3204] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Apr 11 20:22:09 2022] GET /compute/v2.1/servers/fb6aea71-8b17-46b8-ab07-b42b41b573a5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 20:22:10.111999 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-3dec2d61-6daf-481a-bd85-f43a3d950e63 req-2a8e5f00-59f0-4052-aaa9-d6ebb3e4efe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ab5394-5558-4afd-b34d-c75fc0dfd907", "name": "network-vif-deleted", "tag": "56459226-3187-4ee4-9ecc-2c022bdbc206"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:10.121269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-3dec2d61-6daf-481a-bd85-f43a3d950e63 req-2a8e5f00-59f0-4052-aaa9-d6ebb3e4efe5 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:10.122284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-3dec2d61-6daf-481a-bd85-f43a3d950e63 req-2a8e5f00-59f0-4052-aaa9-d6ebb3e4efe5 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:10.133511 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-3dec2d61-6daf-481a-bd85-f43a3d950e63 req-2a8e5f00-59f0-4052-aaa9-d6ebb3e4efe5 service nova] Creating event network-vif-deleted:56459226-3187-4ee4-9ecc-2c022bdbc206 for instance c9ab5394-5558-4afd-b34d-c75fc0dfd907 on hv-cinder-83078 Apr 11 20:22:10.140039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-3dec2d61-6daf-481a-bd85-f43a3d950e63 req-2a8e5f00-59f0-4052-aaa9-d6ebb3e4efe5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Apr 11 20:22:10.140818 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1612/3205] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:22:14.759837 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-da2c064c-8ae4-4051-af31-1ef7dae23aea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:14.760467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-da2c064c-8ae4-4051-af31-1ef7dae23aea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:14.767600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da2c064c-8ae4-4051-af31-1ef7dae23aea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:14.768042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da2c064c-8ae4-4051-af31-1ef7dae23aea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:14.768881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da2c064c-8ae4-4051-af31-1ef7dae23aea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:14.769465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da2c064c-8ae4-4051-af31-1ef7dae23aea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:15.053008 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-da2c064c-8ae4-4051-af31-1ef7dae23aea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lazy-loading 'services' on Instance uuid 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:22:15.157101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-da2c064c-8ae4-4051-af31-1ef7dae23aea tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-volume_attachments/23896911-eba1-4010-8fbb-f8223886e3c9" status: 202 len: 0 microversion: 2.1 time: 0.401100 Apr 11 20:22:15.158543 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1594/3206] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:22:14 2022] DELETE /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-volume_attachments/23896911-eba1-4010-8fbb-f8223886e3c9 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:22:15.168691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9a3654f9-27de-40eb-bdd8-ccf205b2286d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:15.169764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9a3654f9-27de-40eb-bdd8-ccf205b2286d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:15.176603 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a3654f9-27de-40eb-bdd8-ccf205b2286d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:15.177791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a3654f9-27de-40eb-bdd8-ccf205b2286d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:15.180619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a3654f9-27de-40eb-bdd8-ccf205b2286d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:15.181107 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a3654f9-27de-40eb-bdd8-ccf205b2286d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:15.222407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9a3654f9-27de-40eb-bdd8-ccf205b2286d tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059361 Apr 11 20:22:15.225020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1613/3207] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 20:22:15 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:22:16.236289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5e5b58b7-4f43-4f14-9239-e4f204a98279 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:16.238150 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5e5b58b7-4f43-4f14-9239-e4f204a98279 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:16.247500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e5b58b7-4f43-4f14-9239-e4f204a98279 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:16.247500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e5b58b7-4f43-4f14-9239-e4f204a98279 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:16.248546 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e5b58b7-4f43-4f14-9239-e4f204a98279 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:16.248805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e5b58b7-4f43-4f14-9239-e4f204a98279 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:16.282815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5e5b58b7-4f43-4f14-9239-e4f204a98279 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051465 Apr 11 20:22:16.283560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1595/3208] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 20:22:16 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:22:16.342596 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-36a32fbb-cbeb-4bf1-bcf5-7beb51606f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:16.343752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-36a32fbb-cbeb-4bf1-bcf5-7beb51606f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:16.350734 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36a32fbb-cbeb-4bf1-bcf5-7beb51606f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:16.351673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36a32fbb-cbeb-4bf1-bcf5-7beb51606f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:16.352642 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36a32fbb-cbeb-4bf1-bcf5-7beb51606f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:16.353270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36a32fbb-cbeb-4bf1-bcf5-7beb51606f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:16.380955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-36a32fbb-cbeb-4bf1-bcf5-7beb51606f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:22:16.531827 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-36a32fbb-cbeb-4bf1-bcf5-7beb51606f29 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 204 len: 0 microversion: 2.1 time: 0.192736 Apr 11 20:22:16.532651 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1614/3209] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:22:16 2022] DELETE /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:22:16.543549 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-92a7a68c-fa5c-4b64-a55c-35a5ea077ab2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:16.545126 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-92a7a68c-fa5c-4b64-a55c-35a5ea077ab2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:16.558083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-92a7a68c-fa5c-4b64-a55c-35a5ea077ab2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:16.558619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-92a7a68c-fa5c-4b64-a55c-35a5ea077ab2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:16.559901 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-92a7a68c-fa5c-4b64-a55c-35a5ea077ab2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:16.560702 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-92a7a68c-fa5c-4b64-a55c-35a5ea077ab2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:16.814232 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-92a7a68c-fa5c-4b64-a55c-35a5ea077ab2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:16.823045 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-92a7a68c-fa5c-4b64-a55c-35a5ea077ab2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1679 microversion: 2.1 time: 0.285975 Apr 11 20:22:16.823728 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1596/3210] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:16 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1679 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:17.840794 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0fca8a9a-1742-4d01-ac16-427c58b2970c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:17.841711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0fca8a9a-1742-4d01-ac16-427c58b2970c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:17.857438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fca8a9a-1742-4d01-ac16-427c58b2970c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:17.857906 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fca8a9a-1742-4d01-ac16-427c58b2970c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:17.861419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fca8a9a-1742-4d01-ac16-427c58b2970c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:17.862650 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fca8a9a-1742-4d01-ac16-427c58b2970c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:18.146959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0fca8a9a-1742-4d01-ac16-427c58b2970c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:18.155419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0fca8a9a-1742-4d01-ac16-427c58b2970c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1679 microversion: 2.1 time: 0.319370 Apr 11 20:22:18.156205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1615/3211] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:17 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1679 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:18.411288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc5181bb-f53e-4e4d-90a0-dd3f5d462525 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'create', calling method: .version_select at 0x7f408fe5b790>, body: {"keypair": {"name": "tempest-keypair-2135012583"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:18.425048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-bc5181bb-f53e-4e4d-90a0-dd3f5d462525 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:22:18.430004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-bc5181bb-f53e-4e4d-90a0-dd3f5d462525 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for user 0ed65f3c451f42279c453b8b39c0b83a and project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:22:18.708074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-bc5181bb-f53e-4e4d-90a0-dd3f5d462525 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:22:18.711953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-bc5181bb-f53e-4e4d-90a0-dd3f5d462525 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for user 0ed65f3c451f42279c453b8b39c0b83a and project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:22:18.725287 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc5181bb-f53e-4e4d-90a0-dd3f5d462525 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.372583 Apr 11 20:22:18.725889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1597/3212] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 20:22:18 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:19.179373 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9c076cd-9d5c-4f46-a348-e9bcda02e8d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:19.181242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9c076cd-9d5c-4f46-a348-e9bcda02e8d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:19.192105 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9c076cd-9d5c-4f46-a348-e9bcda02e8d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:19.192611 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9c076cd-9d5c-4f46-a348-e9bcda02e8d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:19.193489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9c076cd-9d5c-4f46-a348-e9bcda02e8d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:19.193998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9c076cd-9d5c-4f46-a348-e9bcda02e8d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:19.309327 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c9c076cd-9d5c-4f46-a348-e9bcda02e8d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:19.316817 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9c076cd-9d5c-4f46-a348-e9bcda02e8d2 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1612 microversion: 2.1 time: 0.148021 Apr 11 20:22:19.317383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1616/3213] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:19 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1612 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:19.915617 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-c332dfba-f6f6-4376-82ba-229d1ea53b65 req-cfa17940-1c6e-489e-b0d3-3ddbc2fc1fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a0b0a5-9d53-42f2-a0de-d4f5fd785776", "name": "network-vif-deleted", "tag": "35985253-e588-4afd-bca5-de144022177e"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:19.937989 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c332dfba-f6f6-4376-82ba-229d1ea53b65 req-cfa17940-1c6e-489e-b0d3-3ddbc2fc1fff service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:19.938454 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c332dfba-f6f6-4376-82ba-229d1ea53b65 req-cfa17940-1c6e-489e-b0d3-3ddbc2fc1fff service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:19.963789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-c332dfba-f6f6-4376-82ba-229d1ea53b65 req-cfa17940-1c6e-489e-b0d3-3ddbc2fc1fff service nova] Creating event network-vif-deleted:35985253-e588-4afd-bca5-de144022177e for instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 on hv-cinder-83078 Apr 11 20:22:19.969037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-c332dfba-f6f6-4376-82ba-229d1ea53b65 req-cfa17940-1c6e-489e-b0d3-3ddbc2fc1fff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057032 Apr 11 20:22:19.969647 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1598/3214] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:22:20.345765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:20.347194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:20.365026 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:20.368526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:20.370547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:20.372365 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:20.469101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:20.469708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:20.470427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lazy-loading 'fault' on Instance uuid 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:22:20.564260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2815037a8d04498a5335d360a4476d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe82b6eff194e23a753d5d884d547c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:20.576251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-60f51136-585b-498a-9c9f-70ca3147a96e tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 200 len: 1328 microversion: 2.1 time: 0.235500 Apr 11 20:22:20.578134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1617/3215] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:20 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 1328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:20.790117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1569651945", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3b4b788-ea49-4f96-8c7a-90d99096b6dc"}], "security_groups": [{"name": "tempest-securitygroup--800408468"}], "key_name": "tempest-keypair-2135012583", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:20.913090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] validate_networks() for [('d3b4b788-ea49-4f96-8c7a-90d99096b6dc', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 20:22:21.368472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:22:21.369128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:22:21.369411 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:22:21.369816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:22:21.370221 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:22:21.380393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:21.381304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:21.382814 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:21.383465 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:21.401324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:22:21.405560 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for user 0ed65f3c451f42279c453b8b39c0b83a and project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:22:21.418935 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 20:22:21.421609 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 20:22:21.480243 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5169972-1d3b-4bbe-b3bc-6acd64fd337f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694808 Apr 11 20:22:21.481384 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1599/3216] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 20:22:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 20:22:21.491899 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4baecc02-e917-4f3a-b53b-7f75ba664503 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:21.493417 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4baecc02-e917-4f3a-b53b-7f75ba664503 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:21.561481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4baecc02-e917-4f3a-b53b-7f75ba664503 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:21.568317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4baecc02-e917-4f3a-b53b-7f75ba664503 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1238 microversion: 2.1 time: 0.080621 Apr 11 20:22:21.568945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1618/3217] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:21 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:22:21.595284 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:21.595816 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:21.603514 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:21.603960 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:21.604721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:21.605177 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:21.621196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 could not be found. Apr 11 20:22:21.622141 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:21.625049 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a1b31d3c-2f51-4006-8015-17110e51c08c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 404 len: 111 microversion: 2.1 time: 0.031798 Apr 11 20:22:21.629729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1600/3218] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:21 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:22:21.640889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b720c31c-d269-434c-b964-08a853092231 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '.version_select at 0x7f4086df9b80>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:21.670500 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b720c31c-d269-434c-b964-08a853092231 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890293720" status: 202 len: 0 microversion: 2.1 time: 0.037250 Apr 11 20:22:21.671090 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1619/3219] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Apr 11 20:22:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890293720 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:22:22.586392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39288d38-7ccd-4ebe-8946-10de6bcc8d9f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:22.587272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-39288d38-7ccd-4ebe-8946-10de6bcc8d9f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:22.594143 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39288d38-7ccd-4ebe-8946-10de6bcc8d9f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:22.594740 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39288d38-7ccd-4ebe-8946-10de6bcc8d9f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:22.595612 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39288d38-7ccd-4ebe-8946-10de6bcc8d9f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:22.596791 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39288d38-7ccd-4ebe-8946-10de6bcc8d9f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:22.681594 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-39288d38-7ccd-4ebe-8946-10de6bcc8d9f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:22.692181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39288d38-7ccd-4ebe-8946-10de6bcc8d9f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1298 microversion: 2.1 time: 0.110010 Apr 11 20:22:22.692872 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1601/3220] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:22 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:23.547299 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:23.549774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:23.559185 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:23.560798 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:23.563006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:23.563733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:23.580280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 could not be found. Apr 11 20:22:23.580994 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:23.581902 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-062f87cb-309c-4c01-b3f6-475932a94cd5 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 404 len: 111 microversion: 2.1 time: 0.041004 Apr 11 20:22:23.582661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1620/3221] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:22:23 2022] DELETE /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:22:23.590990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:23.592620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 30a0b0a5-9d53-42f2-a0de-d4f5fd785776] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:23.600030 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:23.600747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:23.601815 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:23.602463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:23.617280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 could not be found. Apr 11 20:22:23.617874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 30a0b0a5-9d53-42f2-a0de-d4f5fd785776 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:23.618714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b03254cf-42f7-4cda-a7aa-ea2cb0fd746a tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776" status: 404 len: 111 microversion: 2.1 time: 0.031995 Apr 11 20:22:23.623046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1602/3222] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:23 2022] GET /compute/v2.1/servers/30a0b0a5-9d53-42f2-a0de-d4f5fd785776 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 20:22:23.711067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8126df11-5b17-4e51-aeb4-0fe0fe4c27fc tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:23.712049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8126df11-5b17-4e51-aeb4-0fe0fe4c27fc tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:23.720615 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8126df11-5b17-4e51-aeb4-0fe0fe4c27fc tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:23.721843 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8126df11-5b17-4e51-aeb4-0fe0fe4c27fc tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:23.722997 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8126df11-5b17-4e51-aeb4-0fe0fe4c27fc tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:23.723962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8126df11-5b17-4e51-aeb4-0fe0fe4c27fc tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:23.888433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8126df11-5b17-4e51-aeb4-0fe0fe4c27fc tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:23.897584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8126df11-5b17-4e51-aeb4-0fe0fe4c27fc tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1363 microversion: 2.1 time: 0.191230 Apr 11 20:22:23.898468 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1621/3223] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:23 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:24.055734 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-0dd19eeb-339b-4548-9f5c-5ee141b77ffc req-9bf79617-a964-40ed-87f9-00f13bfcfdff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef80bc27-0d2d-456b-9d3c-dca66a04b84a", "tag": "30b25cec-5229-49f8-84da-7fea364b424c"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:24.065964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-0dd19eeb-339b-4548-9f5c-5ee141b77ffc req-9bf79617-a964-40ed-87f9-00f13bfcfdff service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.066412 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-0dd19eeb-339b-4548-9f5c-5ee141b77ffc req-9bf79617-a964-40ed-87f9-00f13bfcfdff service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.087807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-0dd19eeb-339b-4548-9f5c-5ee141b77ffc req-9bf79617-a964-40ed-87f9-00f13bfcfdff service nova] Creating event network-changed:30b25cec-5229-49f8-84da-7fea364b424c for instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a on hv-cinder-83078 Apr 11 20:22:24.101293 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-0dd19eeb-339b-4548-9f5c-5ee141b77ffc req-9bf79617-a964-40ed-87f9-00f13bfcfdff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049420 Apr 11 20:22:24.102539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1603/3224] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:22:24.766552 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:24.767118 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:24.773888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.774336 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.775096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.775516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.790819 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 382b367c-812d-487b-8506-d246e8eb9a42 could not be found. Apr 11 20:22:24.791406 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 382b367c-812d-487b-8506-d246e8eb9a42 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:24.792262 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fffd6d01-2325-46dc-870c-eafff9b1202c tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 404 len: 111 microversion: 2.1 time: 0.029574 Apr 11 20:22:24.792775 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1622/3225] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:22:24 2022] DELETE /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:22:24.802033 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:24.802712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 382b367c-812d-487b-8506-d246e8eb9a42] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:24.809642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.810083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.812062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.812062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.824300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 382b367c-812d-487b-8506-d246e8eb9a42 could not be found. Apr 11 20:22:24.824880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 382b367c-812d-487b-8506-d246e8eb9a42 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:24.825730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-908f122f-3d79-4a4c-bc91-eb0951176ec4 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42" status: 404 len: 111 microversion: 2.1 time: 0.028561 Apr 11 20:22:24.826227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1604/3226] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:24 2022] GET /compute/v2.1/servers/382b367c-812d-487b-8506-d246e8eb9a42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:22:24.836371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:24.836872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:24.842953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.843405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.844157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.844591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.857680 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 99731dc4-4495-4be7-88d0-764f481cab49 could not be found. Apr 11 20:22:24.858303 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 99731dc4-4495-4be7-88d0-764f481cab49 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:24.859110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-87fbe75b-2122-45e0-aa94-c170558283cb tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 404 len: 111 microversion: 2.1 time: 0.028355 Apr 11 20:22:24.859624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1623/3227] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:22:24 2022] DELETE /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:22:24.867711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:24.868353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 99731dc4-4495-4be7-88d0-764f481cab49] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:24.875075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.875517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.876268 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.876729 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.890573 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 99731dc4-4495-4be7-88d0-764f481cab49 could not be found. Apr 11 20:22:24.891148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 99731dc4-4495-4be7-88d0-764f481cab49 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:22:24.891961 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-322a1d34-8518-4c3f-8698-9926e2c439a3 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49" status: 404 len: 111 microversion: 2.1 time: 0.028138 Apr 11 20:22:24.892492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1605/3228] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:24 2022] GET /compute/v2.1/servers/99731dc4-4495-4be7-88d0-764f481cab49 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:22:24.918432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5b902681-6855-4902-9c8a-68a0952e1362 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:24.919403 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5b902681-6855-4902-9c8a-68a0952e1362 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:24.928431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b902681-6855-4902-9c8a-68a0952e1362 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.928946 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b902681-6855-4902-9c8a-68a0952e1362 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:24.929711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b902681-6855-4902-9c8a-68a0952e1362 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:24.930141 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b902681-6855-4902-9c8a-68a0952e1362 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:25.058429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5b902681-6855-4902-9c8a-68a0952e1362 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:25.065704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5b902681-6855-4902-9c8a-68a0952e1362 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1363 microversion: 2.1 time: 0.153565 Apr 11 20:22:25.066257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1624/3229] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:24 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:26.082631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-586fd6f1-a2db-4d6d-bccb-6498c9478838 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:26.083207 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-586fd6f1-a2db-4d6d-bccb-6498c9478838 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:26.090290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-586fd6f1-a2db-4d6d-bccb-6498c9478838 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:26.090737 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-586fd6f1-a2db-4d6d-bccb-6498c9478838 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:26.091480 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-586fd6f1-a2db-4d6d-bccb-6498c9478838 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:26.091907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-586fd6f1-a2db-4d6d-bccb-6498c9478838 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:26.224539 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-586fd6f1-a2db-4d6d-bccb-6498c9478838 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:26.232730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-586fd6f1-a2db-4d6d-bccb-6498c9478838 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1363 microversion: 2.1 time: 0.154044 Apr 11 20:22:26.233336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1606/3230] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:26 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:27.253086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7e7ff22-96cb-4c90-83c8-7a00c2a7cef0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:27.253828 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7e7ff22-96cb-4c90-83c8-7a00c2a7cef0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:27.261464 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7e7ff22-96cb-4c90-83c8-7a00c2a7cef0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:27.261909 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7e7ff22-96cb-4c90-83c8-7a00c2a7cef0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:27.262674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7e7ff22-96cb-4c90-83c8-7a00c2a7cef0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:27.263102 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7e7ff22-96cb-4c90-83c8-7a00c2a7cef0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:27.392354 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7e7ff22-96cb-4c90-83c8-7a00c2a7cef0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:27.400804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7e7ff22-96cb-4c90-83c8-7a00c2a7cef0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1363 microversion: 2.1 time: 0.154260 Apr 11 20:22:27.401416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1625/3231] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:27 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:28.421881 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cc6bf127-cce6-4ed4-b02b-b4e61295c058 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:28.422747 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc6bf127-cce6-4ed4-b02b-b4e61295c058 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:28.431556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc6bf127-cce6-4ed4-b02b-b4e61295c058 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:28.432003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc6bf127-cce6-4ed4-b02b-b4e61295c058 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:28.432756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc6bf127-cce6-4ed4-b02b-b4e61295c058 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:28.433220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc6bf127-cce6-4ed4-b02b-b4e61295c058 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:28.749304 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc6bf127-cce6-4ed4-b02b-b4e61295c058 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:28.757658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cc6bf127-cce6-4ed4-b02b-b4e61295c058 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1363 microversion: 2.1 time: 0.342258 Apr 11 20:22:28.758418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1607/3232] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:28 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:29.778638 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb470015-86c7-4113-84d4-53a4b799301b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:29.779630 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb470015-86c7-4113-84d4-53a4b799301b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:29.790067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb470015-86c7-4113-84d4-53a4b799301b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:29.790620 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb470015-86c7-4113-84d4-53a4b799301b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:29.791422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb470015-86c7-4113-84d4-53a4b799301b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:29.791858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb470015-86c7-4113-84d4-53a4b799301b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:29.927932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bb470015-86c7-4113-84d4-53a4b799301b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:29.935411 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb470015-86c7-4113-84d4-53a4b799301b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1363 microversion: 2.1 time: 0.163160 Apr 11 20:22:29.935960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1626/3233] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:29 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:30.953714 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d0351e2-2394-422a-bc2c-d9cc8595ec2a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:30.954297 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d0351e2-2394-422a-bc2c-d9cc8595ec2a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:30.960524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d0351e2-2394-422a-bc2c-d9cc8595ec2a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:30.961006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d0351e2-2394-422a-bc2c-d9cc8595ec2a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:30.961794 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d0351e2-2394-422a-bc2c-d9cc8595ec2a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:30.962223 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d0351e2-2394-422a-bc2c-d9cc8595ec2a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:31.030352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-c1977aed-33e3-43b1-8355-aabf15087787 req-40cae75f-84ec-44db-9907-b1b083ba5b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef80bc27-0d2d-456b-9d3c-dca66a04b84a", "name": "network-vif-plugged", "status": "completed", "tag": "30b25cec-5229-49f8-84da-7fea364b424c"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:31.040712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-c1977aed-33e3-43b1-8355-aabf15087787 req-40cae75f-84ec-44db-9907-b1b083ba5b4d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:31.041524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-c1977aed-33e3-43b1-8355-aabf15087787 req-40cae75f-84ec-44db-9907-b1b083ba5b4d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:31.054272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-c1977aed-33e3-43b1-8355-aabf15087787 req-40cae75f-84ec-44db-9907-b1b083ba5b4d service nova] Creating event network-vif-plugged:30b25cec-5229-49f8-84da-7fea364b424c for instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a on hv-cinder-83078 Apr 11 20:22:31.060237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-c1977aed-33e3-43b1-8355-aabf15087787 req-40cae75f-84ec-44db-9907-b1b083ba5b4d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036618 Apr 11 20:22:31.061719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1627/3234] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:22:31.102285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d0351e2-2394-422a-bc2c-d9cc8595ec2a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:31.113316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d0351e2-2394-422a-bc2c-d9cc8595ec2a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1363 microversion: 2.1 time: 0.161043 Apr 11 20:22:31.113316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1608/3235] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:30 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:32.133990 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb3252d6-c3c1-421b-a8cb-15bac281627c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:32.135139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb3252d6-c3c1-421b-a8cb-15bac281627c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:32.145824 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb3252d6-c3c1-421b-a8cb-15bac281627c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:32.146919 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb3252d6-c3c1-421b-a8cb-15bac281627c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:32.147509 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb3252d6-c3c1-421b-a8cb-15bac281627c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:32.147934 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb3252d6-c3c1-421b-a8cb-15bac281627c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:32.294197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cb3252d6-c3c1-421b-a8cb-15bac281627c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:32.301624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb3252d6-c3c1-421b-a8cb-15bac281627c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1363 microversion: 2.1 time: 0.175490 Apr 11 20:22:32.302215 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1628/3236] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:32 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:33.319851 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec9ae6aa-b79a-4bc0-bc08-f4cbff0b5a6e tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:33.320457 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec9ae6aa-b79a-4bc0-bc08-f4cbff0b5a6e tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:33.327059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec9ae6aa-b79a-4bc0-bc08-f4cbff0b5a6e tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:33.327505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec9ae6aa-b79a-4bc0-bc08-f4cbff0b5a6e tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:33.328256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec9ae6aa-b79a-4bc0-bc08-f4cbff0b5a6e tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:33.328685 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec9ae6aa-b79a-4bc0-bc08-f4cbff0b5a6e tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:33.466014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ec9ae6aa-b79a-4bc0-bc08-f4cbff0b5a6e tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:22:33.473197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec9ae6aa-b79a-4bc0-bc08-f4cbff0b5a6e tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1550 microversion: 2.1 time: 0.157971 Apr 11 20:22:33.473882 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1609/3237] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:22:33 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:22:33.489489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d59834d-77ca-45a1-a9c1-ce8b16371b80 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:22:33.490094 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d59834d-77ca-45a1-a9c1-ce8b16371b80 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:22:33.496739 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d59834d-77ca-45a1-a9c1-ce8b16371b80 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:33.497221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d59834d-77ca-45a1-a9c1-ce8b16371b80 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:33.497977 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d59834d-77ca-45a1-a9c1-ce8b16371b80 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:33.498405 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d59834d-77ca-45a1-a9c1-ce8b16371b80 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:33.574606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d59834d-77ca-45a1-a9c1-ce8b16371b80 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088913 Apr 11 20:22:33.575202 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1629/3238] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Apr 11 20:22:33 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:22:34.807931 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-1eb920ae-6895-464c-89cd-2ed9573bdd22 req-95d1eb13-d397-4276-b9cf-395c8fe6241f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef80bc27-0d2d-456b-9d3c-dca66a04b84a", "tag": "30b25cec-5229-49f8-84da-7fea364b424c"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:34.817625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-1eb920ae-6895-464c-89cd-2ed9573bdd22 req-95d1eb13-d397-4276-b9cf-395c8fe6241f service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:22:34.818534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-1eb920ae-6895-464c-89cd-2ed9573bdd22 req-95d1eb13-d397-4276-b9cf-395c8fe6241f service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:22:34.829690 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-1eb920ae-6895-464c-89cd-2ed9573bdd22 req-95d1eb13-d397-4276-b9cf-395c8fe6241f service nova] Creating event network-changed:30b25cec-5229-49f8-84da-7fea364b424c for instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a on hv-cinder-83078 Apr 11 20:22:34.835074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-1eb920ae-6895-464c-89cd-2ed9573bdd22 req-95d1eb13-d397-4276-b9cf-395c8fe6241f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030677 Apr 11 20:22:34.835858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1610/3239] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:22:45.143574 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b69d2ccb-a014-4a5a-bf18-a0c21f9d1a5e tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Action: 'create', calling method: .version_select at 0x7f408fedd4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-810902360"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:22:45.160489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-b69d2ccb-a014-4a5a-bf18-a0c21f9d1a5e tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Getting quotas for project 8b20dc3215424969b60db8972a86d057. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:22:45.171756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-b69d2ccb-a014-4a5a-bf18-a0c21f9d1a5e tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Getting quotas for user 13e2b4af246a4f5fa21af2954872d022 and project 8b20dc3215424969b60db8972a86d057. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:22:45.356889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-b69d2ccb-a014-4a5a-bf18-a0c21f9d1a5e tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Getting quotas for project 8b20dc3215424969b60db8972a86d057. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:22:45.360524 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-b69d2ccb-a014-4a5a-bf18-a0c21f9d1a5e tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Getting quotas for user 13e2b4af246a4f5fa21af2954872d022 and project 8b20dc3215424969b60db8972a86d057. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:22:45.373669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b69d2ccb-a014-4a5a-bf18-a0c21f9d1a5e tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.420836 Apr 11 20:22:45.374305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1630/3240] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 20:22:44 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:02.824473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1877182166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-810902360", "security_groups": [{"name": "tempest-secgroup-smoke-720916620"}], "networks": [{"uuid": "c9a142f5-8c8c-4877-87b7-f069137bc878"}], "block_device_mapping_v2": [{"uuid": "eb75d160-5c67-40ef-89fd-91bee7390ff1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:23:02.943273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] validate_networks() for [('c9a142f5-8c8c-4877-87b7-f069137bc878', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 20:23:03.320058 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:23:03.320479 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:23:03.320946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:23:03.321373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:23:03.321775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:23:03.331744 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:03.332189 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:03.332992 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:03.333431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:03.350175 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Getting quotas for project 8b20dc3215424969b60db8972a86d057. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:23:03.354211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Getting quotas for user 13e2b4af246a4f5fa21af2954872d022 and project 8b20dc3215424969b60db8972a86d057. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:23:03.413037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 20:23:03.415217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb75d160-5c67-40ef-89fd-91bee7390ff1',volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 20:23:03.546706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-487cf865-2c94-4e8d-a3a2-d4e5197c6af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727026 Apr 11 20:23:03.547348 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1611/3241] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 20:23:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 20:23:03.558774 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-418a3158-b711-4b1d-9421-661ab58190d2 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:03.559379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-418a3158-b711-4b1d-9421-661ab58190d2 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:03.611652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-418a3158-b711-4b1d-9421-661ab58190d2 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:03.618180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-418a3158-b711-4b1d-9421-661ab58190d2 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1088 microversion: 2.1 time: 0.064062 Apr 11 20:23:03.618749 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1631/3242] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:03 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:04.636081 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db870b81-a5fc-41c9-bf0c-60a10cbb308a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:04.636749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db870b81-a5fc-41c9-bf0c-60a10cbb308a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:04.643495 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db870b81-a5fc-41c9-bf0c-60a10cbb308a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:04.643959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db870b81-a5fc-41c9-bf0c-60a10cbb308a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:04.644774 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db870b81-a5fc-41c9-bf0c-60a10cbb308a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:04.645239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db870b81-a5fc-41c9-bf0c-60a10cbb308a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:04.711229 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db870b81-a5fc-41c9-bf0c-60a10cbb308a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:04.719277 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db870b81-a5fc-41c9-bf0c-60a10cbb308a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1204 microversion: 2.1 time: 0.087641 Apr 11 20:23:04.720217 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1612/3243] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:04 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:05.736452 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-406b0aae-8493-4b25-a72e-a186673051e4 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:05.737217 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-406b0aae-8493-4b25-a72e-a186673051e4 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:05.743940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406b0aae-8493-4b25-a72e-a186673051e4 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:05.744453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406b0aae-8493-4b25-a72e-a186673051e4 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:05.745293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406b0aae-8493-4b25-a72e-a186673051e4 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:05.745724 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406b0aae-8493-4b25-a72e-a186673051e4 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:05.868598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-d550f32f-73ca-45bf-9ff1-3effa18616a1 req-6906f74f-ae12-4641-9e95-a022637a423b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667623bc-9455-44c7-bdaa-c3eeed390b84", "tag": "cba49c7f-a7cc-4317-8f36-687aad464b69"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:23:05.880257 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d550f32f-73ca-45bf-9ff1-3effa18616a1 req-6906f74f-ae12-4641-9e95-a022637a423b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:05.881023 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d550f32f-73ca-45bf-9ff1-3effa18616a1 req-6906f74f-ae12-4641-9e95-a022637a423b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:05.900469 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-d550f32f-73ca-45bf-9ff1-3effa18616a1 req-6906f74f-ae12-4641-9e95-a022637a423b service nova] Creating event network-changed:cba49c7f-a7cc-4317-8f36-687aad464b69 for instance 667623bc-9455-44c7-bdaa-c3eeed390b84 on hv-cinder-83078 Apr 11 20:23:05.907121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-d550f32f-73ca-45bf-9ff1-3effa18616a1 req-6906f74f-ae12-4641-9e95-a022637a423b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042317 Apr 11 20:23:05.911244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1613/3244] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:23:05.915015 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-406b0aae-8493-4b25-a72e-a186673051e4 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:05.923886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-406b0aae-8493-4b25-a72e-a186673051e4 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.191721 Apr 11 20:23:05.924569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1632/3245] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:05 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:06.942467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f4dcebde-9df4-405c-80d1-6f380b37390a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:06.943164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f4dcebde-9df4-405c-80d1-6f380b37390a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:06.950148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4dcebde-9df4-405c-80d1-6f380b37390a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:06.950526 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4dcebde-9df4-405c-80d1-6f380b37390a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:06.951285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4dcebde-9df4-405c-80d1-6f380b37390a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:06.951717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f4dcebde-9df4-405c-80d1-6f380b37390a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:07.082477 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f4dcebde-9df4-405c-80d1-6f380b37390a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:07.090712 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f4dcebde-9df4-405c-80d1-6f380b37390a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.153184 Apr 11 20:23:07.091278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1614/3246] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:06 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:08.112695 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-be65f0a7-fd9b-4971-a9f9-2521dce7404c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:08.113769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-be65f0a7-fd9b-4971-a9f9-2521dce7404c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:08.124803 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be65f0a7-fd9b-4971-a9f9-2521dce7404c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:08.125477 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be65f0a7-fd9b-4971-a9f9-2521dce7404c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:08.126228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be65f0a7-fd9b-4971-a9f9-2521dce7404c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:08.126659 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be65f0a7-fd9b-4971-a9f9-2521dce7404c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:08.262859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-be65f0a7-fd9b-4971-a9f9-2521dce7404c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:08.270733 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-be65f0a7-fd9b-4971-a9f9-2521dce7404c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.164486 Apr 11 20:23:08.271300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1633/3247] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:08 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:09.292329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00eca48f-67d0-4cc2-a3c9-76e59be0cbf6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:09.293509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00eca48f-67d0-4cc2-a3c9-76e59be0cbf6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:09.306638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00eca48f-67d0-4cc2-a3c9-76e59be0cbf6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:09.307393 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00eca48f-67d0-4cc2-a3c9-76e59be0cbf6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:09.308637 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00eca48f-67d0-4cc2-a3c9-76e59be0cbf6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:09.309447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00eca48f-67d0-4cc2-a3c9-76e59be0cbf6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:09.452472 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00eca48f-67d0-4cc2-a3c9-76e59be0cbf6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:09.460362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00eca48f-67d0-4cc2-a3c9-76e59be0cbf6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.174809 Apr 11 20:23:09.460933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1615/3248] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:09 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:10.477628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1a58b137-ef54-49b7-8ccd-d22e729ce1ce tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:10.478194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1a58b137-ef54-49b7-8ccd-d22e729ce1ce tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:10.485738 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a58b137-ef54-49b7-8ccd-d22e729ce1ce tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:10.486333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a58b137-ef54-49b7-8ccd-d22e729ce1ce tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:10.487343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a58b137-ef54-49b7-8ccd-d22e729ce1ce tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:10.487756 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a58b137-ef54-49b7-8ccd-d22e729ce1ce tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:10.628216 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1a58b137-ef54-49b7-8ccd-d22e729ce1ce tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:10.635866 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1a58b137-ef54-49b7-8ccd-d22e729ce1ce tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.162348 Apr 11 20:23:10.636431 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1634/3249] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:10 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:10.992218 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a17b3197-caf1-42fc-a88a-fe2e408d0493 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:10.992823 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a17b3197-caf1-42fc-a88a-fe2e408d0493 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:11.006010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a17b3197-caf1-42fc-a88a-fe2e408d0493 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:11.006693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a17b3197-caf1-42fc-a88a-fe2e408d0493 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:11.007813 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a17b3197-caf1-42fc-a88a-fe2e408d0493 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:11.008286 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a17b3197-caf1-42fc-a88a-fe2e408d0493 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:11.034010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a17b3197-caf1-42fc-a88a-fe2e408d0493 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/ips" status: 200 len: 147 microversion: 2.1 time: 0.045625 Apr 11 20:23:11.034579 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1616/3250] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 20:23:10 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/ips => generated 147 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:23:11.653170 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-264f10a9-796f-431d-9fe5-d969d562200d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:11.653922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-264f10a9-796f-431d-9fe5-d969d562200d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:11.661908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-264f10a9-796f-431d-9fe5-d969d562200d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:11.662460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-264f10a9-796f-431d-9fe5-d969d562200d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:11.663390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-264f10a9-796f-431d-9fe5-d969d562200d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:11.664162 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-264f10a9-796f-431d-9fe5-d969d562200d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:11.799163 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-264f10a9-796f-431d-9fe5-d969d562200d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:11.806594 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-264f10a9-796f-431d-9fe5-d969d562200d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.158200 Apr 11 20:23:11.807154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1635/3251] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:11 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:12.827562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d002a96-cc77-4c10-8138-385e02c43a5c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:12.828517 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d002a96-cc77-4c10-8138-385e02c43a5c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:12.839162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d002a96-cc77-4c10-8138-385e02c43a5c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:12.839906 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d002a96-cc77-4c10-8138-385e02c43a5c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:12.841196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d002a96-cc77-4c10-8138-385e02c43a5c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:12.841916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d002a96-cc77-4c10-8138-385e02c43a5c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:12.971343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d002a96-cc77-4c10-8138-385e02c43a5c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:12.979371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d002a96-cc77-4c10-8138-385e02c43a5c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.158329 Apr 11 20:23:12.979940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1617/3252] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:12 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:13.532769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a01fa540-3aca-40c8-a2fb-4c9c6cea3c42 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c30a7be2-7500-493f-9738-3805adbb7c66"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:23:13.533988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a01fa540-3aca-40c8-a2fb-4c9c6cea3c42 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:13.540326 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a01fa540-3aca-40c8-a2fb-4c9c6cea3c42 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:13.541422 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a01fa540-3aca-40c8-a2fb-4c9c6cea3c42 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:13.542042 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a01fa540-3aca-40c8-a2fb-4c9c6cea3c42 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:13.542617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a01fa540-3aca-40c8-a2fb-4c9c6cea3c42 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:13.794889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a01fa540-3aca-40c8-a2fb-4c9c6cea3c42 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265952 Apr 11 20:23:13.795674 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1636/3253] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 20:23:13 2022] POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:23:13.996616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79408f62-df13-4854-b6a5-e39992d8411d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:13.997272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-79408f62-df13-4854-b6a5-e39992d8411d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:14.003652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79408f62-df13-4854-b6a5-e39992d8411d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:14.004101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79408f62-df13-4854-b6a5-e39992d8411d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:14.004853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79408f62-df13-4854-b6a5-e39992d8411d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:14.005317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79408f62-df13-4854-b6a5-e39992d8411d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:14.143251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79408f62-df13-4854-b6a5-e39992d8411d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:14.150897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79408f62-df13-4854-b6a5-e39992d8411d tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.158632 Apr 11 20:23:14.151428 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1618/3254] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:13 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:15.168383 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7782280-13ea-4bd3-a4c1-fa08b3552d14 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:15.169113 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7782280-13ea-4bd3-a4c1-fa08b3552d14 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:15.175971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7782280-13ea-4bd3-a4c1-fa08b3552d14 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:15.176432 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7782280-13ea-4bd3-a4c1-fa08b3552d14 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:15.177244 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7782280-13ea-4bd3-a4c1-fa08b3552d14 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:15.177673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7782280-13ea-4bd3-a4c1-fa08b3552d14 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:15.312276 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a7782280-13ea-4bd3-a4c1-fa08b3552d14 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:15.319949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7782280-13ea-4bd3-a4c1-fa08b3552d14 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.155883 Apr 11 20:23:15.320523 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1637/3255] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:15 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:16.340488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cb2097d6-eb96-47d9-8b83-adef92cc41aa tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:16.341686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cb2097d6-eb96-47d9-8b83-adef92cc41aa tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:16.352562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb2097d6-eb96-47d9-8b83-adef92cc41aa tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:16.353363 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb2097d6-eb96-47d9-8b83-adef92cc41aa tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:16.354606 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb2097d6-eb96-47d9-8b83-adef92cc41aa tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:16.355317 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb2097d6-eb96-47d9-8b83-adef92cc41aa tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:16.510800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb2097d6-eb96-47d9-8b83-adef92cc41aa tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:16.522822 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cb2097d6-eb96-47d9-8b83-adef92cc41aa tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.188498 Apr 11 20:23:16.523689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1619/3256] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:16 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:17.272039 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-fc33a6aa-fa65-4585-8382-b40363058763 req-ab9aa86f-0286-48b6-abda-a3df4854d33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667623bc-9455-44c7-bdaa-c3eeed390b84", "name": "network-vif-plugged", "status": "completed", "tag": "cba49c7f-a7cc-4317-8f36-687aad464b69"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:23:17.281098 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-fc33a6aa-fa65-4585-8382-b40363058763 req-ab9aa86f-0286-48b6-abda-a3df4854d33d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:17.281455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-fc33a6aa-fa65-4585-8382-b40363058763 req-ab9aa86f-0286-48b6-abda-a3df4854d33d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:17.292508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-fc33a6aa-fa65-4585-8382-b40363058763 req-ab9aa86f-0286-48b6-abda-a3df4854d33d service nova] Creating event network-vif-plugged:cba49c7f-a7cc-4317-8f36-687aad464b69 for instance 667623bc-9455-44c7-bdaa-c3eeed390b84 on hv-cinder-83078 Apr 11 20:23:17.297481 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-fc33a6aa-fa65-4585-8382-b40363058763 req-ab9aa86f-0286-48b6-abda-a3df4854d33d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029855 Apr 11 20:23:17.298080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1638/3257] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:23:17.544127 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-59e5b2f2-ea6c-4652-92c7-0da234c687a6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:17.544891 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-59e5b2f2-ea6c-4652-92c7-0da234c687a6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:17.551652 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59e5b2f2-ea6c-4652-92c7-0da234c687a6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:17.552102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59e5b2f2-ea6c-4652-92c7-0da234c687a6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:17.552916 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59e5b2f2-ea6c-4652-92c7-0da234c687a6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:17.553361 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59e5b2f2-ea6c-4652-92c7-0da234c687a6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:17.701674 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-59e5b2f2-ea6c-4652-92c7-0da234c687a6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:17.709762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-59e5b2f2-ea6c-4652-92c7-0da234c687a6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1259 microversion: 2.1 time: 0.170090 Apr 11 20:23:17.710332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1620/3258] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:17 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:18.732711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0caf74fd-2623-4ca4-93cf-e55fa029319a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:18.733885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0caf74fd-2623-4ca4-93cf-e55fa029319a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:18.744484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0caf74fd-2623-4ca4-93cf-e55fa029319a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:18.745284 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0caf74fd-2623-4ca4-93cf-e55fa029319a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:18.746910 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0caf74fd-2623-4ca4-93cf-e55fa029319a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:18.747624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0caf74fd-2623-4ca4-93cf-e55fa029319a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:18.896687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0caf74fd-2623-4ca4-93cf-e55fa029319a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:18.905322 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0caf74fd-2623-4ca4-93cf-e55fa029319a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1442 microversion: 2.1 time: 0.180541 Apr 11 20:23:18.905889 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1639/3259] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:18 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1442 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:18.921410 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e5bd87bf-d031-44cb-a883-a3f374522981 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:18.922015 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e5bd87bf-d031-44cb-a883-a3f374522981 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:18.928490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5bd87bf-d031-44cb-a883-a3f374522981 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:18.928965 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5bd87bf-d031-44cb-a883-a3f374522981 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:18.929726 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5bd87bf-d031-44cb-a883-a3f374522981 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:18.930158 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5bd87bf-d031-44cb-a883-a3f374522981 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:19.063761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5bd87bf-d031-44cb-a883-a3f374522981 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:19.074449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e5bd87bf-d031-44cb-a883-a3f374522981 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1442 microversion: 2.1 time: 0.156949 Apr 11 20:23:19.075250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1621/3260] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:18 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:20.233708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-19653118-d903-4b52-bbe4-54fb854539d8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:23:20.239673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19653118-d903-4b52-bbe4-54fb854539d8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:20.240117 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19653118-d903-4b52-bbe4-54fb854539d8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:20.299010 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-19653118-d903-4b52-bbe4-54fb854539d8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Going to try to stop instance {{(pid=123637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 11 20:23:20.348849 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-19653118-d903-4b52-bbe4-54fb854539d8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/action" status: 202 len: 0 microversion: 2.1 time: 0.118928 Apr 11 20:23:20.349545 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1640/3261] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 20:23:20 2022] POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:23:20.357620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a22d16ba-564f-47d2-9a00-232cf7a34bb6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:20.358233 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a22d16ba-564f-47d2-9a00-232cf7a34bb6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:20.364551 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a22d16ba-564f-47d2-9a00-232cf7a34bb6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:20.365038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a22d16ba-564f-47d2-9a00-232cf7a34bb6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:20.365784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a22d16ba-564f-47d2-9a00-232cf7a34bb6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:20.366211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a22d16ba-564f-47d2-9a00-232cf7a34bb6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:20.497152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a22d16ba-564f-47d2-9a00-232cf7a34bb6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:20.505967 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a22d16ba-564f-47d2-9a00-232cf7a34bb6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.151942 Apr 11 20:23:20.506504 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1622/3262] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:20 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:21.089177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-76f1361d-c24a-4b22-afa0-b72b412df008 req-ba36ec44-430c-4051-8338-92d9c648e24e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667623bc-9455-44c7-bdaa-c3eeed390b84", "tag": "cba49c7f-a7cc-4317-8f36-687aad464b69"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:23:21.097388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-76f1361d-c24a-4b22-afa0-b72b412df008 req-ba36ec44-430c-4051-8338-92d9c648e24e service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:21.097575 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-76f1361d-c24a-4b22-afa0-b72b412df008 req-ba36ec44-430c-4051-8338-92d9c648e24e service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:21.108166 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-76f1361d-c24a-4b22-afa0-b72b412df008 req-ba36ec44-430c-4051-8338-92d9c648e24e service nova] Creating event network-changed:cba49c7f-a7cc-4317-8f36-687aad464b69 for instance 667623bc-9455-44c7-bdaa-c3eeed390b84 on hv-cinder-83078 Apr 11 20:23:21.113192 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-76f1361d-c24a-4b22-afa0-b72b412df008 req-ba36ec44-430c-4051-8338-92d9c648e24e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028780 Apr 11 20:23:21.113781 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1641/3263] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:23:21.523980 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a868f52a-4c5c-47d6-b1ac-61c0d4c53169 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:21.524626 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a868f52a-4c5c-47d6-b1ac-61c0d4c53169 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:21.531467 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a868f52a-4c5c-47d6-b1ac-61c0d4c53169 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:21.532172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a868f52a-4c5c-47d6-b1ac-61c0d4c53169 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:21.532955 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a868f52a-4c5c-47d6-b1ac-61c0d4c53169 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:21.533559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a868f52a-4c5c-47d6-b1ac-61c0d4c53169 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:21.682738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a868f52a-4c5c-47d6-b1ac-61c0d4c53169 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:21.690884 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a868f52a-4c5c-47d6-b1ac-61c0d4c53169 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.170822 Apr 11 20:23:21.691463 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1623/3264] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:21 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:22.714424 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb8ad400-6441-42d6-b53f-211785586682 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:22.715584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb8ad400-6441-42d6-b53f-211785586682 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:22.724203 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb8ad400-6441-42d6-b53f-211785586682 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:22.724656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb8ad400-6441-42d6-b53f-211785586682 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:22.725455 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb8ad400-6441-42d6-b53f-211785586682 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:22.725888 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb8ad400-6441-42d6-b53f-211785586682 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:22.856954 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bb8ad400-6441-42d6-b53f-211785586682 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:22.865970 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb8ad400-6441-42d6-b53f-211785586682 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.159631 Apr 11 20:23:22.866526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1642/3265] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:22 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:23.887853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b61a732-4dd1-48d3-86c4-8dbb5762226d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:23.888883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b61a732-4dd1-48d3-86c4-8dbb5762226d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:23.897362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b61a732-4dd1-48d3-86c4-8dbb5762226d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:23.897819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b61a732-4dd1-48d3-86c4-8dbb5762226d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:23.898565 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b61a732-4dd1-48d3-86c4-8dbb5762226d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:23.899036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b61a732-4dd1-48d3-86c4-8dbb5762226d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:24.039131 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3b61a732-4dd1-48d3-86c4-8dbb5762226d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:24.048341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b61a732-4dd1-48d3-86c4-8dbb5762226d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.167082 Apr 11 20:23:24.048952 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1624/3266] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:23 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:25.070071 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-609528e5-2150-4b22-8fb5-569c661aa2d6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:25.071006 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-609528e5-2150-4b22-8fb5-569c661aa2d6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:25.081100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-609528e5-2150-4b22-8fb5-569c661aa2d6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:25.081844 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-609528e5-2150-4b22-8fb5-569c661aa2d6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:25.082918 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-609528e5-2150-4b22-8fb5-569c661aa2d6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:25.083343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-609528e5-2150-4b22-8fb5-569c661aa2d6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:25.212835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-609528e5-2150-4b22-8fb5-569c661aa2d6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:25.220799 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-609528e5-2150-4b22-8fb5-569c661aa2d6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.157326 Apr 11 20:23:25.221614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1643/3267] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:25 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:26.247878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0dda688b-ac96-4ccc-a1cd-6acf05507cbb tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:26.248959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0dda688b-ac96-4ccc-a1cd-6acf05507cbb tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:26.257950 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dda688b-ac96-4ccc-a1cd-6acf05507cbb tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:26.258100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dda688b-ac96-4ccc-a1cd-6acf05507cbb tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:26.258888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dda688b-ac96-4ccc-a1cd-6acf05507cbb tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:26.259337 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dda688b-ac96-4ccc-a1cd-6acf05507cbb tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:26.389341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0dda688b-ac96-4ccc-a1cd-6acf05507cbb tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:26.397853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0dda688b-ac96-4ccc-a1cd-6acf05507cbb tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.157109 Apr 11 20:23:26.398431 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1625/3268] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:26 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:27.419206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d21a96e1-29a2-4d1b-a651-a3d294b81575 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:27.420132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d21a96e1-29a2-4d1b-a651-a3d294b81575 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:27.429077 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21a96e1-29a2-4d1b-a651-a3d294b81575 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:27.429517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21a96e1-29a2-4d1b-a651-a3d294b81575 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:27.430267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21a96e1-29a2-4d1b-a651-a3d294b81575 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:27.430721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21a96e1-29a2-4d1b-a651-a3d294b81575 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:27.573340 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d21a96e1-29a2-4d1b-a651-a3d294b81575 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:27.586669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d21a96e1-29a2-4d1b-a651-a3d294b81575 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.169450 Apr 11 20:23:27.586669 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1644/3269] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:27 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:28.599447 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2cec42d9-81bd-4b05-b991-bef9620f7657 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:28.600064 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2cec42d9-81bd-4b05-b991-bef9620f7657 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:28.606764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cec42d9-81bd-4b05-b991-bef9620f7657 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:28.607201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cec42d9-81bd-4b05-b991-bef9620f7657 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:28.607968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cec42d9-81bd-4b05-b991-bef9620f7657 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:28.608406 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cec42d9-81bd-4b05-b991-bef9620f7657 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:28.733576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2cec42d9-81bd-4b05-b991-bef9620f7657 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:28.742053 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2cec42d9-81bd-4b05-b991-bef9620f7657 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.146579 Apr 11 20:23:28.742624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1626/3270] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:28 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:29.759766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b5f4f2e2-c38b-4409-9c8a-924ed7166e88 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:29.760343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b5f4f2e2-c38b-4409-9c8a-924ed7166e88 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:29.767221 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5f4f2e2-c38b-4409-9c8a-924ed7166e88 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:29.767661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5f4f2e2-c38b-4409-9c8a-924ed7166e88 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:29.768407 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5f4f2e2-c38b-4409-9c8a-924ed7166e88 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:29.768835 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5f4f2e2-c38b-4409-9c8a-924ed7166e88 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:29.901157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b5f4f2e2-c38b-4409-9c8a-924ed7166e88 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:29.909777 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b5f4f2e2-c38b-4409-9c8a-924ed7166e88 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1725 microversion: 2.1 time: 0.153867 Apr 11 20:23:29.910435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1645/3271] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:29 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:30.931717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a4ed7ec0-228e-401c-81b7-7c9591ac64a3 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:30.932761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a4ed7ec0-228e-401c-81b7-7c9591ac64a3 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:30.942925 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4ed7ec0-228e-401c-81b7-7c9591ac64a3 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:30.943379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4ed7ec0-228e-401c-81b7-7c9591ac64a3 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:30.944228 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4ed7ec0-228e-401c-81b7-7c9591ac64a3 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:30.944661 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4ed7ec0-228e-401c-81b7-7c9591ac64a3 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:31.081493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a4ed7ec0-228e-401c-81b7-7c9591ac64a3 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:31.090352 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a4ed7ec0-228e-401c-81b7-7c9591ac64a3 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1702 microversion: 2.1 time: 0.165560 Apr 11 20:23:31.090928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1627/3272] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:30 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1702 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:31.112569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3a988d1b-99fa-41fb-b061-68050f5a2065 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:23:31.119616 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a988d1b-99fa-41fb-b061-68050f5a2065 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:31.120067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a988d1b-99fa-41fb-b061-68050f5a2065 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:31.142278 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3a988d1b-99fa-41fb-b061-68050f5a2065 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Going to try to start instance {{(pid=123637) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 11 20:23:31.188044 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3a988d1b-99fa-41fb-b061-68050f5a2065 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/action" status: 202 len: 0 microversion: 2.1 time: 0.079263 Apr 11 20:23:31.188938 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1646/3273] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 20:23:31 2022] POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:23:31.202251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-51b7de64-261a-4403-85fb-5341e9fbe5d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:31.202947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-51b7de64-261a-4403-85fb-5341e9fbe5d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:31.209900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51b7de64-261a-4403-85fb-5341e9fbe5d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:31.210355 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51b7de64-261a-4403-85fb-5341e9fbe5d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:31.211117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51b7de64-261a-4403-85fb-5341e9fbe5d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:31.211547 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51b7de64-261a-4403-85fb-5341e9fbe5d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:31.350691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-51b7de64-261a-4403-85fb-5341e9fbe5d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:31.359256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-51b7de64-261a-4403-85fb-5341e9fbe5d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1711 microversion: 2.1 time: 0.161110 Apr 11 20:23:31.360117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1628/3274] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:31 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:32.383668 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0c226862-cc79-4742-9ab7-7d9b517afd50 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:32.384834 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0c226862-cc79-4742-9ab7-7d9b517afd50 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:32.395248 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c226862-cc79-4742-9ab7-7d9b517afd50 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:32.395702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c226862-cc79-4742-9ab7-7d9b517afd50 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:32.396471 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c226862-cc79-4742-9ab7-7d9b517afd50 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:32.396925 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c226862-cc79-4742-9ab7-7d9b517afd50 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:32.529606 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0c226862-cc79-4742-9ab7-7d9b517afd50 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:32.538001 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0c226862-cc79-4742-9ab7-7d9b517afd50 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1711 microversion: 2.1 time: 0.162526 Apr 11 20:23:32.538576 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1647/3275] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:32 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:23:33.559921 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7fa7918-330e-4d2b-8c94-147f18a12339 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:23:33.560787 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7fa7918-330e-4d2b-8c94-147f18a12339 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:23:33.569742 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7fa7918-330e-4d2b-8c94-147f18a12339 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:33.570187 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7fa7918-330e-4d2b-8c94-147f18a12339 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:33.570939 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7fa7918-330e-4d2b-8c94-147f18a12339 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:23:33.571371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7fa7918-330e-4d2b-8c94-147f18a12339 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:23:33.700880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7fa7918-330e-4d2b-8c94-147f18a12339 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:23:33.709482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7fa7918-330e-4d2b-8c94-147f18a12339 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1715 microversion: 2.1 time: 0.156186 Apr 11 20:23:33.710028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1629/3276] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:23:33 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:06.126289 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5825197f-234f-4e34-93d0-5b173cd0f587 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:06.127205 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5825197f-234f-4e34-93d0-5b173cd0f587 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:06.135955 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5825197f-234f-4e34-93d0-5b173cd0f587 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:06.136590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5825197f-234f-4e34-93d0-5b173cd0f587 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:06.137709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5825197f-234f-4e34-93d0-5b173cd0f587 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:06.138319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5825197f-234f-4e34-93d0-5b173cd0f587 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:06.221325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-5825197f-234f-4e34-93d0-5b173cd0f587 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lazy-loading 'services' on Instance uuid ef80bc27-0d2d-456b-9d3c-dca66a04b84a {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:24:06.301073 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5825197f-234f-4e34-93d0-5b173cd0f587 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/os-volume_attachments/c30a7be2-7500-493f-9738-3805adbb7c66" status: 202 len: 0 microversion: 2.1 time: 0.180906 Apr 11 20:24:06.301691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1648/3277] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:24:06 2022] DELETE /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/os-volume_attachments/c30a7be2-7500-493f-9738-3805adbb7c66 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:24:07.431256 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9633f4c9-cbff-4be9-9d23-6a527ee97f65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:24:07.437670 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9633f4c9-cbff-4be9-9d23-6a527ee97f65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:07.438116 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9633f4c9-cbff-4be9-9d23-6a527ee97f65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:07.496356 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9633f4c9-cbff-4be9-9d23-6a527ee97f65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Going to try to stop instance {{(pid=123638) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 11 20:24:07.543157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9633f4c9-cbff-4be9-9d23-6a527ee97f65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/action" status: 202 len: 0 microversion: 2.1 time: 0.115663 Apr 11 20:24:07.543913 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1630/3278] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 20:24:07 2022] POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:24:07.553416 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-998b6e45-2e65-40b0-ae67-d171e580f0a1 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:07.554101 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-998b6e45-2e65-40b0-ae67-d171e580f0a1 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:07.561751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-998b6e45-2e65-40b0-ae67-d171e580f0a1 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:07.562177 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-998b6e45-2e65-40b0-ae67-d171e580f0a1 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:07.563060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-998b6e45-2e65-40b0-ae67-d171e580f0a1 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:07.563506 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-998b6e45-2e65-40b0-ae67-d171e580f0a1 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:07.701696 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-998b6e45-2e65-40b0-ae67-d171e580f0a1 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:07.709719 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-998b6e45-2e65-40b0-ae67-d171e580f0a1 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.160782 Apr 11 20:24:07.710283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1649/3279] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:07 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:08.733142 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fbef8d78-1ad9-4872-8225-99be17da994b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:08.734289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fbef8d78-1ad9-4872-8225-99be17da994b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:08.744876 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbef8d78-1ad9-4872-8225-99be17da994b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:08.745671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbef8d78-1ad9-4872-8225-99be17da994b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:08.747308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbef8d78-1ad9-4872-8225-99be17da994b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:08.748026 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbef8d78-1ad9-4872-8225-99be17da994b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:08.880080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fbef8d78-1ad9-4872-8225-99be17da994b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:08.887494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fbef8d78-1ad9-4872-8225-99be17da994b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.162295 Apr 11 20:24:08.888059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1631/3280] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:08 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:09.908242 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-febf9c0c-f821-4a90-b825-9a9fec4ee905 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:09.909157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-febf9c0c-f821-4a90-b825-9a9fec4ee905 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:09.918894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-febf9c0c-f821-4a90-b825-9a9fec4ee905 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:09.919572 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-febf9c0c-f821-4a90-b825-9a9fec4ee905 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:09.920709 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-febf9c0c-f821-4a90-b825-9a9fec4ee905 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:09.921449 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-febf9c0c-f821-4a90-b825-9a9fec4ee905 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:10.053516 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-febf9c0c-f821-4a90-b825-9a9fec4ee905 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:10.061343 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-febf9c0c-f821-4a90-b825-9a9fec4ee905 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.159173 Apr 11 20:24:10.061908 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1650/3281] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:09 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:11.079624 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54ddb0f6-065a-49e3-bde3-2a1eb1bf6d8d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:11.080235 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54ddb0f6-065a-49e3-bde3-2a1eb1bf6d8d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:11.086671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54ddb0f6-065a-49e3-bde3-2a1eb1bf6d8d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:11.087120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54ddb0f6-065a-49e3-bde3-2a1eb1bf6d8d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:11.087874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54ddb0f6-065a-49e3-bde3-2a1eb1bf6d8d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:11.088309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54ddb0f6-065a-49e3-bde3-2a1eb1bf6d8d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:11.220295 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54ddb0f6-065a-49e3-bde3-2a1eb1bf6d8d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:11.228138 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54ddb0f6-065a-49e3-bde3-2a1eb1bf6d8d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.152381 Apr 11 20:24:11.228701 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1632/3282] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:11 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:12.249935 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-156f999d-ade8-4183-ad07-1a1d6ee23de8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:12.250942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-156f999d-ade8-4183-ad07-1a1d6ee23de8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:12.259465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-156f999d-ade8-4183-ad07-1a1d6ee23de8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:12.259913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-156f999d-ade8-4183-ad07-1a1d6ee23de8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:12.260711 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-156f999d-ade8-4183-ad07-1a1d6ee23de8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:12.261188 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-156f999d-ade8-4183-ad07-1a1d6ee23de8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:12.402613 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-156f999d-ade8-4183-ad07-1a1d6ee23de8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:12.410156 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-156f999d-ade8-4183-ad07-1a1d6ee23de8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.167211 Apr 11 20:24:12.410727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1651/3283] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:12 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:13.427866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b9d704b8-ec90-4dab-a372-85c82c826932 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:13.428490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b9d704b8-ec90-4dab-a372-85c82c826932 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:13.435069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9d704b8-ec90-4dab-a372-85c82c826932 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:13.435518 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9d704b8-ec90-4dab-a372-85c82c826932 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:13.436341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9d704b8-ec90-4dab-a372-85c82c826932 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:13.436749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9d704b8-ec90-4dab-a372-85c82c826932 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:13.571060 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b9d704b8-ec90-4dab-a372-85c82c826932 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:13.579831 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9d704b8-ec90-4dab-a372-85c82c826932 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.155897 Apr 11 20:24:13.580646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1633/3284] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:13 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:14.601096 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09db72ab-71c6-49a2-8e82-b6f783df990a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:14.601673 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09db72ab-71c6-49a2-8e82-b6f783df990a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:14.608138 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09db72ab-71c6-49a2-8e82-b6f783df990a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:14.608579 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09db72ab-71c6-49a2-8e82-b6f783df990a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:14.609361 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09db72ab-71c6-49a2-8e82-b6f783df990a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:14.609790 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09db72ab-71c6-49a2-8e82-b6f783df990a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:14.740130 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09db72ab-71c6-49a2-8e82-b6f783df990a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:14.752348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09db72ab-71c6-49a2-8e82-b6f783df990a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.156770 Apr 11 20:24:14.753293 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1652/3285] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:14 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:15.774036 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e43d29b2-1843-4c98-84be-5e7d311d5d89 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:15.774786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e43d29b2-1843-4c98-84be-5e7d311d5d89 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:15.786641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e43d29b2-1843-4c98-84be-5e7d311d5d89 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:15.787169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e43d29b2-1843-4c98-84be-5e7d311d5d89 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:15.788809 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e43d29b2-1843-4c98-84be-5e7d311d5d89 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:15.789367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e43d29b2-1843-4c98-84be-5e7d311d5d89 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:15.921037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e43d29b2-1843-4c98-84be-5e7d311d5d89 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:15.928625 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e43d29b2-1843-4c98-84be-5e7d311d5d89 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.160387 Apr 11 20:24:15.929225 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1634/3286] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:15 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:16.949897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-10900ad2-02fd-40ac-afb3-b1f143394a3f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:16.950894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-10900ad2-02fd-40ac-afb3-b1f143394a3f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:16.961753 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10900ad2-02fd-40ac-afb3-b1f143394a3f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:16.962501 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10900ad2-02fd-40ac-afb3-b1f143394a3f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:16.963757 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10900ad2-02fd-40ac-afb3-b1f143394a3f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:16.964480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10900ad2-02fd-40ac-afb3-b1f143394a3f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:17.100979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-10900ad2-02fd-40ac-afb3-b1f143394a3f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:17.112768 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-10900ad2-02fd-40ac-afb3-b1f143394a3f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1679 microversion: 2.1 time: 0.169120 Apr 11 20:24:17.113583 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1653/3287] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:16 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:18.135298 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-85a71e87-ea38-462c-b132-f90191983ee4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:18.136321 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-85a71e87-ea38-462c-b132-f90191983ee4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:18.147203 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85a71e87-ea38-462c-b132-f90191983ee4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:18.147653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85a71e87-ea38-462c-b132-f90191983ee4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:18.148417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85a71e87-ea38-462c-b132-f90191983ee4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:18.148855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85a71e87-ea38-462c-b132-f90191983ee4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:18.286344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85a71e87-ea38-462c-b132-f90191983ee4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:18.293923 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-85a71e87-ea38-462c-b132-f90191983ee4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1656 microversion: 2.1 time: 0.165258 Apr 11 20:24:18.294492 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1635/3288] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:18 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1656 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:18.312700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a82d1622-7649-48af-be87-899a409c2dd4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:24:18.320933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a82d1622-7649-48af-be87-899a409c2dd4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:18.321410 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a82d1622-7649-48af-be87-899a409c2dd4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:18.342274 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a82d1622-7649-48af-be87-899a409c2dd4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Going to try to start instance {{(pid=123637) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 11 20:24:18.386675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a82d1622-7649-48af-be87-899a409c2dd4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/action" status: 202 len: 0 microversion: 2.1 time: 0.079820 Apr 11 20:24:18.387173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1654/3289] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 20:24:18 2022] POST /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:24:18.395362 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65f7c26f-13e8-4b2b-ab9b-76f123ae6002 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:18.396001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65f7c26f-13e8-4b2b-ab9b-76f123ae6002 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:18.402285 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65f7c26f-13e8-4b2b-ab9b-76f123ae6002 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:18.402761 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65f7c26f-13e8-4b2b-ab9b-76f123ae6002 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:18.403524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65f7c26f-13e8-4b2b-ab9b-76f123ae6002 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:18.404157 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65f7c26f-13e8-4b2b-ab9b-76f123ae6002 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:18.531423 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65f7c26f-13e8-4b2b-ab9b-76f123ae6002 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:18.539342 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65f7c26f-13e8-4b2b-ab9b-76f123ae6002 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1665 microversion: 2.1 time: 0.147761 Apr 11 20:24:18.539911 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1636/3290] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:18 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:19.562822 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a733b196-2dc3-4d22-af0b-cfc26ef6c5d2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:19.563971 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a733b196-2dc3-4d22-af0b-cfc26ef6c5d2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:19.574562 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a733b196-2dc3-4d22-af0b-cfc26ef6c5d2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:19.575279 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a733b196-2dc3-4d22-af0b-cfc26ef6c5d2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:19.576521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a733b196-2dc3-4d22-af0b-cfc26ef6c5d2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:19.577305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a733b196-2dc3-4d22-af0b-cfc26ef6c5d2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:19.708214 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a733b196-2dc3-4d22-af0b-cfc26ef6c5d2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:19.715872 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a733b196-2dc3-4d22-af0b-cfc26ef6c5d2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1665 microversion: 2.1 time: 0.160900 Apr 11 20:24:19.716426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1655/3291] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:19 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:20.732897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-48f4c16e-2354-468c-9999-b607475eb033 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:20.733561 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-48f4c16e-2354-468c-9999-b607475eb033 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:20.740505 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48f4c16e-2354-468c-9999-b607475eb033 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:20.740977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48f4c16e-2354-468c-9999-b607475eb033 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:20.741805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48f4c16e-2354-468c-9999-b607475eb033 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:20.742251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48f4c16e-2354-468c-9999-b607475eb033 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:20.879071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-48f4c16e-2354-468c-9999-b607475eb033 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:20.890692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-48f4c16e-2354-468c-9999-b607475eb033 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1669 microversion: 2.1 time: 0.161559 Apr 11 20:24:20.891371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1637/3292] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:20 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:24.715809 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:24:24.716752 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:24:53.074148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-066f61dc-dd2c-4629-83be-67cd34d386b7 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:53.075134 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-066f61dc-dd2c-4629-83be-67cd34d386b7 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:53.081687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-066f61dc-dd2c-4629-83be-67cd34d386b7 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:53.082133 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-066f61dc-dd2c-4629-83be-67cd34d386b7 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:53.082922 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-066f61dc-dd2c-4629-83be-67cd34d386b7 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:53.083377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-066f61dc-dd2c-4629-83be-67cd34d386b7 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:53.112352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-066f61dc-dd2c-4629-83be-67cd34d386b7 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042434 Apr 11 20:24:53.112896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1656/3293] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 20:24:53 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:24:53.175470 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-916ff2b2-b797-4949-89a4-946ce52cd844 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:53.176059 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-916ff2b2-b797-4949-89a4-946ce52cd844 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:53.182590 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-916ff2b2-b797-4949-89a4-946ce52cd844 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:53.183039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-916ff2b2-b797-4949-89a4-946ce52cd844 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:53.183854 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-916ff2b2-b797-4949-89a4-946ce52cd844 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:53.184290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-916ff2b2-b797-4949-89a4-946ce52cd844 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:53.208303 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-916ff2b2-b797-4949-89a4-946ce52cd844 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:24:53.287167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-916ff2b2-b797-4949-89a4-946ce52cd844 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 204 len: 0 microversion: 2.1 time: 0.115414 Apr 11 20:24:53.287708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1638/3294] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:24:53 2022] DELETE /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:24:53.296546 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97b2af20-5633-45ac-b76e-438d1c3e4d35 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:53.297182 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97b2af20-5633-45ac-b76e-438d1c3e4d35 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:53.303128 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97b2af20-5633-45ac-b76e-438d1c3e4d35 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:53.303567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97b2af20-5633-45ac-b76e-438d1c3e4d35 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:53.304319 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97b2af20-5633-45ac-b76e-438d1c3e4d35 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:53.304771 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97b2af20-5633-45ac-b76e-438d1c3e4d35 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:53.432547 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97b2af20-5633-45ac-b76e-438d1c3e4d35 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:53.444660 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97b2af20-5633-45ac-b76e-438d1c3e4d35 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1675 microversion: 2.1 time: 0.151975 Apr 11 20:24:53.445439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1657/3295] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:53 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:24:54.468128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c55db6ee-573f-4ba6-b8c9-073e86a2ed65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:54.468870 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c55db6ee-573f-4ba6-b8c9-073e86a2ed65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:54.476244 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c55db6ee-573f-4ba6-b8c9-073e86a2ed65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:54.476689 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c55db6ee-573f-4ba6-b8c9-073e86a2ed65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:54.477471 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c55db6ee-573f-4ba6-b8c9-073e86a2ed65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:54.477898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c55db6ee-573f-4ba6-b8c9-073e86a2ed65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:54.613947 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c55db6ee-573f-4ba6-b8c9-073e86a2ed65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:54.621762 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c55db6ee-573f-4ba6-b8c9-073e86a2ed65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1675 microversion: 2.1 time: 0.158936 Apr 11 20:24:54.622323 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1639/3296] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:54 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:55.640209 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3dc2b91b-d0a1-47ab-996e-1f6eb318f403 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:55.641396 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3dc2b91b-d0a1-47ab-996e-1f6eb318f403 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:55.648979 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3dc2b91b-d0a1-47ab-996e-1f6eb318f403 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:55.649429 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3dc2b91b-d0a1-47ab-996e-1f6eb318f403 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:55.650229 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3dc2b91b-d0a1-47ab-996e-1f6eb318f403 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:55.650663 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3dc2b91b-d0a1-47ab-996e-1f6eb318f403 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:55.791691 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3dc2b91b-d0a1-47ab-996e-1f6eb318f403 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:24:55.798984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3dc2b91b-d0a1-47ab-996e-1f6eb318f403 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 200 len: 1675 microversion: 2.1 time: 0.163719 Apr 11 20:24:55.799544 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1658/3297] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:55 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:24:56.132966 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-96312bd6-314f-4baf-a6f7-4cfa1088e28c req-0ab0adaf-da1a-41e8-90b7-5db671d61aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef80bc27-0d2d-456b-9d3c-dca66a04b84a", "name": "network-vif-deleted", "tag": "30b25cec-5229-49f8-84da-7fea364b424c"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:24:56.142167 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-96312bd6-314f-4baf-a6f7-4cfa1088e28c req-0ab0adaf-da1a-41e8-90b7-5db671d61aa0 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:56.142836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-96312bd6-314f-4baf-a6f7-4cfa1088e28c req-0ab0adaf-da1a-41e8-90b7-5db671d61aa0 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:56.165075 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-96312bd6-314f-4baf-a6f7-4cfa1088e28c req-0ab0adaf-da1a-41e8-90b7-5db671d61aa0 service nova] Creating event network-vif-deleted:30b25cec-5229-49f8-84da-7fea364b424c for instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a on hv-cinder-83078 Apr 11 20:24:56.178832 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-96312bd6-314f-4baf-a6f7-4cfa1088e28c req-0ab0adaf-da1a-41e8-90b7-5db671d61aa0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156257 Apr 11 20:24:56.181160 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1640/3298] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:24:56.815873 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:56.816485 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:24:56.823084 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:56.823540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:56.824306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:24:56.824740 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:24:56.838813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] HTTP exception thrown: Instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a could not be found. Apr 11 20:24:56.839408 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Returning 404 to user: Instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:24:56.840280 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13316919-507d-42a9-a636-c12360b6c036 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 404 len: 111 microversion: 2.1 time: 0.028499 Apr 11 20:24:56.840816 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1659/3299] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:24:56 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:24:56.850042 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-791a1ff2-a1df-4da1-af00-2f642577bd85 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '.version_select at 0x7f4086ddeca0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:24:56.853320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-791a1ff2-a1df-4da1-af00-2f642577bd85 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [56d9edc1-c44f-4312-9a31-297a4cf21913] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 20:24:57.863638 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [None req-791a1ff2-a1df-4da1-af00-2f642577bd85 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [56d9edc1-c44f-4312-9a31-297a4cf21913] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 39704. Apr 11 20:24:57.885509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-791a1ff2-a1df-4da1-af00-2f642577bd85 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135012583" status: 202 len: 0 microversion: 2.1 time: 1.039558 Apr 11 20:24:57.886027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1641/3300] 10.222.0.62 () {58 vars in 1220 bytes} [Mon Apr 11 20:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135012583 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:24:58.760004 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2e7b0d57-a810-4411-a279-b43be090786d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'create', calling method: .version_select at 0x7f4086f404c0>, body: {"keypair": {"name": "tempest-keypair-1057676952"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:24:58.773893 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-2e7b0d57-a810-4411-a279-b43be090786d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:24:58.777716 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-2e7b0d57-a810-4411-a279-b43be090786d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for user 0ed65f3c451f42279c453b8b39c0b83a and project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:24:59.123016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-2e7b0d57-a810-4411-a279-b43be090786d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:24:59.126942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-2e7b0d57-a810-4411-a279-b43be090786d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for user 0ed65f3c451f42279c453b8b39c0b83a and project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:24:59.141058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2e7b0d57-a810-4411-a279-b43be090786d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.384438 Apr 11 20:24:59.141305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1660/3301] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Apr 11 20:24:58 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:00.480756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-34770776", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3b4b788-ea49-4f96-8c7a-90d99096b6dc"}], "security_groups": [{"name": "tempest-securitygroup--469081974"}], "key_name": "tempest-keypair-1057676952", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:00.584924 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] validate_networks() for [('d3b4b788-ea49-4f96-8c7a-90d99096b6dc', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 20:25:00.998588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:25:00.999010 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:25:00.999473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:25:00.999878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:25:01.000280 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:25:01.008968 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:01.009786 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:01.010588 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:01.011019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:01.027528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:25:01.031511 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Getting quotas for user 0ed65f3c451f42279c453b8b39c0b83a and project 11fac62a5ca449a4bff54bf1ab9446df. Resources: {'cores', 'ram', 'instances'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:25:01.042862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 20:25:01.045309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 20:25:01.098651 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-33e9dc1a-7a3c-4d3b-9458-52057830841f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.622439 Apr 11 20:25:01.099766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1642/3302] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 20:25:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 20:25:01.110290 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1a1f03e7-af7f-4fa6-9e79-5401570936ae tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:01.111120 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1a1f03e7-af7f-4fa6-9e79-5401570936ae tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:01.179730 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1a1f03e7-af7f-4fa6-9e79-5401570936ae tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:01.186932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1a1f03e7-af7f-4fa6-9e79-5401570936ae tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1236 microversion: 2.1 time: 0.080680 Apr 11 20:25:01.188989 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1661/3303] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:01 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:02.203855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b777840f-a00c-44b2-805c-59cd6e40e101 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:02.204522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b777840f-a00c-44b2-805c-59cd6e40e101 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:02.211919 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b777840f-a00c-44b2-805c-59cd6e40e101 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:02.212366 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b777840f-a00c-44b2-805c-59cd6e40e101 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:02.213159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b777840f-a00c-44b2-805c-59cd6e40e101 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:02.213602 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b777840f-a00c-44b2-805c-59cd6e40e101 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:02.275766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b777840f-a00c-44b2-805c-59cd6e40e101 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:02.283735 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b777840f-a00c-44b2-805c-59cd6e40e101 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1306 microversion: 2.1 time: 0.083872 Apr 11 20:25:02.284497 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1643/3304] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:02 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:03.301356 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-896dd139-50a4-456b-8c60-d4113f07029c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:03.302264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-896dd139-50a4-456b-8c60-d4113f07029c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:03.309428 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-896dd139-50a4-456b-8c60-d4113f07029c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:03.309930 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-896dd139-50a4-456b-8c60-d4113f07029c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:03.310760 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-896dd139-50a4-456b-8c60-d4113f07029c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:03.311479 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-896dd139-50a4-456b-8c60-d4113f07029c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:03.448079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-896dd139-50a4-456b-8c60-d4113f07029c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:03.455585 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-896dd139-50a4-456b-8c60-d4113f07029c tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1361 microversion: 2.1 time: 0.158514 Apr 11 20:25:03.456143 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1662/3305] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:03 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:25:03.480080 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-8a981179-3783-4dbd-ae28-25d711d69ccd req-9dbedadf-21ea-403b-855f-88bce4baed69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a10e455-7a87-4244-80cc-492865110b8a", "tag": "7ed292be-e2d5-4826-b287-ad508535b408"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:03.494069 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-8a981179-3783-4dbd-ae28-25d711d69ccd req-9dbedadf-21ea-403b-855f-88bce4baed69 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:03.495188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-8a981179-3783-4dbd-ae28-25d711d69ccd req-9dbedadf-21ea-403b-855f-88bce4baed69 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:03.512153 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-8a981179-3783-4dbd-ae28-25d711d69ccd req-9dbedadf-21ea-403b-855f-88bce4baed69 service nova] Creating event network-changed:7ed292be-e2d5-4826-b287-ad508535b408 for instance 0a10e455-7a87-4244-80cc-492865110b8a on hv-cinder-83078 Apr 11 20:25:03.517574 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-8a981179-3783-4dbd-ae28-25d711d69ccd req-9dbedadf-21ea-403b-855f-88bce4baed69 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041047 Apr 11 20:25:03.518499 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1644/3306] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:04.474183 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bcaadbff-744e-4594-b2a1-df8f6c5043d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:04.474772 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bcaadbff-744e-4594-b2a1-df8f6c5043d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:04.481787 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcaadbff-744e-4594-b2a1-df8f6c5043d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:04.482226 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcaadbff-744e-4594-b2a1-df8f6c5043d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:04.482986 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcaadbff-744e-4594-b2a1-df8f6c5043d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:04.483413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcaadbff-744e-4594-b2a1-df8f6c5043d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:04.614174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bcaadbff-744e-4594-b2a1-df8f6c5043d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:04.622160 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bcaadbff-744e-4594-b2a1-df8f6c5043d4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1361 microversion: 2.1 time: 0.152776 Apr 11 20:25:04.622952 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1663/3307] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:04 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:05.645329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-812502ce-bda0-4c46-b95a-ce0383c40008 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:05.646488 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-812502ce-bda0-4c46-b95a-ce0383c40008 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:05.657635 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-812502ce-bda0-4c46-b95a-ce0383c40008 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:05.658061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-812502ce-bda0-4c46-b95a-ce0383c40008 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:05.658889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-812502ce-bda0-4c46-b95a-ce0383c40008 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:05.659567 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-812502ce-bda0-4c46-b95a-ce0383c40008 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:05.797889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-812502ce-bda0-4c46-b95a-ce0383c40008 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:05.808996 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-812502ce-bda0-4c46-b95a-ce0383c40008 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1361 microversion: 2.1 time: 0.171557 Apr 11 20:25:05.809768 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1645/3308] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:05 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:06.827045 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e1b671a-e458-4747-b390-1fc387a8d8e4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:06.827641 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e1b671a-e458-4747-b390-1fc387a8d8e4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:06.834155 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e1b671a-e458-4747-b390-1fc387a8d8e4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:06.834598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e1b671a-e458-4747-b390-1fc387a8d8e4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:06.835474 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e1b671a-e458-4747-b390-1fc387a8d8e4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:06.835904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e1b671a-e458-4747-b390-1fc387a8d8e4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:06.971619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e1b671a-e458-4747-b390-1fc387a8d8e4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:06.979609 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e1b671a-e458-4747-b390-1fc387a8d8e4 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1361 microversion: 2.1 time: 0.157027 Apr 11 20:25:06.980168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1664/3309] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:06 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:07.997619 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e4d4a1c-6ecb-476f-bb05-4d2ca95fed9d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:07.998215 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e4d4a1c-6ecb-476f-bb05-4d2ca95fed9d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:08.004998 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e4d4a1c-6ecb-476f-bb05-4d2ca95fed9d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:08.005442 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e4d4a1c-6ecb-476f-bb05-4d2ca95fed9d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:08.006201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e4d4a1c-6ecb-476f-bb05-4d2ca95fed9d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:08.006634 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e4d4a1c-6ecb-476f-bb05-4d2ca95fed9d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:08.134271 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e4d4a1c-6ecb-476f-bb05-4d2ca95fed9d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:08.141866 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e4d4a1c-6ecb-476f-bb05-4d2ca95fed9d tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1361 microversion: 2.1 time: 0.148606 Apr 11 20:25:08.142598 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1646/3310] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:07 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:09.163283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2383c8fc-3951-4e39-9560-8e8c33521c2b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:09.164305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2383c8fc-3951-4e39-9560-8e8c33521c2b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:09.174298 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2383c8fc-3951-4e39-9560-8e8c33521c2b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:09.174750 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2383c8fc-3951-4e39-9560-8e8c33521c2b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:09.175505 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2383c8fc-3951-4e39-9560-8e8c33521c2b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:09.175959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2383c8fc-3951-4e39-9560-8e8c33521c2b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:09.313211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2383c8fc-3951-4e39-9560-8e8c33521c2b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:09.320571 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2383c8fc-3951-4e39-9560-8e8c33521c2b tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1361 microversion: 2.1 time: 0.164011 Apr 11 20:25:09.321193 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1665/3311] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:09 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:09.868721 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-1a1b1ac0-f1b4-4058-9bcf-51f1f6669411 req-b9ce9ef7-3b12-4457-91e1-2dc2bb42556b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a10e455-7a87-4244-80cc-492865110b8a", "name": "network-vif-plugged", "status": "completed", "tag": "7ed292be-e2d5-4826-b287-ad508535b408"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:09.877439 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-1a1b1ac0-f1b4-4058-9bcf-51f1f6669411 req-b9ce9ef7-3b12-4457-91e1-2dc2bb42556b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:09.877975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-1a1b1ac0-f1b4-4058-9bcf-51f1f6669411 req-b9ce9ef7-3b12-4457-91e1-2dc2bb42556b service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:09.889335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-1a1b1ac0-f1b4-4058-9bcf-51f1f6669411 req-b9ce9ef7-3b12-4457-91e1-2dc2bb42556b service nova] Creating event network-vif-plugged:7ed292be-e2d5-4826-b287-ad508535b408 for instance 0a10e455-7a87-4244-80cc-492865110b8a on hv-cinder-83078 Apr 11 20:25:09.894519 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-1a1b1ac0-f1b4-4058-9bcf-51f1f6669411 req-b9ce9ef7-3b12-4457-91e1-2dc2bb42556b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088795 Apr 11 20:25:09.895109 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1647/3312] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:10.338296 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-294add85-bb01-4dee-9690-5a7d893a095f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:10.338877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-294add85-bb01-4dee-9690-5a7d893a095f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:10.345438 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-294add85-bb01-4dee-9690-5a7d893a095f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:10.345879 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-294add85-bb01-4dee-9690-5a7d893a095f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:10.346707 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-294add85-bb01-4dee-9690-5a7d893a095f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:10.347154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-294add85-bb01-4dee-9690-5a7d893a095f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:10.479698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-294add85-bb01-4dee-9690-5a7d893a095f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:10.487614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-294add85-bb01-4dee-9690-5a7d893a095f tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1361 microversion: 2.1 time: 0.153662 Apr 11 20:25:10.488224 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1666/3313] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:10 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:11.506580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d70b4dc0-bead-48c7-af96-35664c3580f0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:11.507148 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d70b4dc0-bead-48c7-af96-35664c3580f0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:11.513696 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d70b4dc0-bead-48c7-af96-35664c3580f0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:11.514373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d70b4dc0-bead-48c7-af96-35664c3580f0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:11.514973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d70b4dc0-bead-48c7-af96-35664c3580f0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:11.515407 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d70b4dc0-bead-48c7-af96-35664c3580f0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:11.657344 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d70b4dc0-bead-48c7-af96-35664c3580f0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:11.664855 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d70b4dc0-bead-48c7-af96-35664c3580f0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1548 microversion: 2.1 time: 0.163512 Apr 11 20:25:11.665444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1648/3314] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:11 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:25:11.681168 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59265500-b202-4cde-add2-27a441344683 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:11.681700 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59265500-b202-4cde-add2-27a441344683 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:11.688083 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59265500-b202-4cde-add2-27a441344683 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:11.688522 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59265500-b202-4cde-add2-27a441344683 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:11.689305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59265500-b202-4cde-add2-27a441344683 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:11.689727 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59265500-b202-4cde-add2-27a441344683 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:11.766442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59265500-b202-4cde-add2-27a441344683 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089114 Apr 11 20:25:11.767021 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1667/3315] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Apr 11 20:25:11 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:13.034692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-84f8b4ed-077f-4a3c-aa27-b69abc09cc85 req-98e2ff4c-1ab0-47df-868b-da4026556bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a10e455-7a87-4244-80cc-492865110b8a", "tag": "7ed292be-e2d5-4826-b287-ad508535b408"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:13.042658 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-84f8b4ed-077f-4a3c-aa27-b69abc09cc85 req-98e2ff4c-1ab0-47df-868b-da4026556bfa service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:13.043099 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-84f8b4ed-077f-4a3c-aa27-b69abc09cc85 req-98e2ff4c-1ab0-47df-868b-da4026556bfa service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:13.055646 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-84f8b4ed-077f-4a3c-aa27-b69abc09cc85 req-98e2ff4c-1ab0-47df-868b-da4026556bfa service nova] Creating event network-changed:7ed292be-e2d5-4826-b287-ad508535b408 for instance 0a10e455-7a87-4244-80cc-492865110b8a on hv-cinder-83078 Apr 11 20:25:13.060764 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-84f8b4ed-077f-4a3c-aa27-b69abc09cc85 req-98e2ff4c-1ab0-47df-868b-da4026556bfa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086929 Apr 11 20:25:13.061781 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1649/3316] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:18.643273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-34507e22-de02-427a-b5d3-5c3aff3f5f5a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:18.644195 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-34507e22-de02-427a-b5d3-5c3aff3f5f5a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:18.654240 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34507e22-de02-427a-b5d3-5c3aff3f5f5a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:18.654998 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34507e22-de02-427a-b5d3-5c3aff3f5f5a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:18.656589 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34507e22-de02-427a-b5d3-5c3aff3f5f5a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:18.657398 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34507e22-de02-427a-b5d3-5c3aff3f5f5a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:18.681584 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-34507e22-de02-427a-b5d3-5c3aff3f5f5a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lazy-loading 'flavor' on Instance uuid 667623bc-9455-44c7-bdaa-c3eeed390b84 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:25:18.772664 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-34507e22-de02-427a-b5d3-5c3aff3f5f5a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "POST /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84/action" status: 202 len: 0 microversion: 2.1 time: 0.136891 Apr 11 20:25:18.773436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1668/3317] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 20:25:18 2022] POST /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:25:18.783613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4d02d561-3c6e-4795-b53f-f942666d21e8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:18.784324 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4d02d561-3c6e-4795-b53f-f942666d21e8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:18.790849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d02d561-3c6e-4795-b53f-f942666d21e8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:18.791336 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d02d561-3c6e-4795-b53f-f942666d21e8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:18.792096 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d02d561-3c6e-4795-b53f-f942666d21e8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:18.792528 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d02d561-3c6e-4795-b53f-f942666d21e8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:18.936443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4d02d561-3c6e-4795-b53f-f942666d21e8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:18.944605 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4d02d561-3c6e-4795-b53f-f942666d21e8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.165773 Apr 11 20:25:18.945210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1650/3318] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:18 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:19.972223 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e5fbab6-053b-4f3c-a363-1b3a68d82a53 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:19.973069 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e5fbab6-053b-4f3c-a363-1b3a68d82a53 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:19.982548 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e5fbab6-053b-4f3c-a363-1b3a68d82a53 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:19.983191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e5fbab6-053b-4f3c-a363-1b3a68d82a53 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:19.984385 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e5fbab6-053b-4f3c-a363-1b3a68d82a53 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:19.985063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e5fbab6-053b-4f3c-a363-1b3a68d82a53 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:20.130801 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e5fbab6-053b-4f3c-a363-1b3a68d82a53 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:20.138325 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e5fbab6-053b-4f3c-a363-1b3a68d82a53 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.173789 Apr 11 20:25:20.138929 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1669/3319] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:19 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:21.155341 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-667afce8-f10a-4c4c-b9b8-6e47cd156b66 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:21.155940 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-667afce8-f10a-4c4c-b9b8-6e47cd156b66 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:21.163162 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-667afce8-f10a-4c4c-b9b8-6e47cd156b66 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:21.163600 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-667afce8-f10a-4c4c-b9b8-6e47cd156b66 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:21.164345 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-667afce8-f10a-4c4c-b9b8-6e47cd156b66 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:21.164766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-667afce8-f10a-4c4c-b9b8-6e47cd156b66 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:21.294920 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-667afce8-f10a-4c4c-b9b8-6e47cd156b66 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:21.305943 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-667afce8-f10a-4c4c-b9b8-6e47cd156b66 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.154140 Apr 11 20:25:21.306743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1651/3320] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:21 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:22.329565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0131269c-30f9-468d-bdd7-85910881cf70 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:22.330619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0131269c-30f9-468d-bdd7-85910881cf70 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:22.341246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0131269c-30f9-468d-bdd7-85910881cf70 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:22.341991 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0131269c-30f9-468d-bdd7-85910881cf70 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:22.343300 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0131269c-30f9-468d-bdd7-85910881cf70 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:22.344018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0131269c-30f9-468d-bdd7-85910881cf70 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:22.477241 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0131269c-30f9-468d-bdd7-85910881cf70 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:22.485095 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0131269c-30f9-468d-bdd7-85910881cf70 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.162066 Apr 11 20:25:22.485665 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1670/3321] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:22 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:23.506656 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-da7dc8c5-4f44-4043-893c-61910f8b96e6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:23.507582 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-da7dc8c5-4f44-4043-893c-61910f8b96e6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:23.517898 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da7dc8c5-4f44-4043-893c-61910f8b96e6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:23.518562 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da7dc8c5-4f44-4043-893c-61910f8b96e6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:23.519332 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da7dc8c5-4f44-4043-893c-61910f8b96e6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:23.519767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da7dc8c5-4f44-4043-893c-61910f8b96e6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:23.651152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-da7dc8c5-4f44-4043-893c-61910f8b96e6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:23.659110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-da7dc8c5-4f44-4043-893c-61910f8b96e6 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.158827 Apr 11 20:25:23.659680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1652/3322] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:23 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:24.683380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6421a948-7cd8-4c50-a4db-0990d63ee678 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:24.684264 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6421a948-7cd8-4c50-a4db-0990d63ee678 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:24.693439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6421a948-7cd8-4c50-a4db-0990d63ee678 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:24.694075 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6421a948-7cd8-4c50-a4db-0990d63ee678 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:24.695139 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6421a948-7cd8-4c50-a4db-0990d63ee678 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:24.695745 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6421a948-7cd8-4c50-a4db-0990d63ee678 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:24.828558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6421a948-7cd8-4c50-a4db-0990d63ee678 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:24.836617 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6421a948-7cd8-4c50-a4db-0990d63ee678 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.158922 Apr 11 20:25:24.837227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1671/3323] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:24 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:25.858046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-edf8c3d1-203a-4f02-ab3b-decbaddc2225 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:25.859136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-edf8c3d1-203a-4f02-ab3b-decbaddc2225 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:25.870456 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edf8c3d1-203a-4f02-ab3b-decbaddc2225 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:25.871571 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edf8c3d1-203a-4f02-ab3b-decbaddc2225 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:25.872824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edf8c3d1-203a-4f02-ab3b-decbaddc2225 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:25.873642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edf8c3d1-203a-4f02-ab3b-decbaddc2225 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:26.012756 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-edf8c3d1-203a-4f02-ab3b-decbaddc2225 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:26.021037 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-edf8c3d1-203a-4f02-ab3b-decbaddc2225 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.169524 Apr 11 20:25:26.021615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1653/3324] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:25 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:27.042173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7bf7be18-2375-4301-80a3-92271a042cdc tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:27.043173 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7bf7be18-2375-4301-80a3-92271a042cdc tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:27.052165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf7be18-2375-4301-80a3-92271a042cdc tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:27.052605 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf7be18-2375-4301-80a3-92271a042cdc tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:27.053389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf7be18-2375-4301-80a3-92271a042cdc tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:27.053814 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bf7be18-2375-4301-80a3-92271a042cdc tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:27.186725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7bf7be18-2375-4301-80a3-92271a042cdc tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:27.195002 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7bf7be18-2375-4301-80a3-92271a042cdc tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.159377 Apr 11 20:25:27.195581 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1672/3325] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:27 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:28.215444 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e6a1dd9d-c6fd-4c8a-a01f-520cfcb2da72 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:28.216114 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e6a1dd9d-c6fd-4c8a-a01f-520cfcb2da72 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:28.224290 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6a1dd9d-c6fd-4c8a-a01f-520cfcb2da72 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:28.224741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6a1dd9d-c6fd-4c8a-a01f-520cfcb2da72 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:28.225530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6a1dd9d-c6fd-4c8a-a01f-520cfcb2da72 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:28.225963 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6a1dd9d-c6fd-4c8a-a01f-520cfcb2da72 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:28.361074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e6a1dd9d-c6fd-4c8a-a01f-520cfcb2da72 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:28.372944 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e6a1dd9d-c6fd-4c8a-a01f-520cfcb2da72 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.163554 Apr 11 20:25:28.373780 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1654/3326] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:28 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:29.392569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3423575d-6db9-4c27-befc-7d121081745c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:29.393440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3423575d-6db9-4c27-befc-7d121081745c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:29.400165 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3423575d-6db9-4c27-befc-7d121081745c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:29.400704 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3423575d-6db9-4c27-befc-7d121081745c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:29.401588 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3423575d-6db9-4c27-befc-7d121081745c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:29.402013 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3423575d-6db9-4c27-befc-7d121081745c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:29.535942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3423575d-6db9-4c27-befc-7d121081745c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:29.546518 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3423575d-6db9-4c27-befc-7d121081745c tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.157979 Apr 11 20:25:29.547349 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1673/3327] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:29 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:30.571149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-295f1a62-5f8e-416b-bd79-ef9cf8e92af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:30.571846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-295f1a62-5f8e-416b-bd79-ef9cf8e92af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:30.579904 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295f1a62-5f8e-416b-bd79-ef9cf8e92af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:30.580458 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295f1a62-5f8e-416b-bd79-ef9cf8e92af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:30.581426 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295f1a62-5f8e-416b-bd79-ef9cf8e92af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:30.581958 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295f1a62-5f8e-416b-bd79-ef9cf8e92af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:30.720327 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-295f1a62-5f8e-416b-bd79-ef9cf8e92af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:30.727844 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-295f1a62-5f8e-416b-bd79-ef9cf8e92af8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.161712 Apr 11 20:25:30.728399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1655/3328] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:30 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:31.745144 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7cd42936-f588-49c4-be7b-caeb3003cd29 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:31.746100 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7cd42936-f588-49c4-be7b-caeb3003cd29 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:31.754017 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cd42936-f588-49c4-be7b-caeb3003cd29 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:31.754460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cd42936-f588-49c4-be7b-caeb3003cd29 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:31.755277 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cd42936-f588-49c4-be7b-caeb3003cd29 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:31.755702 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cd42936-f588-49c4-be7b-caeb3003cd29 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:31.888703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7cd42936-f588-49c4-be7b-caeb3003cd29 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:31.896508 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7cd42936-f588-49c4-be7b-caeb3003cd29 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1568 microversion: 2.1 time: 0.155293 Apr 11 20:25:31.897112 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1674/3329] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:31 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:31.913289 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-940e4212-f459-4c20-b629-9f0ec406a3b8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:31.913826 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-940e4212-f459-4c20-b629-9f0ec406a3b8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:31.920071 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-940e4212-f459-4c20-b629-9f0ec406a3b8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:31.920534 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-940e4212-f459-4c20-b629-9f0ec406a3b8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:31.921305 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-940e4212-f459-4c20-b629-9f0ec406a3b8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:31.921738 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-940e4212-f459-4c20-b629-9f0ec406a3b8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:32.018676 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-940e4212-f459-4c20-b629-9f0ec406a3b8 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "POST /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84/action" status: 202 len: 0 microversion: 2.1 time: 0.109488 Apr 11 20:25:32.019677 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1656/3330] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Apr 11 20:25:31 2022] POST /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:25:32.028440 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13368bad-416c-455e-bd9e-b8abb59fcd28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:32.029058 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13368bad-416c-455e-bd9e-b8abb59fcd28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:32.034867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13368bad-416c-455e-bd9e-b8abb59fcd28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:32.035307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13368bad-416c-455e-bd9e-b8abb59fcd28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:32.036033 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13368bad-416c-455e-bd9e-b8abb59fcd28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:32.036459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13368bad-416c-455e-bd9e-b8abb59fcd28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:32.200158 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-13368bad-416c-455e-bd9e-b8abb59fcd28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:32.208076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13368bad-416c-455e-bd9e-b8abb59fcd28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1516 microversion: 2.1 time: 0.184026 Apr 11 20:25:32.208644 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1675/3331] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:32 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:33.226443 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea53c6be-b13c-443e-8dc9-b8822edb76f0 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:33.227057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ea53c6be-b13c-443e-8dc9-b8822edb76f0 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:33.233159 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea53c6be-b13c-443e-8dc9-b8822edb76f0 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:33.233610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea53c6be-b13c-443e-8dc9-b8822edb76f0 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:33.234365 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea53c6be-b13c-443e-8dc9-b8822edb76f0 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:33.234766 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea53c6be-b13c-443e-8dc9-b8822edb76f0 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:33.396237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ea53c6be-b13c-443e-8dc9-b8822edb76f0 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:33.403896 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea53c6be-b13c-443e-8dc9-b8822edb76f0 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1516 microversion: 2.1 time: 0.181999 Apr 11 20:25:33.404475 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1657/3332] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:33 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:33.906710 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-9b839a6b-08c0-41ae-9c71-2b653ba2b74d req-67bcc763-c3fd-4a65-864e-4f6a69a7b18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667623bc-9455-44c7-bdaa-c3eeed390b84", "name": "network-vif-unplugged", "status": "completed", "tag": "cba49c7f-a7cc-4317-8f36-687aad464b69"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:33.915266 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-9b839a6b-08c0-41ae-9c71-2b653ba2b74d req-67bcc763-c3fd-4a65-864e-4f6a69a7b18d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:33.915703 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-9b839a6b-08c0-41ae-9c71-2b653ba2b74d req-67bcc763-c3fd-4a65-864e-4f6a69a7b18d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:33.927206 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.compute.server_external_events [req-9b839a6b-08c0-41ae-9c71-2b653ba2b74d req-67bcc763-c3fd-4a65-864e-4f6a69a7b18d service nova] Unable to find a host for instance 667623bc-9455-44c7-bdaa-c3eeed390b84. Dropping event network-vif-unplugged {{(pid=123637) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 11 20:25:33.928068 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-9b839a6b-08c0-41ae-9c71-2b653ba2b74d req-67bcc763-c3fd-4a65-864e-4f6a69a7b18d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025308 Apr 11 20:25:33.928655 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1676/3333] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 11 20:25:34.423379 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ecf787f-7083-4e56-a738-8059a092a998 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:34.424188 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ecf787f-7083-4e56-a738-8059a092a998 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:34.430239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ecf787f-7083-4e56-a738-8059a092a998 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:34.430687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ecf787f-7083-4e56-a738-8059a092a998 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:34.431449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ecf787f-7083-4e56-a738-8059a092a998 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:34.431889 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ecf787f-7083-4e56-a738-8059a092a998 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:34.566669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ecf787f-7083-4e56-a738-8059a092a998 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:34.574181 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ecf787f-7083-4e56-a738-8059a092a998 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1516 microversion: 2.1 time: 0.156413 Apr 11 20:25:34.574749 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1658/3334] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:34 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:35.590933 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-05b3414e-0b55-4606-83bf-cff65f291e16 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:35.591521 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-05b3414e-0b55-4606-83bf-cff65f291e16 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:35.598041 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05b3414e-0b55-4606-83bf-cff65f291e16 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:35.598484 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05b3414e-0b55-4606-83bf-cff65f291e16 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:35.599227 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05b3414e-0b55-4606-83bf-cff65f291e16 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:35.599652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05b3414e-0b55-4606-83bf-cff65f291e16 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:35.736339 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-05b3414e-0b55-4606-83bf-cff65f291e16 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:35.745419 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-05b3414e-0b55-4606-83bf-cff65f291e16 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1516 microversion: 2.1 time: 0.158576 Apr 11 20:25:35.746359 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1677/3335] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:35 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:36.763309 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c18110c6-3531-4330-9ea1-c95dcb57ad28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:36.763922 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c18110c6-3531-4330-9ea1-c95dcb57ad28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:36.770524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c18110c6-3531-4330-9ea1-c95dcb57ad28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:36.771111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c18110c6-3531-4330-9ea1-c95dcb57ad28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:36.771977 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c18110c6-3531-4330-9ea1-c95dcb57ad28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:36.772537 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c18110c6-3531-4330-9ea1-c95dcb57ad28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:36.907437 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c18110c6-3531-4330-9ea1-c95dcb57ad28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:36.918824 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c18110c6-3531-4330-9ea1-c95dcb57ad28 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1518 microversion: 2.1 time: 0.159656 Apr 11 20:25:36.919578 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1659/3336] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:36 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:37.938020 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d5537aba-9cf7-4781-b64f-81324a5833cd tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:37.938624 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d5537aba-9cf7-4781-b64f-81324a5833cd tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:37.945366 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5537aba-9cf7-4781-b64f-81324a5833cd tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:37.945804 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5537aba-9cf7-4781-b64f-81324a5833cd tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:37.946558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5537aba-9cf7-4781-b64f-81324a5833cd tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:37.946984 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5537aba-9cf7-4781-b64f-81324a5833cd tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:38.074633 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d5537aba-9cf7-4781-b64f-81324a5833cd tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:38.082295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d5537aba-9cf7-4781-b64f-81324a5833cd tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.148214 Apr 11 20:25:38.083104 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1678/3337] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:37 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:39.103741 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df916352-8e89-4025-bcf5-75e43009592a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:39.104710 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df916352-8e89-4025-bcf5-75e43009592a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:39.113928 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df916352-8e89-4025-bcf5-75e43009592a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:39.114373 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df916352-8e89-4025-bcf5-75e43009592a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:39.115121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df916352-8e89-4025-bcf5-75e43009592a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:39.115548 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df916352-8e89-4025-bcf5-75e43009592a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:39.273542 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df916352-8e89-4025-bcf5-75e43009592a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:39.284946 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df916352-8e89-4025-bcf5-75e43009592a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.187861 Apr 11 20:25:39.285525 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1660/3338] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:39 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:40.306048 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1a4fff7c-bb9a-4544-912b-bd827feb6b21 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:40.307055 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1a4fff7c-bb9a-4544-912b-bd827feb6b21 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:40.316367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a4fff7c-bb9a-4544-912b-bd827feb6b21 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:40.316805 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a4fff7c-bb9a-4544-912b-bd827feb6b21 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:40.317591 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a4fff7c-bb9a-4544-912b-bd827feb6b21 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:40.318023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a4fff7c-bb9a-4544-912b-bd827feb6b21 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:40.456966 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1a4fff7c-bb9a-4544-912b-bd827feb6b21 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:40.464793 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1a4fff7c-bb9a-4544-912b-bd827feb6b21 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.165082 Apr 11 20:25:40.465399 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1679/3339] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:40 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:41.486530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5bf83f44-f28b-43cb-8403-04d8ab7b2854 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:41.487135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5bf83f44-f28b-43cb-8403-04d8ab7b2854 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:41.493580 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bf83f44-f28b-43cb-8403-04d8ab7b2854 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:41.494028 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bf83f44-f28b-43cb-8403-04d8ab7b2854 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:41.494769 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bf83f44-f28b-43cb-8403-04d8ab7b2854 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:41.495198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bf83f44-f28b-43cb-8403-04d8ab7b2854 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:41.637349 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5bf83f44-f28b-43cb-8403-04d8ab7b2854 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:41.645693 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5bf83f44-f28b-43cb-8403-04d8ab7b2854 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.165891 Apr 11 20:25:41.646274 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1661/3340] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:41 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:42.671080 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ace24cbe-cce6-42e3-ba0e-2c722ca425ab tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:42.671968 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ace24cbe-cce6-42e3-ba0e-2c722ca425ab tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:42.679421 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ace24cbe-cce6-42e3-ba0e-2c722ca425ab tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:42.679870 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ace24cbe-cce6-42e3-ba0e-2c722ca425ab tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:42.680628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ace24cbe-cce6-42e3-ba0e-2c722ca425ab tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:42.681097 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ace24cbe-cce6-42e3-ba0e-2c722ca425ab tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:42.825427 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ace24cbe-cce6-42e3-ba0e-2c722ca425ab tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:42.832860 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ace24cbe-cce6-42e3-ba0e-2c722ca425ab tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.168492 Apr 11 20:25:42.833448 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1680/3341] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:42 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:43.853704 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0028a4b-a647-455a-b413-9edd9d04d961 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:43.854641 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0028a4b-a647-455a-b413-9edd9d04d961 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:43.865522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0028a4b-a647-455a-b413-9edd9d04d961 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:43.866273 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0028a4b-a647-455a-b413-9edd9d04d961 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:43.867523 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0028a4b-a647-455a-b413-9edd9d04d961 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:43.868250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0028a4b-a647-455a-b413-9edd9d04d961 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:44.003434 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0028a4b-a647-455a-b413-9edd9d04d961 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:44.010900 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0028a4b-a647-455a-b413-9edd9d04d961 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.163724 Apr 11 20:25:44.011473 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1662/3342] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:43 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:44.876983 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-89caa034-78ff-4dab-a189-e99735119a65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:44.877595 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-89caa034-78ff-4dab-a189-e99735119a65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:44.884670 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89caa034-78ff-4dab-a189-e99735119a65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:44.885169 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89caa034-78ff-4dab-a189-e99735119a65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:44.885959 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89caa034-78ff-4dab-a189-e99735119a65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:44.886404 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89caa034-78ff-4dab-a189-e99735119a65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:44.912765 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-89caa034-78ff-4dab-a189-e99735119a65 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/ips" status: 200 len: 147 microversion: 2.1 time: 0.042902 Apr 11 20:25:44.913364 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1681/3343] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 20:25:44 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:45.027358 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c631e259-699c-4896-8710-ab15721f955f tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:45.027933 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c631e259-699c-4896-8710-ab15721f955f tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:45.034211 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c631e259-699c-4896-8710-ab15721f955f tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:45.034657 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c631e259-699c-4896-8710-ab15721f955f tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:45.035394 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c631e259-699c-4896-8710-ab15721f955f tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:45.035846 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c631e259-699c-4896-8710-ab15721f955f tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:45.179808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c631e259-699c-4896-8710-ab15721f955f tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:45.192003 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c631e259-699c-4896-8710-ab15721f955f tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.168381 Apr 11 20:25:45.202910 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1663/3344] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:45 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:46.209270 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d97631bd-0e5f-4104-9075-349bbd7cce00 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:46.209900 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d97631bd-0e5f-4104-9075-349bbd7cce00 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:46.216465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d97631bd-0e5f-4104-9075-349bbd7cce00 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:46.217092 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d97631bd-0e5f-4104-9075-349bbd7cce00 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:46.217949 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d97631bd-0e5f-4104-9075-349bbd7cce00 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:46.218380 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d97631bd-0e5f-4104-9075-349bbd7cce00 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:46.253088 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3629314a-e7d4-4c1a-ace8-ff33f8e3b471 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0c80ae1-aff7-40e5-a6db-c70a9f6a481d"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:46.254512 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3629314a-e7d4-4c1a-ace8-ff33f8e3b471 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:46.262743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3629314a-e7d4-4c1a-ace8-ff33f8e3b471 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:46.263241 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3629314a-e7d4-4c1a-ace8-ff33f8e3b471 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:46.264011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3629314a-e7d4-4c1a-ace8-ff33f8e3b471 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:46.264441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3629314a-e7d4-4c1a-ace8-ff33f8e3b471 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:46.354884 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d97631bd-0e5f-4104-9075-349bbd7cce00 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:46.362346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d97631bd-0e5f-4104-9075-349bbd7cce00 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.156911 Apr 11 20:25:46.363067 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1682/3345] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:46 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:46.510032 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3629314a-e7d4-4c1a-ace8-ff33f8e3b471 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261513 Apr 11 20:25:46.510664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1664/3346] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 20:25:46 2022] POST /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:47.385379 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8db6e47b-a9df-431a-90ba-269d3988b0c3 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:47.386314 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8db6e47b-a9df-431a-90ba-269d3988b0c3 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:47.395352 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8db6e47b-a9df-431a-90ba-269d3988b0c3 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:47.395821 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8db6e47b-a9df-431a-90ba-269d3988b0c3 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:47.396567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8db6e47b-a9df-431a-90ba-269d3988b0c3 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:47.397023 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8db6e47b-a9df-431a-90ba-269d3988b0c3 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:47.537785 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8db6e47b-a9df-431a-90ba-269d3988b0c3 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:47.548409 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8db6e47b-a9df-431a-90ba-269d3988b0c3 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.169413 Apr 11 20:25:47.549220 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1683/3347] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:47 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:48.083129 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-f4331b3d-4904-4b5f-a896-f6524b9161dc req-90002961-a7ce-45f5-b84b-8bb24a9abe05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667623bc-9455-44c7-bdaa-c3eeed390b84", "name": "network-vif-plugged", "status": "completed", "tag": "cba49c7f-a7cc-4317-8f36-687aad464b69"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:48.093117 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-f4331b3d-4904-4b5f-a896-f6524b9161dc req-90002961-a7ce-45f5-b84b-8bb24a9abe05 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:48.093691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-f4331b3d-4904-4b5f-a896-f6524b9161dc req-90002961-a7ce-45f5-b84b-8bb24a9abe05 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:48.104888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-f4331b3d-4904-4b5f-a896-f6524b9161dc req-90002961-a7ce-45f5-b84b-8bb24a9abe05 service nova] Creating event network-vif-plugged:cba49c7f-a7cc-4317-8f36-687aad464b69 for instance 667623bc-9455-44c7-bdaa-c3eeed390b84 on hv-cinder-83078 Apr 11 20:25:48.109975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-f4331b3d-4904-4b5f-a896-f6524b9161dc req-90002961-a7ce-45f5-b84b-8bb24a9abe05 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031034 Apr 11 20:25:48.110964 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1665/3348] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:48.569858 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-78f63ee7-7325-466b-8604-51814a98191a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:48.570537 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-78f63ee7-7325-466b-8604-51814a98191a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:48.577323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78f63ee7-7325-466b-8604-51814a98191a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:48.577766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78f63ee7-7325-466b-8604-51814a98191a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:48.578529 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78f63ee7-7325-466b-8604-51814a98191a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:48.578951 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78f63ee7-7325-466b-8604-51814a98191a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:48.715538 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78f63ee7-7325-466b-8604-51814a98191a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:48.722882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-78f63ee7-7325-466b-8604-51814a98191a tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1574 microversion: 2.1 time: 0.157092 Apr 11 20:25:48.723443 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1684/3349] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:48 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:49.745267 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2ea6dfc9-7c86-447e-8dd9-49db5d1ac822 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:49.746319 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2ea6dfc9-7c86-447e-8dd9-49db5d1ac822 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:49.752603 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ea6dfc9-7c86-447e-8dd9-49db5d1ac822 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:49.753046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ea6dfc9-7c86-447e-8dd9-49db5d1ac822 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:49.753836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ea6dfc9-7c86-447e-8dd9-49db5d1ac822 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:49.754265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2ea6dfc9-7c86-447e-8dd9-49db5d1ac822 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:49.905108 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2ea6dfc9-7c86-447e-8dd9-49db5d1ac822 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:25:49.915500 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2ea6dfc9-7c86-447e-8dd9-49db5d1ac822 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1561 microversion: 2.1 time: 0.174809 Apr 11 20:25:49.916006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1666/3350] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:25:49 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:25:52.974841 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-35fc1510-fcde-4a6c-bddd-6efbb04dcaa8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:52.975712 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-35fc1510-fcde-4a6c-bddd-6efbb04dcaa8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:52.982267 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35fc1510-fcde-4a6c-bddd-6efbb04dcaa8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:52.982725 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35fc1510-fcde-4a6c-bddd-6efbb04dcaa8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:52.983496 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35fc1510-fcde-4a6c-bddd-6efbb04dcaa8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:52.983962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35fc1510-fcde-4a6c-bddd-6efbb04dcaa8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:53.014526 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-35fc1510-fcde-4a6c-bddd-6efbb04dcaa8 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043750 Apr 11 20:25:53.015076 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1685/3351] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 20:25:52 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:53.025014 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a0fd0208-b554-4b72-ae60-9ee8b2f831ac tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:25:53.025556 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a0fd0208-b554-4b72-ae60-9ee8b2f831ac tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:53.032077 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0fd0208-b554-4b72-ae60-9ee8b2f831ac tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:53.032527 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0fd0208-b554-4b72-ae60-9ee8b2f831ac tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:53.033328 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0fd0208-b554-4b72-ae60-9ee8b2f831ac tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:53.033862 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0fd0208-b554-4b72-ae60-9ee8b2f831ac tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:53.062700 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a0fd0208-b554-4b72-ae60-9ee8b2f831ac tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/c0c80ae1-aff7-40e5-a6db-c70a9f6a481d" status: 200 len: 194 microversion: 2.1 time: 0.041638 Apr 11 20:25:53.063288 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1667/3352] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Apr 11 20:25:53 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/c0c80ae1-aff7-40e5-a6db-c70a9f6a481d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:25:54.399237 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0734694c-bcac-42c0-b5cf-6061d6f6c485 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "524cff2c-9e4a-4b84-97a9-e875f9669946"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:25:54.400722 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0734694c-bcac-42c0-b5cf-6061d6f6c485 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:25:54.411629 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0734694c-bcac-42c0-b5cf-6061d6f6c485 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:54.412341 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0734694c-bcac-42c0-b5cf-6061d6f6c485 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:54.413295 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0734694c-bcac-42c0-b5cf-6061d6f6c485 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:25:54.413826 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0734694c-bcac-42c0-b5cf-6061d6f6c485 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:25:54.684110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0734694c-bcac-42c0-b5cf-6061d6f6c485 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "POST /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291314 Apr 11 20:25:54.685049 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1686/3353] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Apr 11 20:25:54 2022] POST /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:02.239686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe2760b3-e994-41c9-898a-633f8b73e918 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:02.240623 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe2760b3-e994-41c9-898a-633f8b73e918 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:02.247683 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe2760b3-e994-41c9-898a-633f8b73e918 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:02.248132 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe2760b3-e994-41c9-898a-633f8b73e918 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:02.248993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe2760b3-e994-41c9-898a-633f8b73e918 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:02.249350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe2760b3-e994-41c9-898a-633f8b73e918 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:02.277929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe2760b3-e994-41c9-898a-633f8b73e918 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042277 Apr 11 20:26:02.278494 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1668/3354] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 20:26:02 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:02.429371 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-77aec895-6031-436c-8196-979436eaf231 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:02.429863 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-77aec895-6031-436c-8196-979436eaf231 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:02.436435 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77aec895-6031-436c-8196-979436eaf231 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:02.437000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77aec895-6031-436c-8196-979436eaf231 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:02.437766 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77aec895-6031-436c-8196-979436eaf231 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:02.438191 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77aec895-6031-436c-8196-979436eaf231 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:02.467953 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-77aec895-6031-436c-8196-979436eaf231 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/c0c80ae1-aff7-40e5-a6db-c70a9f6a481d" status: 200 len: 194 microversion: 2.1 time: 0.043468 Apr 11 20:26:02.468527 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1687/3355] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Apr 11 20:26:02 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/c0c80ae1-aff7-40e5-a6db-c70a9f6a481d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:02.478360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82b61b1d-0d2c-453f-ae4d-b9edcc166daa tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:02.478849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82b61b1d-0d2c-453f-ae4d-b9edcc166daa tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:02.485173 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82b61b1d-0d2c-453f-ae4d-b9edcc166daa tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:02.485615 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82b61b1d-0d2c-453f-ae4d-b9edcc166daa tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:02.486360 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82b61b1d-0d2c-453f-ae4d-b9edcc166daa tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:02.486788 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82b61b1d-0d2c-453f-ae4d-b9edcc166daa tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:02.567481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-82b61b1d-0d2c-453f-ae4d-b9edcc166daa tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lazy-loading 'services' on Instance uuid 0a10e455-7a87-4244-80cc-492865110b8a {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:26:02.642496 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82b61b1d-0d2c-453f-ae4d-b9edcc166daa tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/c0c80ae1-aff7-40e5-a6db-c70a9f6a481d" status: 202 len: 0 microversion: 2.1 time: 0.167969 Apr 11 20:26:02.643113 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1669/3356] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:26:02 2022] DELETE /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/c0c80ae1-aff7-40e5-a6db-c70a9f6a481d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:26:03.769060 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8814f78-4669-417d-a953-4aef831244a6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:03.769610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8814f78-4669-417d-a953-4aef831244a6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:03.776154 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8814f78-4669-417d-a953-4aef831244a6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:03.776598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8814f78-4669-417d-a953-4aef831244a6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:03.777388 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8814f78-4669-417d-a953-4aef831244a6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:03.777815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8814f78-4669-417d-a953-4aef831244a6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:03.808764 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8814f78-4669-417d-a953-4aef831244a6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/524cff2c-9e4a-4b84-97a9-e875f9669946" status: 200 len: 194 microversion: 2.1 time: 0.043722 Apr 11 20:26:03.809377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1688/3357] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Apr 11 20:26:03 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/524cff2c-9e4a-4b84-97a9-e875f9669946 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:03.820395 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f8166e36-0ace-4dba-93a3-1e06d4adb6e0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:03.821027 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f8166e36-0ace-4dba-93a3-1e06d4adb6e0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:03.827672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8166e36-0ace-4dba-93a3-1e06d4adb6e0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:03.828124 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8166e36-0ace-4dba-93a3-1e06d4adb6e0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:03.828878 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8166e36-0ace-4dba-93a3-1e06d4adb6e0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:03.829346 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8166e36-0ace-4dba-93a3-1e06d4adb6e0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:03.908048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-f8166e36-0ace-4dba-93a3-1e06d4adb6e0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lazy-loading 'services' on Instance uuid 0a10e455-7a87-4244-80cc-492865110b8a {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 20:26:03.981982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f8166e36-0ace-4dba-93a3-1e06d4adb6e0 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/524cff2c-9e4a-4b84-97a9-e875f9669946" status: 202 len: 0 microversion: 2.1 time: 0.166111 Apr 11 20:26:03.982853 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1670/3358] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Apr 11 20:26:03 2022] DELETE /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments/524cff2c-9e4a-4b84-97a9-e875f9669946 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:26:05.155897 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f7129d43-0308-4b60-945a-17ec69ebb8b6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:05.156880 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f7129d43-0308-4b60-945a-17ec69ebb8b6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:05.163459 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7129d43-0308-4b60-945a-17ec69ebb8b6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:05.163948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7129d43-0308-4b60-945a-17ec69ebb8b6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:05.164652 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7129d43-0308-4b60-945a-17ec69ebb8b6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:05.165110 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7129d43-0308-4b60-945a-17ec69ebb8b6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:05.194519 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f7129d43-0308-4b60-945a-17ec69ebb8b6 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042549 Apr 11 20:26:05.195051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1689/3359] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 20:26:05 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:26:05.301200 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b8c346b6-3e0a-4738-bd5b-ec85d2695106 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:05.302216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b8c346b6-3e0a-4738-bd5b-ec85d2695106 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:05.309461 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8c346b6-3e0a-4738-bd5b-ec85d2695106 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:05.309907 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8c346b6-3e0a-4738-bd5b-ec85d2695106 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:05.310664 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8c346b6-3e0a-4738-bd5b-ec85d2695106 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:05.311090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8c346b6-3e0a-4738-bd5b-ec85d2695106 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:05.338610 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b8c346b6-3e0a-4738-bd5b-ec85d2695106 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041848 Apr 11 20:26:05.339163 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1671/3360] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Apr 11 20:26:05 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 20:26:05.395462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15c6f1c9-6283-4e1b-a959-e2ca78ecd364 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:05.395950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15c6f1c9-6283-4e1b-a959-e2ca78ecd364 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:05.401867 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c6f1c9-6283-4e1b-a959-e2ca78ecd364 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:05.402317 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c6f1c9-6283-4e1b-a959-e2ca78ecd364 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:05.403062 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c6f1c9-6283-4e1b-a959-e2ca78ecd364 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:05.403489 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c6f1c9-6283-4e1b-a959-e2ca78ecd364 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:05.427174 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15c6f1c9-6283-4e1b-a959-e2ca78ecd364 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:26:05.507943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15c6f1c9-6283-4e1b-a959-e2ca78ecd364 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 204 len: 0 microversion: 2.1 time: 0.115830 Apr 11 20:26:05.508751 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1690/3361] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:26:05 2022] DELETE /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:26:05.519777 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c9e0080a-54d0-4ea8-b6fe-381d0644267a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:05.520389 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c9e0080a-54d0-4ea8-b6fe-381d0644267a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:05.526597 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9e0080a-54d0-4ea8-b6fe-381d0644267a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:05.527039 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9e0080a-54d0-4ea8-b6fe-381d0644267a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:05.527783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9e0080a-54d0-4ea8-b6fe-381d0644267a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:05.528210 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9e0080a-54d0-4ea8-b6fe-381d0644267a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:05.659599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9e0080a-54d0-4ea8-b6fe-381d0644267a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:26:05.667152 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c9e0080a-54d0-4ea8-b6fe-381d0644267a tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1673 microversion: 2.1 time: 0.153244 Apr 11 20:26:05.667687 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1672/3362] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:05 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:26:06.684453 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fac0ef69-deff-4c4b-86a8-65e3e2530dc2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:06.685333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fac0ef69-deff-4c4b-86a8-65e3e2530dc2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:06.693532 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fac0ef69-deff-4c4b-86a8-65e3e2530dc2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:06.694109 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fac0ef69-deff-4c4b-86a8-65e3e2530dc2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:06.695171 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fac0ef69-deff-4c4b-86a8-65e3e2530dc2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:06.695639 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fac0ef69-deff-4c4b-86a8-65e3e2530dc2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:06.834228 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fac0ef69-deff-4c4b-86a8-65e3e2530dc2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:26:06.843018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fac0ef69-deff-4c4b-86a8-65e3e2530dc2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1673 microversion: 2.1 time: 0.162989 Apr 11 20:26:06.843598 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1691/3363] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:06 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:26:07.864789 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2b02bcf-99c6-4191-acc4-9cf229daebba tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:07.865425 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2b02bcf-99c6-4191-acc4-9cf229daebba tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:07.872128 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2b02bcf-99c6-4191-acc4-9cf229daebba tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:07.872576 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2b02bcf-99c6-4191-acc4-9cf229daebba tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:07.873343 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2b02bcf-99c6-4191-acc4-9cf229daebba tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:07.873775 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2b02bcf-99c6-4191-acc4-9cf229daebba tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:07.936164 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2b02bcf-99c6-4191-acc4-9cf229daebba tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed65f3c451f42279c453b8b39c0b83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fac62a5ca449a4bff54bf1ab9446df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:26:07.944739 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2b02bcf-99c6-4191-acc4-9cf229daebba tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 200 len: 1606 microversion: 2.1 time: 0.083748 Apr 11 20:26:07.945493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1673/3364] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:07 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 1606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:26:08.233088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-42db7b93-0f77-4958-b0d7-48c6b5a70266 req-05ada301-2eaf-49e3-99d5-633133a87aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a10e455-7a87-4244-80cc-492865110b8a", "name": "network-vif-deleted", "tag": "7ed292be-e2d5-4826-b287-ad508535b408"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:26:08.243197 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-42db7b93-0f77-4958-b0d7-48c6b5a70266 req-05ada301-2eaf-49e3-99d5-633133a87aae service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:08.243678 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-42db7b93-0f77-4958-b0d7-48c6b5a70266 req-05ada301-2eaf-49e3-99d5-633133a87aae service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:08.256586 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-42db7b93-0f77-4958-b0d7-48c6b5a70266 req-05ada301-2eaf-49e3-99d5-633133a87aae service nova] Creating event network-vif-deleted:7ed292be-e2d5-4826-b287-ad508535b408 for instance 0a10e455-7a87-4244-80cc-492865110b8a on hv-cinder-83078 Apr 11 20:26:08.262208 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-42db7b93-0f77-4958-b0d7-48c6b5a70266 req-05ada301-2eaf-49e3-99d5-633133a87aae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032959 Apr 11 20:26:08.263338 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1692/3365] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:08.962782 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:08.963487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:08.969784 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:08.970227 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:08.970986 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:08.971417 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:08.985140 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] HTTP exception thrown: Instance 0a10e455-7a87-4244-80cc-492865110b8a could not be found. Apr 11 20:26:08.985759 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Returning 404 to user: Instance 0a10e455-7a87-4244-80cc-492865110b8a could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:26:08.986581 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-55496a0b-f025-4cd1-8f7c-fbe82f3775e2 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 404 len: 111 microversion: 2.1 time: 0.027795 Apr 11 20:26:08.987120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1674/3366] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:08 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:26:08.996708 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-98442e83-e7e5-436c-9be9-a9ac26a7f727 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '.version_select at 0x7f408c064a60>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:09.015533 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-98442e83-e7e5-436c-9be9-a9ac26a7f727 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057676952" status: 202 len: 0 microversion: 2.1 time: 0.023424 Apr 11 20:26:09.016116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1693/3367] 10.222.0.62 () {58 vars in 1220 bytes} [Mon Apr 11 20:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057676952 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:26:11.917522 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:11.918062 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:11.924957 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:11.925325 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:11.926084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:11.926530 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:11.939874 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] HTTP exception thrown: Instance 0a10e455-7a87-4244-80cc-492865110b8a could not be found. Apr 11 20:26:11.940449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Returning 404 to user: Instance 0a10e455-7a87-4244-80cc-492865110b8a could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:26:11.941371 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-26b7e8fd-7861-4e20-bb04-83a8efc9c438 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 404 len: 111 microversion: 2.1 time: 0.027752 Apr 11 20:26:11.942110 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1675/3368] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:26:11 2022] DELETE /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:26:11.950676 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:11.951414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: 0a10e455-7a87-4244-80cc-492865110b8a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:11.957675 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:11.958194 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:11.958940 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:11.959367 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:11.972283 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] HTTP exception thrown: Instance 0a10e455-7a87-4244-80cc-492865110b8a could not be found. Apr 11 20:26:11.972852 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Returning 404 to user: Instance 0a10e455-7a87-4244-80cc-492865110b8a could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:26:11.973769 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f2e7a7b-0e1f-46da-974b-cd179c6fe130 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a" status: 404 len: 111 microversion: 2.1 time: 0.027519 Apr 11 20:26:11.974323 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1694/3369] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:11 2022] GET /compute/v2.1/servers/0a10e455-7a87-4244-80cc-492865110b8a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:26:13.119166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:13.119680 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:13.126867 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:13.127320 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:13.128084 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:13.128506 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:13.142282 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] HTTP exception thrown: Instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a could not be found. Apr 11 20:26:13.142953 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Returning 404 to user: Instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:26:13.143783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f562e43f-c0c1-42c0-8da6-fa4465397093 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 404 len: 111 microversion: 2.1 time: 0.028610 Apr 11 20:26:13.144300 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1676/3370] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:26:13 2022] DELETE /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:26:13.152567 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:13.153212 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] [instance: ef80bc27-0d2d-456b-9d3c-dca66a04b84a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:13.160008 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:13.160460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:13.161251 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:13.161687 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:13.175358 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] HTTP exception thrown: Instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a could not be found. Apr 11 20:26:13.175943 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] Returning 404 to user: Instance ef80bc27-0d2d-456b-9d3c-dca66a04b84a could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:26:13.176773 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-39cd9b9f-7d8b-46b3-8eb4-9250b9e35341 tempest-AttachVolumeTestJSON-339161617 tempest-AttachVolumeTestJSON-339161617-project] 10.222.0.62 "GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a" status: 404 len: 111 microversion: 2.1 time: 0.028112 Apr 11 20:26:13.177337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1695/3371] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:13 2022] GET /compute/v2.1/servers/ef80bc27-0d2d-456b-9d3c-dca66a04b84a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:26:18.069401 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2f289c3-7b38-4d90-8161-b3a202e232ee tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] Action: 'create', calling method: .version_select at 0x7f408fe63d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2018874510", "metadata": {"Type": "work"}}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:26:18.373790 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2f289c3-7b38-4d90-8161-b3a202e232ee tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.425390 Apr 11 20:26:18.375253 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1677/3372] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Apr 11 20:26:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 11 20:26:18.390950 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26582125-e506-4f3f-b9b1-365aeb70e11f tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] Calling method '.version_select at 0x7f408c029dc0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:18.443346 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26582125-e506-4f3f-b9b1-365aeb70e11f tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d" status: 200 len: 353 microversion: 2.1 time: 0.056292 Apr 11 20:26:18.443945 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1696/3373] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:26:18 2022] GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:19.456671 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-68169fbd-6fce-47f4-93df-6d428a615377 tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] Calling method '.version_select at 0x7f408fe6e3a0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:19.504377 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-68169fbd-6fce-47f4-93df-6d428a615377 tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d" status: 200 len: 354 microversion: 2.1 time: 0.052103 Apr 11 20:26:19.504975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1678/3374] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:26:19 2022] GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:19.516462 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb4fb0c7-1f82-46f4-9d71-f670952d762b tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] Calling method '.version_select at 0x7f4086df99d0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:19.562207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb4fb0c7-1f82-46f4-9d71-f670952d762b tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d" status: 200 len: 354 microversion: 2.1 time: 0.049925 Apr 11 20:26:19.562842 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1697/3375] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:26:19 2022] GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:19.579812 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9593eda7-f2d6-4a51-aaf6-68a41f60f568 tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] Calling method '.version_select at 0x7f4086dc5af0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:19.642001 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9593eda7-f2d6-4a51-aaf6-68a41f60f568 tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d" status: 202 len: 0 microversion: 2.1 time: 0.066033 Apr 11 20:26:19.642691 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1679/3376] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 20:26:19 2022] DELETE /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:26:19.651207 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a18f8907-5ce7-4f61-b4f7-f5a957daec15 tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] Calling method '.version_select at 0x7f408c029280>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:19.704272 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a18f8907-5ce7-4f61-b4f7-f5a957daec15 tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d" status: 200 len: 353 microversion: 2.1 time: 0.056981 Apr 11 20:26:19.704960 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1698/3377] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:26:19 2022] GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:20.721265 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd132085-afed-405f-9f5b-953e65a1046c tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] Calling method '.version_select at 0x7f408fdfc0d0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:20.757387 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-fd132085-afed-405f-9f5b-953e65a1046c tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] HTTP exception thrown: Volume 135e0d6e-c49b-4ac6-ba73-2de5c9b4917d could not be found. Apr 11 20:26:20.758111 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd132085-afed-405f-9f5b-953e65a1046c tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] Returning 404 to user: Volume 135e0d6e-c49b-4ac6-ba73-2de5c9b4917d could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:26:20.758948 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd132085-afed-405f-9f5b-953e65a1046c tempest-VolumesGetTestJSON-721189947 tempest-VolumesGetTestJSON-721189947-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d" status: 404 len: 109 microversion: 2.1 time: 0.045068 Apr 11 20:26:20.759493 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1680/3378] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:26:20 2022] GET /compute/v2.1/os-volumes/135e0d6e-c49b-4ac6-ba73-2de5c9b4917d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:26:55.529157 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1275656806", "imageRef": "80644718-6e22-4679-8738-4a53961d12da", "flavorRef": "452"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:26:55.581569 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] validate_networks() for None {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 20:26:56.084159 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 20:26:56.084580 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 20:26:56.085088 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 20:26:56.085494 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 20:26:56.085904 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 20:26:56.094885 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:56.095246 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:56.096037 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:56.096467 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:56.113714 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Getting quotas for project 10b2ec1610034444a5623d5972723409. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 20:26:56.117683 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Getting quotas for user c8e4818d17fc46cea722b3be42cdcde7 and project 10b2ec1610034444a5623d5972723409. Resources: {'cores', 'ram', 'instances'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 20:26:56.129333 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 20:26:56.131608 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80644718-6e22-4679-8738-4a53961d12da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 20:26:56.177268 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1bd7f5e-05e6-4870-83e4-d2ff2ab15009 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655339 Apr 11 20:26:56.177913 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1699/3379] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Apr 11 20:26:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 20:26:56.193019 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7656ba09-cef7-4382-98ed-53ecfc3a09d3 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:56.193807 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7656ba09-cef7-4382-98ed-53ecfc3a09d3 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:56.249481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7656ba09-cef7-4382-98ed-53ecfc3a09d3 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:26:56.256333 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7656ba09-cef7-4382-98ed-53ecfc3a09d3 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1215 microversion: 2.1 time: 0.068952 Apr 11 20:26:56.256873 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1681/3380] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:56 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:26:57.273926 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-45905395-9d01-4ae9-b146-cc36ab1ae5d8 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:57.274565 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-45905395-9d01-4ae9-b146-cc36ab1ae5d8 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:57.280767 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45905395-9d01-4ae9-b146-cc36ab1ae5d8 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:57.281257 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45905395-9d01-4ae9-b146-cc36ab1ae5d8 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:57.282022 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45905395-9d01-4ae9-b146-cc36ab1ae5d8 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:57.282460 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45905395-9d01-4ae9-b146-cc36ab1ae5d8 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:57.347402 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-45905395-9d01-4ae9-b146-cc36ab1ae5d8 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:26:57.356397 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-45905395-9d01-4ae9-b146-cc36ab1ae5d8 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1273 microversion: 2.1 time: 0.087032 Apr 11 20:26:57.357000 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1700/3381] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:57 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:26:58.375566 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f151a348-195d-4c72-b4c4-a84627e6c0d5 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:58.376182 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f151a348-195d-4c72-b4c4-a84627e6c0d5 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:58.382706 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f151a348-195d-4c72-b4c4-a84627e6c0d5 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:58.383149 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f151a348-195d-4c72-b4c4-a84627e6c0d5 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:58.383899 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f151a348-195d-4c72-b4c4-a84627e6c0d5 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:58.384329 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f151a348-195d-4c72-b4c4-a84627e6c0d5 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:58.535544 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f151a348-195d-4c72-b4c4-a84627e6c0d5 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:26:58.545482 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f151a348-195d-4c72-b4c4-a84627e6c0d5 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1315 microversion: 2.1 time: 0.173869 Apr 11 20:26:58.546068 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1682/3382] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:58 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:26:58.621987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-12a58e7f-4cf6-440c-a4fe-79b5cedb667e req-3f7ffad5-b0cc-42a7-b5ec-3b908dce030d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837a82ee-2fe8-412d-94ac-96d667fb8401", "tag": "49e0d85e-96d5-4d9e-9730-28152cba79ad"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:26:58.632813 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-12a58e7f-4cf6-440c-a4fe-79b5cedb667e req-3f7ffad5-b0cc-42a7-b5ec-3b908dce030d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:58.633260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-12a58e7f-4cf6-440c-a4fe-79b5cedb667e req-3f7ffad5-b0cc-42a7-b5ec-3b908dce030d service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:58.650025 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-12a58e7f-4cf6-440c-a4fe-79b5cedb667e req-3f7ffad5-b0cc-42a7-b5ec-3b908dce030d service nova] Creating event network-changed:49e0d85e-96d5-4d9e-9730-28152cba79ad for instance 837a82ee-2fe8-412d-94ac-96d667fb8401 on hv-cinder-83078 Apr 11 20:26:58.658948 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-12a58e7f-4cf6-440c-a4fe-79b5cedb667e req-3f7ffad5-b0cc-42a7-b5ec-3b908dce030d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040861 Apr 11 20:26:58.659558 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1701/3383] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:26:59.565758 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae72ce87-e874-4dce-ab6f-b45f7888be0b tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:26:59.566353 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae72ce87-e874-4dce-ab6f-b45f7888be0b tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:26:59.578154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae72ce87-e874-4dce-ab6f-b45f7888be0b tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:59.578743 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae72ce87-e874-4dce-ab6f-b45f7888be0b tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:59.579999 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae72ce87-e874-4dce-ab6f-b45f7888be0b tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:26:59.580717 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae72ce87-e874-4dce-ab6f-b45f7888be0b tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:26:59.715661 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ae72ce87-e874-4dce-ab6f-b45f7888be0b tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:26:59.726486 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae72ce87-e874-4dce-ab6f-b45f7888be0b tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1315 microversion: 2.1 time: 0.167011 Apr 11 20:26:59.727251 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1683/3384] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:26:59 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:00.747656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b1d95e95-a183-4dbf-b60c-a0eac36e78ad tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:00.748475 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b1d95e95-a183-4dbf-b60c-a0eac36e78ad tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:00.756844 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1d95e95-a183-4dbf-b60c-a0eac36e78ad tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:00.757353 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1d95e95-a183-4dbf-b60c-a0eac36e78ad tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:00.758114 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1d95e95-a183-4dbf-b60c-a0eac36e78ad tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:00.758540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1d95e95-a183-4dbf-b60c-a0eac36e78ad tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:00.889269 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b1d95e95-a183-4dbf-b60c-a0eac36e78ad tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:00.896932 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b1d95e95-a183-4dbf-b60c-a0eac36e78ad tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1315 microversion: 2.1 time: 0.156117 Apr 11 20:27:00.897520 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1702/3385] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:00 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:01.922100 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d4536a2f-fab0-49f7-a192-f0f234909928 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:01.922973 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d4536a2f-fab0-49f7-a192-f0f234909928 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:01.931396 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4536a2f-fab0-49f7-a192-f0f234909928 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:01.931842 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4536a2f-fab0-49f7-a192-f0f234909928 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:01.932599 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4536a2f-fab0-49f7-a192-f0f234909928 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:01.933074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4536a2f-fab0-49f7-a192-f0f234909928 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:02.074620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d4536a2f-fab0-49f7-a192-f0f234909928 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:02.082487 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d4536a2f-fab0-49f7-a192-f0f234909928 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1315 microversion: 2.1 time: 0.167069 Apr 11 20:27:02.083061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1684/3386] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:01 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:03.102729 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-844de725-efd3-411f-80e7-47b460ed1d12 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:03.103610 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-844de725-efd3-411f-80e7-47b460ed1d12 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:03.112387 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-844de725-efd3-411f-80e7-47b460ed1d12 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:03.112988 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-844de725-efd3-411f-80e7-47b460ed1d12 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:03.114057 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-844de725-efd3-411f-80e7-47b460ed1d12 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:03.114628 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-844de725-efd3-411f-80e7-47b460ed1d12 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:03.246701 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-844de725-efd3-411f-80e7-47b460ed1d12 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:03.255086 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-844de725-efd3-411f-80e7-47b460ed1d12 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1315 microversion: 2.1 time: 0.158263 Apr 11 20:27:03.255666 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1703/3387] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:03 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:04.275198 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0d42396-430b-4400-b60d-8f764f3a70f9 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:04.275979 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0d42396-430b-4400-b60d-8f764f3a70f9 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:04.285135 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0d42396-430b-4400-b60d-8f764f3a70f9 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:04.285692 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0d42396-430b-4400-b60d-8f764f3a70f9 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:04.286653 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0d42396-430b-4400-b60d-8f764f3a70f9 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:04.287196 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0d42396-430b-4400-b60d-8f764f3a70f9 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:04.424708 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0d42396-430b-4400-b60d-8f764f3a70f9 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:04.433038 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0d42396-430b-4400-b60d-8f764f3a70f9 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1315 microversion: 2.1 time: 0.163775 Apr 11 20:27:04.433620 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1685/3388] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:04 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:04.466896 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-46ae34bd-ec5d-4a2c-9ef1-7a40e40a37f8 req-2a9520d4-e224-4ecd-a11c-ca62ec13cc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837a82ee-2fe8-412d-94ac-96d667fb8401", "name": "network-vif-plugged", "status": "completed", "tag": "49e0d85e-96d5-4d9e-9730-28152cba79ad"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:27:04.475698 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-46ae34bd-ec5d-4a2c-9ef1-7a40e40a37f8 req-2a9520d4-e224-4ecd-a11c-ca62ec13cc07 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:04.476142 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-46ae34bd-ec5d-4a2c-9ef1-7a40e40a37f8 req-2a9520d4-e224-4ecd-a11c-ca62ec13cc07 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:04.487653 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-46ae34bd-ec5d-4a2c-9ef1-7a40e40a37f8 req-2a9520d4-e224-4ecd-a11c-ca62ec13cc07 service nova] Creating event network-vif-plugged:49e0d85e-96d5-4d9e-9730-28152cba79ad for instance 837a82ee-2fe8-412d-94ac-96d667fb8401 on hv-cinder-83078 Apr 11 20:27:04.492656 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-46ae34bd-ec5d-4a2c-9ef1-7a40e40a37f8 req-2a9520d4-e224-4ecd-a11c-ca62ec13cc07 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029472 Apr 11 20:27:04.493273 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1704/3389] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:27:05.454367 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec6bdacd-5f7a-46b0-ab07-62288eb9d8e4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:05.455272 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec6bdacd-5f7a-46b0-ab07-62288eb9d8e4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:05.463678 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec6bdacd-5f7a-46b0-ab07-62288eb9d8e4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:05.464119 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec6bdacd-5f7a-46b0-ab07-62288eb9d8e4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:05.464993 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec6bdacd-5f7a-46b0-ab07-62288eb9d8e4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:05.465441 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec6bdacd-5f7a-46b0-ab07-62288eb9d8e4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:05.678808 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ec6bdacd-5f7a-46b0-ab07-62288eb9d8e4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:05.686819 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec6bdacd-5f7a-46b0-ab07-62288eb9d8e4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1315 microversion: 2.1 time: 0.239276 Apr 11 20:27:05.687391 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1686/3390] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:05 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:06.411631 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ccfdf967-7921-408b-9fb7-2ab1b9905d62 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:06.412266 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-24dd4d4a-e244-4177-a6d5-6b69141ef378 req-d87e306f-c5df-4db3-84e9-97b09cddb05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667623bc-9455-44c7-bdaa-c3eeed390b84", "tag": "cba49c7f-a7cc-4317-8f36-687aad464b69"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:27:06.412414 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ccfdf967-7921-408b-9fb7-2ab1b9905d62 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:06.419795 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccfdf967-7921-408b-9fb7-2ab1b9905d62 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:06.420245 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccfdf967-7921-408b-9fb7-2ab1b9905d62 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:06.420390 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-24dd4d4a-e244-4177-a6d5-6b69141ef378 req-d87e306f-c5df-4db3-84e9-97b09cddb05a service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:06.420897 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-24dd4d4a-e244-4177-a6d5-6b69141ef378 req-d87e306f-c5df-4db3-84e9-97b09cddb05a service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:06.421054 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccfdf967-7921-408b-9fb7-2ab1b9905d62 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:06.421451 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccfdf967-7921-408b-9fb7-2ab1b9905d62 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:06.432383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-24dd4d4a-e244-4177-a6d5-6b69141ef378 req-d87e306f-c5df-4db3-84e9-97b09cddb05a service nova] Creating event network-changed:cba49c7f-a7cc-4317-8f36-687aad464b69 for instance 667623bc-9455-44c7-bdaa-c3eeed390b84 on hv-cinder-83078 Apr 11 20:27:06.437858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-24dd4d4a-e244-4177-a6d5-6b69141ef378 req-d87e306f-c5df-4db3-84e9-97b09cddb05a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029811 Apr 11 20:27:06.438880 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1687/3391] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:27:06.450400 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ccfdf967-7921-408b-9fb7-2ab1b9905d62 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:27:06.540975 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ccfdf967-7921-408b-9fb7-2ab1b9905d62 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 204 len: 0 microversion: 2.1 time: 0.134605 Apr 11 20:27:06.541890 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1705/3392] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:27:06 2022] DELETE /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:27:06.551418 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e1db349c-20c2-4406-ba2c-42c353bd5b05 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:06.552715 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e1db349c-20c2-4406-ba2c-42c353bd5b05 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:06.559220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1db349c-20c2-4406-ba2c-42c353bd5b05 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:06.559672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1db349c-20c2-4406-ba2c-42c353bd5b05 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:06.560449 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1db349c-20c2-4406-ba2c-42c353bd5b05 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:06.560888 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1db349c-20c2-4406-ba2c-42c353bd5b05 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:06.692237 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e1db349c-20c2-4406-ba2c-42c353bd5b05 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:06.700168 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e1db349c-20c2-4406-ba2c-42c353bd5b05 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.153674 Apr 11 20:27:06.700982 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1688/3393] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:06 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:27:06.704614 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-42d3d0c8-904a-4ed7-b0dc-4c6443e5ed3f tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:06.705439 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-42d3d0c8-904a-4ed7-b0dc-4c6443e5ed3f tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:06.711418 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42d3d0c8-904a-4ed7-b0dc-4c6443e5ed3f tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:06.711962 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42d3d0c8-904a-4ed7-b0dc-4c6443e5ed3f tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:06.712877 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42d3d0c8-904a-4ed7-b0dc-4c6443e5ed3f tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:06.713390 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42d3d0c8-904a-4ed7-b0dc-4c6443e5ed3f tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:07.011413 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-42d3d0c8-904a-4ed7-b0dc-4c6443e5ed3f tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:07.019436 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-42d3d0c8-904a-4ed7-b0dc-4c6443e5ed3f tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1465 microversion: 2.1 time: 0.319472 Apr 11 20:27:07.020016 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1706/3394] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:06 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1465 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 20:27:07.059478 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-57e93d7d-a448-47d8-aba2-a2c54c03b614 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:07.060718 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57e93d7d-a448-47d8-aba2-a2c54c03b614 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:07.067101 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57e93d7d-a448-47d8-aba2-a2c54c03b614 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:07.067632 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57e93d7d-a448-47d8-aba2-a2c54c03b614 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:07.068490 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57e93d7d-a448-47d8-aba2-a2c54c03b614 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:07.069046 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57e93d7d-a448-47d8-aba2-a2c54c03b614 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:07.093316 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57e93d7d-a448-47d8-aba2-a2c54c03b614 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 20:27:07.171074 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-57e93d7d-a448-47d8-aba2-a2c54c03b614 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "DELETE /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 204 len: 0 microversion: 2.1 time: 0.115491 Apr 11 20:27:07.171666 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1689/3395] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:27:07 2022] DELETE /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 20:27:07.180059 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-301ff85b-a49e-4c19-b115-b9e66d4f8d94 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:07.180662 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-301ff85b-a49e-4c19-b115-b9e66d4f8d94 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:07.186917 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-301ff85b-a49e-4c19-b115-b9e66d4f8d94 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:07.187362 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-301ff85b-a49e-4c19-b115-b9e66d4f8d94 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:07.188355 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-301ff85b-a49e-4c19-b115-b9e66d4f8d94 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:07.188961 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-301ff85b-a49e-4c19-b115-b9e66d4f8d94 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:07.318051 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-301ff85b-a49e-4c19-b115-b9e66d4f8d94 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:07.325851 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-301ff85b-a49e-4c19-b115-b9e66d4f8d94 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1471 microversion: 2.1 time: 0.149795 Apr 11 20:27:07.326465 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1707/3396] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:07 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:07.718381 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eec16870-2e86-496d-8cd8-3d8376dd1373 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:07.719121 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eec16870-2e86-496d-8cd8-3d8376dd1373 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:07.725559 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eec16870-2e86-496d-8cd8-3d8376dd1373 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:07.726004 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eec16870-2e86-496d-8cd8-3d8376dd1373 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:07.726767 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eec16870-2e86-496d-8cd8-3d8376dd1373 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:07.727201 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eec16870-2e86-496d-8cd8-3d8376dd1373 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:07.861990 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eec16870-2e86-496d-8cd8-3d8376dd1373 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:07.870134 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eec16870-2e86-496d-8cd8-3d8376dd1373 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.156153 Apr 11 20:27:07.871048 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1690/3397] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:07 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:08.347987 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f268337e-86f4-4ee8-8779-fb6d2fb61fa4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:08.348882 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f268337e-86f4-4ee8-8779-fb6d2fb61fa4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:08.356306 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f268337e-86f4-4ee8-8779-fb6d2fb61fa4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:08.356754 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f268337e-86f4-4ee8-8779-fb6d2fb61fa4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:08.357540 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f268337e-86f4-4ee8-8779-fb6d2fb61fa4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:08.357973 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f268337e-86f4-4ee8-8779-fb6d2fb61fa4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:08.490942 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f268337e-86f4-4ee8-8779-fb6d2fb61fa4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:08.499014 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f268337e-86f4-4ee8-8779-fb6d2fb61fa4 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1471 microversion: 2.1 time: 0.157762 Apr 11 20:27:08.499577 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1708/3398] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:08 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:08.892079 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66eb9633-547d-42aa-91b1-2f46f80c4a65 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:08.893076 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-66eb9633-547d-42aa-91b1-2f46f80c4a65 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:08.903783 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66eb9633-547d-42aa-91b1-2f46f80c4a65 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:08.904515 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66eb9633-547d-42aa-91b1-2f46f80c4a65 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:08.905800 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66eb9633-547d-42aa-91b1-2f46f80c4a65 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:08.906507 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66eb9633-547d-42aa-91b1-2f46f80c4a65 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:09.054524 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-66eb9633-547d-42aa-91b1-2f46f80c4a65 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:09.062061 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-66eb9633-547d-42aa-91b1-2f46f80c4a65 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1567 microversion: 2.1 time: 0.176478 Apr 11 20:27:09.071399 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1691/3399] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:08 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:09.518335 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a0c57fe5-06cc-4f23-b1f4-8ea6d0b00d22 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:09.519780 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a0c57fe5-06cc-4f23-b1f4-8ea6d0b00d22 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:09.528260 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0c57fe5-06cc-4f23-b1f4-8ea6d0b00d22 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:09.528800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0c57fe5-06cc-4f23-b1f4-8ea6d0b00d22 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:09.529887 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0c57fe5-06cc-4f23-b1f4-8ea6d0b00d22 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:09.530426 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0c57fe5-06cc-4f23-b1f4-8ea6d0b00d22 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:09.653260 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-23a61287-d77c-42f0-afbf-a704bb67d0d7 req-098dd939-5cc5-4e6e-aa82-521e31ea2849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667623bc-9455-44c7-bdaa-c3eeed390b84", "name": "network-vif-deleted", "tag": "cba49c7f-a7cc-4317-8f36-687aad464b69"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:27:09.685057 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-23a61287-d77c-42f0-afbf-a704bb67d0d7 req-098dd939-5cc5-4e6e-aa82-521e31ea2849 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:09.686006 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-23a61287-d77c-42f0-afbf-a704bb67d0d7 req-098dd939-5cc5-4e6e-aa82-521e31ea2849 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:09.722886 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a0c57fe5-06cc-4f23-b1f4-8ea6d0b00d22 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e4818d17fc46cea722b3be42cdcde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b2ec1610034444a5623d5972723409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:09.724847 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-23a61287-d77c-42f0-afbf-a704bb67d0d7 req-098dd939-5cc5-4e6e-aa82-521e31ea2849 service nova] Creating event network-vif-deleted:cba49c7f-a7cc-4317-8f36-687aad464b69 for instance 667623bc-9455-44c7-bdaa-c3eeed390b84 on hv-cinder-83078 Apr 11 20:27:09.732236 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a0c57fe5-06cc-4f23-b1f4-8ea6d0b00d22 tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 200 len: 1471 microversion: 2.1 time: 0.219466 Apr 11 20:27:09.733791 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1709/3400] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:09 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:09.737208 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-23a61287-d77c-42f0-afbf-a704bb67d0d7 req-098dd939-5cc5-4e6e-aa82-521e31ea2849 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108981 Apr 11 20:27:09.743481 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1692/3401] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:27:09.756345 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-fd8f5732-4f9c-4e37-b835-086c94633862 req-2b7bca53-3f30-44ca-99b2-650fe7eb7689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837a82ee-2fe8-412d-94ac-96d667fb8401", "name": "network-vif-deleted", "tag": "49e0d85e-96d5-4d9e-9730-28152cba79ad"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:27:09.767063 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-fd8f5732-4f9c-4e37-b835-086c94633862 req-2b7bca53-3f30-44ca-99b2-650fe7eb7689 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:09.767495 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-fd8f5732-4f9c-4e37-b835-086c94633862 req-2b7bca53-3f30-44ca-99b2-650fe7eb7689 service nova] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:09.779859 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-fd8f5732-4f9c-4e37-b835-086c94633862 req-2b7bca53-3f30-44ca-99b2-650fe7eb7689 service nova] Creating event network-vif-deleted:49e0d85e-96d5-4d9e-9730-28152cba79ad for instance 837a82ee-2fe8-412d-94ac-96d667fb8401 on hv-cinder-83078 Apr 11 20:27:09.787348 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-fd8f5732-4f9c-4e37-b835-086c94633862 req-2b7bca53-3f30-44ca-99b2-650fe7eb7689 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034947 Apr 11 20:27:09.788011 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1710/3402] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Apr 11 20:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:27:10.088247 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e5f54e49-0d8f-4259-b4c2-02d92b8f5ee9 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:10.089216 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e5f54e49-0d8f-4259-b4c2-02d92b8f5ee9 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:10.096730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5f54e49-0d8f-4259-b4c2-02d92b8f5ee9 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:10.097222 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5f54e49-0d8f-4259-b4c2-02d92b8f5ee9 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:10.097975 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5f54e49-0d8f-4259-b4c2-02d92b8f5ee9 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:10.098397 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5f54e49-0d8f-4259-b4c2-02d92b8f5ee9 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:10.176197 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5f54e49-0d8f-4259-b4c2-02d92b8f5ee9 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e2b4af246a4f5fa21af2954872d022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20dc3215424969b60db8972a86d057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 20:27:10.194172 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e5f54e49-0d8f-4259-b4c2-02d92b8f5ee9 tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 200 len: 1219 microversion: 2.1 time: 0.111491 Apr 11 20:27:10.195220 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1693/3403] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:10 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 20:27:10.755315 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:10.756238 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] [instance: 837a82ee-2fe8-412d-94ac-96d667fb8401] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:10.767337 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:10.768108 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:10.769597 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:10.770301 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:10.784661 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] HTTP exception thrown: Instance 837a82ee-2fe8-412d-94ac-96d667fb8401 could not be found. Apr 11 20:27:10.785623 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] Returning 404 to user: Instance 837a82ee-2fe8-412d-94ac-96d667fb8401 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:27:10.786433 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-392034c6-b282-422a-8347-62200b73b32c tempest-VolumesNegativeTest-919779068 tempest-VolumesNegativeTest-919779068-project] 10.222.0.62 "GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401" status: 404 len: 111 microversion: 2.1 time: 0.038541 Apr 11 20:27:10.786957 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1711/3404] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:10 2022] GET /compute/v2.1/servers/837a82ee-2fe8-412d-94ac-96d667fb8401 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:27:11.213205 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:11.214009 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] [instance: 667623bc-9455-44c7-bdaa-c3eeed390b84] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:27:11.221802 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:11.222322 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:11.223154 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:27:11.223672 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:27:11.237383 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] HTTP exception thrown: Instance 667623bc-9455-44c7-bdaa-c3eeed390b84 could not be found. Apr 11 20:27:11.237976 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Returning 404 to user: Instance 667623bc-9455-44c7-bdaa-c3eeed390b84 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:27:11.238805 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8470423f-c435-4042-b3a3-0ca6917b38bb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84" status: 404 len: 111 microversion: 2.1 time: 0.029558 Apr 11 20:27:11.239350 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1694/3405] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:27:11 2022] GET /compute/v2.1/servers/667623bc-9455-44c7-bdaa-c3eeed390b84 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:27:11.402736 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5ea08f5-6734-41d9-808c-0f34348699eb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] Calling method '.version_select at 0x7f4086e1b040>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:27:11.428018 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5ea08f5-6734-41d9-808c-0f34348699eb tempest-TestShelveInstance-11057609 tempest-TestShelveInstance-11057609-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-810902360" status: 202 len: 0 microversion: 2.1 time: 0.029327 Apr 11 20:27:11.428632 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1712/3406] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Apr 11 20:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-810902360 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:28:24.429278 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:24.429858 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:28:24.436166 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:28:24.436613 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:28:24.437403 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:28:24.437836 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:28:24.451796 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 could not be found. Apr 11 20:28:24.452308 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:28:24.453239 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9f4a3233-1622-414d-a823-3f1f50ebea53 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 404 len: 111 microversion: 2.1 time: 0.028842 Apr 11 20:28:24.453757 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1695/3407] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Apr 11 20:28:24 2022] DELETE /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:28:24.463442 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:24.464064 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] [instance: 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 20:28:24.471079 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:28:24.471528 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:28:24.472286 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 20:28:24.472721 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Lock "52b6058f-23f3-4720-b8c1-0d0a04c26f0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 20:28:24.485891 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] HTTP exception thrown: Instance 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 could not be found. Apr 11 20:28:24.486486 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] Returning 404 to user: Instance 6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:28:24.487305 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90dfb0ca-15fa-4420-ad56-98416ccaca92 tempest-AttachVolumeNegativeTest-1608782510 tempest-AttachVolumeNegativeTest-1608782510-project] 10.222.0.62 "GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4" status: 404 len: 111 microversion: 2.1 time: 0.029243 Apr 11 20:28:24.487854 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1713/3408] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Apr 11 20:28:24 2022] GET /compute/v2.1/servers/6c6ddfe3-e601-44f1-8869-d4ed5d93c8a4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 20:28:29.103845 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-45da8c97-691e-4e81-9549-2b604bf935ba tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Action: 'create', calling method: .version_select at 0x7f4086dde790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-336838568"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:28:29.496776 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-45da8c97-691e-4e81-9549-2b604bf935ba tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.507642 Apr 11 20:28:29.497631 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1696/3409] 10.222.0.62 () {60 vars in 1154 bytes} [Mon Apr 11 20:28:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 509 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 11 20:28:29.509389 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a0a99ac8-fcb0-420e-b850-65a1717ce6cb tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f4086e1bf70>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:29.558148 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a0a99ac8-fcb0-420e-b850-65a1717ce6cb tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f" status: 200 len: 344 microversion: 2.1 time: 0.052967 Apr 11 20:28:29.558735 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1714/3410] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:28:29 2022] GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:30.576169 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-814f6dcd-1d7c-4eab-b366-ef8dfc0018d9 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f4086d1fb80>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:30.634240 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-814f6dcd-1d7c-4eab-b366-ef8dfc0018d9 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f" status: 200 len: 345 microversion: 2.1 time: 0.065386 Apr 11 20:28:30.634804 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1697/3411] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:28:30 2022] GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:30.646377 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e9caff1e-67eb-4477-bed1-b4dfe1296fe0 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Action: 'create', calling method: .version_select at 0x7f4086d5c5e0>, body: {"snapshot": {"volume_id": "a445ff31-36ed-487d-9551-289405faf04f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1131173268"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 20:28:30.804136 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e9caff1e-67eb-4477-bed1-b4dfe1296fe0 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.161487 Apr 11 20:28:30.804815 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1715/3412] 10.222.0.62 () {60 vars in 1161 bytes} [Mon Apr 11 20:28:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:30.814883 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ada72cc2-d0bf-438d-998c-e4113bafa761 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f408c07e940>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:30.843686 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ada72cc2-d0bf-438d-998c-e4113bafa761 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2" status: 200 len: 287 microversion: 2.1 time: 0.032782 Apr 11 20:28:30.844402 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1698/3413] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Apr 11 20:28:30 2022] GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:30.854167 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3c6759d6-beab-42a1-a95b-3c30f1ef9514 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f408fedd670>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:30.883332 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3c6759d6-beab-42a1-a95b-3c30f1ef9514 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033040 Apr 11 20:28:30.883894 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1716/3414] 10.222.0.62 () {58 vars in 1139 bytes} [Mon Apr 11 20:28:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:30.894090 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d735a759-4881-48a7-a426-3cf4d78a02e9 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f408fe8eb80>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:30.922364 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d735a759-4881-48a7-a426-3cf4d78a02e9 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2" status: 200 len: 287 microversion: 2.1 time: 0.032084 Apr 11 20:28:30.922927 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1699/3415] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Apr 11 20:28:30 2022] GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:31.937964 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2f06095a-448e-4988-b866-43a77612732a tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f4086df98b0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:31.973625 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2f06095a-448e-4988-b866-43a77612732a tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2" status: 200 len: 287 microversion: 2.1 time: 0.042189 Apr 11 20:28:31.974184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1717/3416] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Apr 11 20:28:31 2022] GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:32.990929 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9af80599-64cd-450d-9966-e59fc8a467db tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f4086dc5f70>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:33.033311 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9af80599-64cd-450d-9966-e59fc8a467db tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2" status: 200 len: 287 microversion: 2.1 time: 0.049602 Apr 11 20:28:33.034136 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1700/3417] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Apr 11 20:28:32 2022] GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:34.046392 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c8a985f0-2f94-4524-9706-aad20ab21f98 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f408c0d6790>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:34.076180 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c8a985f0-2f94-4524-9706-aad20ab21f98 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2" status: 200 len: 288 microversion: 2.1 time: 0.034207 Apr 11 20:28:34.076723 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1718/3418] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Apr 11 20:28:34 2022] GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:34.087730 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c98816ec-717a-4af2-bf82-f1162fb6b2d4 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f4086db1790>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:34.144392 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c98816ec-717a-4af2-bf82-f1162fb6b2d4 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2" status: 202 len: 0 microversion: 2.1 time: 0.060901 Apr 11 20:28:34.145091 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1701/3419] 10.222.0.62 () {58 vars in 1253 bytes} [Mon Apr 11 20:28:34 2022] DELETE /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:28:34.153480 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2b483b1-ec12-44a3-809e-07f8aa80f0e4 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f4086df9040>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:34.182517 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2b483b1-ec12-44a3-809e-07f8aa80f0e4 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2" status: 200 len: 287 microversion: 2.1 time: 0.032987 Apr 11 20:28:34.183115 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1719/3420] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Apr 11 20:28:34 2022] GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 20:28:35.198849 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4038e768-a973-4ccd-ab73-4663a7c54617 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f408fe6eaf0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:35.225097 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-4038e768-a973-4ccd-ab73-4663a7c54617 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] HTTP exception thrown: Snapshot 63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 could not be found. Apr 11 20:28:35.225711 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4038e768-a973-4ccd-ab73-4663a7c54617 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Returning 404 to user: Snapshot 63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:28:35.226553 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4038e768-a973-4ccd-ab73-4663a7c54617 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2" status: 404 len: 111 microversion: 2.1 time: 0.034898 Apr 11 20:28:35.227083 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1702/3421] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Apr 11 20:28:35 2022] GET /compute/v2.1/os-snapshots/63c738b3-82e7-4ae8-bdf5-62f3d8eb0ad2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:28:35.236053 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e916ebad-d2fb-49e0-9798-d00b8d4cb04e tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f4086f408b0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:35.300342 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e916ebad-d2fb-49e0-9798-d00b8d4cb04e tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f" status: 202 len: 0 microversion: 2.1 time: 0.068718 Apr 11 20:28:35.301307 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1720/3422] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 20:28:35 2022] DELETE /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 20:28:35.309616 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f9c4166-5fce-4d8e-a6ee-63b8f6de3218 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f4086dde310>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:35.357772 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f9c4166-5fce-4d8e-a6ee-63b8f6de3218 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f" status: 200 len: 344 microversion: 2.1 time: 0.051892 Apr 11 20:28:35.358314 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1703/3423] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:28:35 2022] GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 20:28:36.375363 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-03ee7644-a246-4a7c-8d38-f54bf8b8b90f tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f408c0648b0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:36.411590 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-03ee7644-a246-4a7c-8d38-f54bf8b8b90f tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] HTTP exception thrown: Volume a445ff31-36ed-487d-9551-289405faf04f could not be found. Apr 11 20:28:36.412184 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-03ee7644-a246-4a7c-8d38-f54bf8b8b90f tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Returning 404 to user: Volume a445ff31-36ed-487d-9551-289405faf04f could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:28:36.413027 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-03ee7644-a246-4a7c-8d38-f54bf8b8b90f tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f" status: 404 len: 109 microversion: 2.1 time: 0.045395 Apr 11 20:28:36.413553 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1721/3424] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:28:36 2022] GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:28:36.427959 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0c222343-3cb4-4ab4-a486-3884fea56f28 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f408fe6edc0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:36.459636 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-0c222343-3cb4-4ab4-a486-3884fea56f28 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] HTTP exception thrown: Volume a445ff31-36ed-487d-9551-289405faf04f could not be found. Apr 11 20:28:36.460250 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0c222343-3cb4-4ab4-a486-3884fea56f28 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Returning 404 to user: Volume a445ff31-36ed-487d-9551-289405faf04f could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:28:36.461120 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0c222343-3cb4-4ab4-a486-3884fea56f28 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f" status: 404 len: 109 microversion: 2.1 time: 0.037673 Apr 11 20:28:36.461642 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1704/3425] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Apr 11 20:28:36 2022] DELETE /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:28:36.469476 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e0c628db-1ada-48dc-8aca-46140f92b617 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Calling method '.version_select at 0x7f408c0294c0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 20:28:36.497619 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-e0c628db-1ada-48dc-8aca-46140f92b617 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] HTTP exception thrown: Volume a445ff31-36ed-487d-9551-289405faf04f could not be found. Apr 11 20:28:36.498211 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e0c628db-1ada-48dc-8aca-46140f92b617 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] Returning 404 to user: Volume a445ff31-36ed-487d-9551-289405faf04f could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 20:28:36.499116 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e0c628db-1ada-48dc-8aca-46140f92b617 tempest-VolumesSnapshotsTestJSON-1520076119 tempest-VolumesSnapshotsTestJSON-1520076119-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f" status: 404 len: 109 microversion: 2.1 time: 0.033393 Apr 11 20:28:36.499648 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1722/3426] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Apr 11 20:28:36 2022] GET /compute/v2.1/os-volumes/a445ff31-36ed-487d-9551-289405faf04f => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 20:29:24.730800 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:29:24.731636 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:29:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:29:44.053974 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:29:44.055132 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:29:58.522372 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:29:58.523509 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:29:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:30:25.764452 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:30:25.765415 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:31:23.568312 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:31:23.569335 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:32:44.741490 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:32:44.742384 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:32:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:32:47.644806 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:32:47.645762 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:33:04.067253 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:33:04.067845 dv-cinder-830787-3-iscsi devstack@n-api.service[123637]: Mon Apr 11 20:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:33:18.536102 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:33:18.537011 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:33:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:33:45.778281 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:33:45.779318 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:33:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 20:34:43.580669 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 20:34:43.581694 dv-cinder-830787-3-iscsi devstack@n-api.service[123638]: Mon Apr 11 20:34:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!